<?xml version="1.0" encoding="UTF-8"?><rss xmlns:dc="http://purl.org/dc/elements/1.1/" xmlns:content="http://purl.org/rss/1.0/modules/content/" xmlns:atom="http://www.w3.org/2005/Atom" version="2.0" xmlns:cc="http://cyber.law.harvard.edu/rss/creativeCommonsRssModule.html">
    <channel>
        <title><![CDATA[Stories by Nelson Buainain on Medium]]></title>
        <description><![CDATA[Stories by Nelson Buainain on Medium]]></description>
        <link>https://medium.com/@wildmon_nelson?source=rss-afa3e0bdec35------2</link>
        <image>
            <url>https://cdn-images-1.medium.com/fit/c/150/150/1*D8__6JiPeJx2JhvXEb638A.jpeg</url>
            <title>Stories by Nelson Buainain on Medium</title>
            <link>https://medium.com/@wildmon_nelson?source=rss-afa3e0bdec35------2</link>
        </image>
        <generator>Medium</generator>
        <lastBuildDate>Wed, 18 Nov 2026 19:35:46 GMT</lastBuildDate>
        <atom:link href="https://medium.com/@wildmon_nelson/feed" rel="self" type="application/rss+xml"/>
        <webMaster><![CDATA[yourfriends@medium.com]]></webMaster>
        <atom:link href="http://medium.superfeedr.com/" rel="hub"/>
        <item>
            <title><![CDATA[Turning Audio Recordings into Conservation Action: A Scalable AI Workflow for Biodiversity…]]></title>
            <link>https://medium.com/@wildmon_nelson/turning-audio-recordings-into-conservation-action-a-scalable-ai-workflow-for-biodiversity-9b027ba17a88?source=rss-afa3e0bdec35------2</link>
            <guid isPermaLink="false">https://medium.com/p/9b027ba17a88</guid>
            <category><![CDATA[biodiversity]]></category>
            <category><![CDATA[audio]]></category>
            <category><![CDATA[conservation]]></category>
            <category><![CDATA[embedding]]></category>
            <dc:creator><![CDATA[Nelson Buainain]]></dc:creator>
            <pubDate>Thu, 02 Oct 2025 14:15:36 GMT</pubDate>
            <atom:updated>2025-10-02T14:15:36.226Z</atom:updated>
            <content:encoded><![CDATA[<h3>Turning Audio Recordings into Conservation Action: A Scalable AI Workflow for Biodiversity Monitoring</h3><h4>How we’re using open data, AI models, and cloud infrastructure to help communities detect and monitor species faster, cheaper, and at scale</h4><p>Across the world, passive acoustic recorders are capturing the sounds of wildlife, from tropical frogs to elusive forest birds. Collecting audio is only the beginning though. For most conservation groups, the real challenge comes next:</p><blockquote><strong><em>How do you transform millions of minutes of recordings into useful, trustworthy biodiversity data, without costly infrastructure, time-consuming manual processing, or heavy dependence on data scientists and coding experts to run complex analyses?</em></strong></blockquote><p>At <a href="https://wildmon.ai/"><strong>WildMon</strong></a>, we’ve spent the last year developing a scalable, cloud-ready workflow to solve this problem. Built for modularity and grounded in real-world field constraints, the system combines <strong>pre-trained AI models</strong>, <strong>open biodiversity data</strong>, and <strong>smart and intuitive validation tools</strong> to support acoustic monitoring across diverse ecosystems.</p><p>We’ve applied this workflow across <strong>14 projects in 10 countries</strong>, processing <strong>over 10 million minutes of audio</strong>, detecting hundreds of species, including birds, mammals, amphibians, and insects, and helping local teams answer critical ecological questions.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/944/1*p58UvlkQvqf-hrzTt4gcWA.png" /><figcaption>Real-world applications of our scalable workflow, deployed in 14 biodiversity monitoring projects across the Americas, Africa, and Asia.</figcaption></figure><p>Now, we’re preparing to turn this workflow into an <strong>open-source platform</strong> that communities around the world can use, without coding expertise required, to monitor biodiversity where it matters most.</p><h3>A Shared, Scalable Framework for Acoustic Monitoring</h3><p>Our goal was to create a system that’s:</p><ul><li><strong>Accessible</strong> — so that even non-technical teams can use it.</li><li><strong>Efficient</strong> — powered by <a href="https://milvus.io/ai-quick-reference/what-are-audio-embeddings-and-how-are-they-generated">embeddings</a> (compact numerical representations of sound that make audio easy to analyze) and parallel cloud computing to cut costs and speed up results.</li><li><strong>Modular</strong> — compatible with multiple AI models and components, allowing future sustainability as technology advances.</li><li><strong>Collaborative </strong>— built so teams around the world can work together, validate detections, and improve the system.</li><li><strong>Community-driven</strong>—Improves over time as people add new species, data, and models that are open to everyone.</li></ul><p>At the heart of the workflow is a simple but powerful idea:<br> → <strong>Extract audio embeddings once</strong>, and use them to drive everything else: classification, search, model training, and analysis.</p><p>Here’s how the workflow works in practice:</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*yX26YdtgdLrLyCzNOnhB3Q.jpeg" /><figcaption>Workflow overview for scalable acoustic biodiversity monitoring, from data upload to insights.</figcaption></figure><h3>①–③ Process and Embed Audio</h3><p>Recordings are uploaded into <a href="https://cloud.google.com/storage/docs/buckets">Google Cloud Storage</a>, segmented, and passed through a pre-trained <strong>foundation model</strong> like <a href="https://birdnet.cornell.edu/">BirdNET</a>, <a href="https://www.kaggle.com/models/google/bird-vocalization-classifier">Perch</a>, or <a href="https://arxiv.org/abs/2403.10380">BirdSET</a>, to generate embeddings — compact, reusable numerical representations of sound. This step is the most computationally intensive, but it only happens once per dataset.</p><p>We use a parallelized cloud infrastructure in <a href="https://cloud.google.com/?utm_source=google&amp;utm_medium=cpc&amp;utm_campaign=latam-LATAM-all-es-dr-BKWS-all-all-trial-e-dr-1710136-LUAC0010197&amp;utm_content=text-ad-none-any-DEV_c-CRE_512379899417-ADGP_Hybrid+%7C+BKWS+-+EXA+%7C+Txt_GCP-General-KWID_43700062784667386-kwd-301173107424&amp;utm_term=KW_google+cloud-ST_Google+Cloud&amp;gad_source=1&amp;gad_campaignid=6492207325&amp;gclid=CjwKCAjwvuLDBhAOEiwAPtF0VvHqk-VMgJArDp7RbUG2LEls8m2nwwdKiGfV33Q7ACqtFmoCRYlrpBoCjZgQAvD_BwE&amp;gclsrc=aw.ds&amp;hl=en">Google Cloud</a> to distribute the workload. We also compute <a href="https://ecohack.shinyapps.io/Acoustic_Index_Users_Guide/">acoustic indices</a> for ecological analysis. Everything is saved in compressed format for fast access downstream.</p><h3>④ Search Species</h3><h4>Generate a Local Species List</h4><p>Using the recording coordinates, we query biodiversity occurrences databases like <a href="https://www.gbif.org/"><strong>GBIF</strong></a> to generate a tailored list of species expected in the area. This helps focus downstream analysis by:</p><ul><li>Filtering classifier model results to only show geographically relevant species</li><li>Identifying rare or overlooked species not covered by current models, especially frogs, insects, and mammals that are missing in the bird-focused foundations models</li><li>Searching open audio repositories like <a href="https://xeno-canto.org/">Xeno-Canto</a> and <a href="https://www.inaturalist.org/">iNaturalist</a>, for example, for reference calls of those missing species to power embeddings similarity search</li></ul><p>This component can easily evolve to a more comprehensive and model-based species list, such as the new <strong>AI-based geospatial tools</strong> from <a href="https://www.inaturalist.org/blog/84677-introducing-the-inaturalist-geomodel">iNaturalist GeoModel</a>, to further improve accuracy in under-sampled regions.</p><h4>Detect Species Using AI Models and Embedding Search</h4><p>Once we have the embeddings and species list, we detect vocal species using two approaches:</p><ul><li><strong>AI classifiers</strong> (e.g., original BirdNET or lightweight custom/regional models based on the chosen foundation model) can quickly recognize the “bulk” of species with high performance. They’re especially effective for the most common species, and custom versions can boost performance for local contexts or expand coverage to other species if enough training data are available.</li><li><a href="https://www.frontiersin.org/journals/ecology-and-evolution/articles/10.3389/fevo.2024.1409407/full"><strong>Embeddings similarity search</strong></a><strong> </strong>works<strong> </strong>like a “find similar sounds” tool. We take one or more reference calls of a species (say, a frog call from <a href="https://xeno-canto.org/">Xeno-Canto</a>) and compare their embeddings to all the embeddings in our dataset. Using a similarity measure (cosine distance), we can flag recordings that closely match. This lets us detect rare, local, or understudied species that aren’t included in the existing classifiers.</li></ul><p>This dual approach allows us to cover a wider range of taxa, including rare or local species not present in foundation models. Searches are fast and efficient, since they operate on pre-computed embeddings, not raw audio, allowing fast iterations.</p><h3>⑤ Validate What Matters, Not Everything</h3><p>Our web-based validation tool makes it easy to review detections. Each record comes with an audio snippet, spectrogram, and example calls from the species, making it intuitive even for non-experts to contribute.</p><p>But what really saves time is how the tool <strong>helps you focus only on what matters</strong>. Instead of reviewing thousands of detections, smart filters guide the process based on your ecological goal:</p><ul><li>Want a quick species list? Just check the top result per species.</li><li>Doing trend or spatial modeling? Focus on one of the top detections per site per day.</li><li>Building a custom classifier? Sample across high and low confidence scores for <a href="https://arxiv.org/pdf/2505.03071">iterative active learning</a> modeling.</li></ul><p>This means you validate just what you need, not everything. It’s a flexible, human-in-the-loop, efficient system to turn raw AI results into reliable biodiversity data, with minimal effort and maximum impact.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*HaQjqGQUVGCWc-ui3yzSBw.png" /><figcaption>A human-in-the-loop interface for validating AI-generated detections, using reference calls for support and filters to prioritize effort — here showing a jaguar calling in the forests of Guyana.</figcaption></figure><h3>⑥ Exporting Results and Generating Ecological Insights</h3><p>Once detections are validated, they can be exported in multiple formats, ready for <strong>ecological analysis, reporting, and sharing</strong>. Outputs include:</p><ul><li><strong>Species lists and site-level summaries</strong> for inventories and quick assessments</li><li><strong>Detection-level tables</strong> for modeling presence, activity patterns, or trends</li><li><a href="https://www.gbif.org/darwin-core"><strong>Darwin Core (DwC)</strong></a><strong> Standard</strong>, a format used to publish species records to <strong>GBIF</strong> and also integrated into <strong>WildMon’s dashboards</strong>, making it easy to share validated data with global databases and local partners alike.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*4B6uy08o4px4OimfBmyWgw.png" /><figcaption>Exported results can be visualized in <a href="https://dashboard.wildmon.ai/project/pdbff/">an interactive dashboard</a> to gain quick ecological insights.</figcaption></figure><h3>⑦ Build Smarter Models as You Validate</h3><p>And here’s where it gets powerful: Users can leverage their validated data to <strong>train and reapply lightweight </strong><a href="https://www.nature.com/articles/s41598-023-49989-z"><strong>custom classifiers</strong> directly on the embeddings</a>, dramatically improving results over time. These models are fast to deploy, don’t require deep learning knowledge, and make the system smarter with each iteration.</p><h3>Real-World Impact Across 14 Projects</h3><p>We applied this workflow across 14 conservation projects in 10 countries, spanning a range of ecosystems, animal groups and goals, showing its broad application.</p><ul><li><strong>Scale:</strong> Each project processed an average of <strong>875,000 minutes</strong> of audio (≈3 TB), targeting around <strong>455 species</strong> per region based on GBIF data.</li><li><strong>Results:</strong> After human validation of AI detections, an average of <strong>178 species</strong> were confirmed per project, mostly birds, but also amphibians, mammals, and insects. Notably, an average of 6.3 endangered species per project were identified, based on IUCN classifications. Compared to traditional methods relying on manual inspection of subsets followed by template matching (<a href="https://www.mdpi.com/2072-4292/14/18/4565">see our prior work here</a>), this workflow has increased species detection rates by roughly <strong>40%</strong>, uncovering a broader and more diverse range of vocal species.</li></ul><figure><img alt="" src="https://cdn-images-1.medium.com/max/590/1*nM06psVSiduspsWbzCpt9w.png" /><figcaption>Acoustic monitoring revealed a wide taxonomic range, with birds most common and an average of 6.3 endangered species detected per project</figcaption></figure><ul><li><strong>Efficiency:</strong> on average, it took around<strong> 2 hours of processing </strong>to go from 3 TB of raw audio to species detections ready for validation,<strong> </strong>showing how scalable and practical this approach can be, even for large datasets.</li></ul><p>In Kenya, the acoustic workflow enabled us to analyze hundreds of hours of soundscape data, showing how Forest Garden initiatives, led by farmers working with <a href="https://trees.org/">Trees for the Future</a> and supported by <a href="https://catona.com/">Catona</a>, foster complex habitats, elevate species diversity, and offer a powerful model for integrating biodiversity conservation with food security and local livelihoods.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*AI3Pnv9vIJ26toyrpphIyA.jpeg" /><figcaption>Local community member deploying an acoustic sensor for biodiversity monitoring in a Forest Garden, Kenya. Source: Trees for the future <a href="https://www.instagram.com/p/DG3PiULP3Uh/">Instagram page</a></figcaption></figure><p>In the <strong>U.S. Virgin Islands</strong>, our acoustic pipeline helped the <a href="https://dpnr.vi.gov/">Department of Planning &amp; Natural Resources</a> map the distribution of endemic and threatened species, shaping conservation priorities across the islands. This data was also used by the Southeast Conservation Adaptation Strategy (SECAS) to refine conservation opportunity areas and corridors for the territory in the <a href="https://blueprintgeography.org/explorer">Blueprint Explorer</a>.</p><p>In Brazil, the workflow is being used to provide clear evidence on how forest restoration efforts led by local communities, with support from <a href="https://www.weforest.org/">WeForest</a> and <a href="https://ipe.org.br/en/">IPÊ</a>, are enhancing habitat complexity and boosting bird diversity across fragmented Atlantic Forest landscapes.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/1024/1*irrqjsiaSajodtLbX9qUOg.jpeg" /><figcaption>Community-led forest restoration reconnects fragmented Atlantic Forest habitats, boosting biodiversity in Brazil. Photo: <a href="https://www.weforest.org/">WeForest</a>.</figcaption></figure><p>In <strong>Mexico’s Yucatán Peninsula</strong>, Ecosfera and ConMonoMaya members and researchers from Universidad Veracruzana trained a custom model to detect <strong>Geoffroy’s spider monkey</strong> (<em>Ateles geoffroyi</em>), an endangered species not covered by general classifiers. Starting with only a handful of examples, they used an active learning workflow to run three cycles of validation and retraining. With each iteration, the model uncovered new detections at previously unconfirmed sites, showing how even limited data, when paired with expert validation, can power adaptive and effective species monitoring.</p><figure><img alt="" src="https://cdn-images-1.medium.com/max/808/0*vAwbXK0SMbbJLLb9" /><figcaption>Endangered Geoffroy’s spider monkeys were detected in multiple new sites in the Yucatán Peninsula, Mexico, using just a few initial examples and a custom-trained model.</figcaption></figure><p>These examples illustrate how the workflow adapts to different conservation needs, from restoration and planning to species-specific monitoring, enabling partners to generate insights from audio in a matter of hours, not months.</p><h3>Why This Matters</h3><p>Most biodiversity monitoring tools aren’t built for scale or for the people <strong>on the frontlines of conservation</strong>. Our workflow is being designed to change that.</p><p>By reusing embeddings, reducing expertise requirements, combining multiple AI models, and enabling collaborative human validation, we’re creating a system that’s fast, powerful, and adaptable across regions and species.</p><p>While the workflow is already helping real-world projects today, we&#39;re only getting started. The next step is making it open, easy to use, and widely accessible, so that communities everywhere can track biodiversity on their own terms.</p><h3>Want to Collaborate?</h3><p>We’re looking for partners, funders, and conservation teams to help shape the next version of this platform and pilot it in the field.</p><p>If you’re interested in bringing this workflow to your project or helping us make it fully open-source, <a href="https://wildmon.ai/get-connected">let’s talk</a>.</p><p>We’ve proven that this approach works. Now we want to make it work for everyone.</p><img src="https://medium.com/_/stat?event=post.clientViewed&referrerSource=full_rss&postId=9b027ba17a88" width="1" height="1" alt="">]]></content:encoded>
        </item>
    </channel>
</rss>