Acoustic fingerprints in nature: A self-supervised learning approach for ecosystem activity monitoring

作者：Darío Demattíes, Samir Rajani, Rajesh Sankaran, Sean Shahkarami, Bhupendra Raut, Scott Collis, Pete Beckman, Nicola Ferrier · 发表于：Ecological Informatics · 年份：2024 · DOI：10.1016/j.ecoinf.2024.102823 · 被引用次数：7 · 研究领域：Animal Vocal Communication and Behavior、Music and Audio Processing、Marine animal studies overview

According to the World Health Organization, healthy communities rely on well-functioning ecosystems . Clean air, fresh water, and nutritious food are inextricably linked to ecosystem health. Changes in biological activity convey important information about ecosystem dynamics, and understanding such changes is crucial for the survival of our species. Scientific edge cyberinfrastructures collect distributed data and process it in situ, often using machine learning algorithms. Most current machine learning algorithms deployed on edge cyberinfrastructures, however, are trained on data that does not accurately represent the real stream of data collected at the edge. In this work we explore the applicability of two new self-supervised learning algorithms for characterizing an insufficiently curated, imbalanced, and unlabeled dataset collected by using a set of nine microphones at different locations at the Morton Arboretum, an internationally recognized tree-focused botanical garden and research center in Lisle, IL. Our implementations showed completely autonomous characterization capabilities, such as the separation of spectrograms by recording location, month, week, and hour of the day. The models also showed the ability to discriminate spectrograms by biological and atmospheric activity, including rain, insects, and bird activity, in a completely unsupervised fashion. We validated our findings using a supervised deep learning approach and with a dataset labeled by experts, confi...