AI EcoSound Tutor: A guiding tool for exploring AI in bioacoustics

dc.contributor.authorAzeem, Muhammaden
dc.contributor.authorNguyen, Hoang D.en
dc.contributor.authorMinghim, Rosaneen
dc.contributor.editorNguyen, Hoang D.en
dc.contributor.funderResearch Irelanden
dc.contributor.funderEuropean Regional Development Funden
dc.date.accessioned2025-12-18T14:33:49Z
dc.date.available2025-12-18T14:33:49Z
dc.date.issued2025en
dc.description.abstractArtificial intelligence offers powerful methods for audio processing and analysis. Still, complex workflows and the required programming skills often limit access for students and domain experts, such as marine bioacousticians and soundscape ecologists. We present ”AI EcoSound Tutor”, a codefree and interactive tool that lowers these barriers by allowing users to construct and explore a complete AI pipeline for audio data analysis. Starting from raw recordings, users can choose from various feature extraction techniques (MFCC, OpenL3), apply dimensionality reduction methods (PCA, t-SNE, UMAP), and optionally perform unsupervised clustering (K-Means, GMM, HDBSCAN). The results are displayed with an interactive 2D visualisation where the user can compare multiple plots by employing various techniques, including PCA and t-SNE. Interactive plots enable the selection of points or clusters of interest, allowing exploration of spectrograms within the desired frequency range, and playing an audio clip corresponding to the selected points. An integrated ”Help” feature provides explanations of each method (i.e., what it is, how it works, and its practical use in different domains, such as bioacoustics), fostering both conceptual understanding and useful skill acquisition as learning outcomes. For precomputed features or embeddings, this tool also supports training and evaluating a variety of machine learning models, providing visual feedback on the results. By merging accessibility, interactivity, pedagogy, and domain relevance, our application demystifies AI methods for interdisciplinary education and supporting research in audio analysis.en
dc.description.sponsorshipResearch Ireland (12-RC-2289- P2)en
dc.description.statusPeer revieweden
dc.description.versionAccepted Versionen
dc.format.mimetypeapplication/pdfen
dc.identifier.citationAzeem, M., Nguyen, H. D. and Minghim, R. (2025) 'AI EcoSound Tutor: A guiding tool for exploring AI in bioacoustics', 39th Annual AAAI Conference on Artificial Intelligence, Philadelphia, Pennsylvania, USA, 25 February - 4 March 2025.en
dc.identifier.endpage9en
dc.identifier.startpage1en
dc.identifier.urihttps://hdl.handle.net/10468/18354
dc.language.isoenen
dc.relation.ispartof39th Annual AAAI Conference on Artificial Intelligence, Philadelphia, Pennsylvania, USA, 25 February - 4 March 2025en
dc.relation.projectinfo:eu-repo/grantAgreement/SFI/Centres for Research Training (CRT) Programme/18/CRT/6222/IE/SFI Centre for Research Training in Advanced Networks for Sustainable Societies/en
dc.rights© 2025, the Authors. For the purpose of Open Access, a CC BY licence applies to any Author Accepted Manuscript from this submission.en
dc.rights.urihttps://creativecommons.org/licenses/by/4.0/en
dc.subjectAI educationen
dc.subjectAudio analysisen
dc.subjectMachine learningen
dc.subjectVisualisationen
dc.subjectBioacousticsen
dc.subjectSoundscape ecologyen
dc.subjectSpectrogram analysisen
dc.titleAI EcoSound Tutor: A guiding tool for exploring AI in bioacousticsen
dc.typeArticle (peer-reviewed)en
Files
Original bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
2025_EAAI_AI_Sound_Tutor.pdf
Size:
684.59 KB
Format:
Adobe Portable Document Format
Description:
Accepted Version
License bundle
Now showing 1 - 1 of 1
Loading...
Thumbnail Image
Name:
license.txt
Size:
2.71 KB
Format:
Item-specific license agreed upon to submission
Description: