NeuProNet: neural profiling networks for sound classification

Loading...
Thumbnail Image
Files
s00521-023-09361-8.pdf(1.8 MB)
Published Version
Date
2024-01-16
Authors
Tran, Khanh-Tung
Vu, Xuan-Son
Nguyen, Khuong
Nguyen, Hoang D.
Journal Title
Journal ISSN
Volume Title
Publisher
Springer Nature
Research Projects
Organizational Units
Journal Issue
Abstract
Real-world sound signals exhibit various aspects of grouping and profiling behaviors, such as being recorded from identical sources, having similar environmental settings, or encountering related background noises. In this work, we propose novel neural profiling networks (NeuProNet) capable of learning and extracting high-level unique profile representations from sounds. An end-to-end framework is developed so that any backbone architectures can be plugged in and trained, achieving better performance in any downstream sound classification tasks. We introduce an in-batch profile grouping mechanism based on profile awareness and attention pooling to produce reliable and robust features with contrastive learning. Furthermore, extensive experiments are conducted on multiple benchmark datasets and tasks to show that neural computing models under the guidance of our framework gain significant performance gaps across all evaluation tasks. Particularly, the integration of NeuProNet surpasses recent state-of-the-art (SoTA) approaches on UrbanSound8K and VocalSound datasets with statistically significant improvements in benchmarking metrics, up to 5.92% in accuracy compared to the previous SoTA method and up to 20.19% compared to baselines. Our work provides a strong foundation for utilizing neural profiling for machine learning tasks.
Description
Keywords
Neural profiling network , Audio classification , Deep learning , Signal processing
Citation
Tran, K. T., Vu, X. S., Nguyen, K. and Nguyen, H. D. (2024) 'NeuProNet: neural profiling networks for sound classification', Neural Computing and Applications, 36, pp. 5873-5887. https://doi.org/10.1007/s00521-023-09361-8
Link to publisher’s version