SPIDER: Lightweight Speaker Identification on Resource-Constrained Embedded Devices
Loading...
Date
2026-05-10
Authors
Gallacher, Markus
Boano, Carlo Alberto
Pillai, Arun Sankar Muttathu Sivasankara
Roedig, Utz
Lunardi, Willian
Baddeley, Michael
Journal Title
Journal ISSN
Volume Title
Publisher
Association for Computing Machinery, Inc
Published Version
Abstract
Voice-based Speaker Identification (SI) can be framed as the problem of Closed-Set Speaker Identification (CSSI), recognizing a speaker from a known set, or OSSI, additionally recognizing unknown speakers. Precise and accurate Open-Set Speaker Identification (SI) can enable a variety of applications, ranging from human presence detection to authentication. Existing SI solutions are typically driven by deep learning approaches, which involve computationally demanding models often running in cloud back-ends. Enabling local SI models running directly on resource-constrained embedded devices can enable new use cases while preserving speaker privacy. In this work, we fill this gap and present SPIDER, a lightweight, on-device CSSI and OSSI solution capable of running on the off-the-shelf Nordic nRF52840 and nRF5340 system-on-chip microcontrollers, which feature as little as 256 and 512 kB of RAM, respectively, and 1 MB of flash memory. SPIDER is 16x-67x smaller than currently-available SI models, and yet, the 16x smaller version achieves a comparable accuracy of 94.33 % for CSSI and 91.8% for OSSI. Our evaluation across multiple datasets confirms the viability of performing accurate SI directly on resource-constrained embedded devices using only low-cost microphones. To foster further research and development, we open source our implementation of SPIDER, empowering the community to explore new SI use cases where cloud connectivity or backhaul infrastructure is impractical or undesirable.
Description
Keywords
Datasets , Embedded AI , Information processing , Lightweight models , Machine learning , Open-set speaker identification , [ComputerScience]
Citation
Gallacher, M, Boano, C A, Pillai, A S M S, Roedig, U, Lunardi, W & Baddeley, M 2026, SPIDER: Lightweight Speaker Identification on Resource-Constrained Embedded Devices. in SenSys 2026 - Proceedings of the 2026 ACM/IEEE International Conference on Embedded Artificial Intelligence and Sensing Systems, Part of CPS-IoTWeek 2026, Saint Malo, France 11 - 14 May 2026. SenSys 2026 - Proceedings of the 2026 ACM/IEEE International Conference on Embedded Artificial Intelligence and Sensing Systems, Part of CPS-IoTWeek 2026, Association for Computing Machinery, Inc, pp. 1316-1329, International Conference on Embedded Artificial Intelligence and Sensing Systems, SenSys 2026, Saint Malo, France, 11/05/26. https://doi.org/10.1145/3774906.3800492