In-Ear-Voice: Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms

被引:7
|
作者
Schilk, Philipp [1 ]
Polvani, Niccolo [2 ,3 ]
Ronco, Andrea [1 ]
Cernak, Milos [3 ]
Magno, Michele [1 ]
机构
[1] Eidgenoss Tech Hsch Zurich ETHZ, Zurich, Switzerland
[2] Ecole Polytech Fed Lausanne EPFL, Lausanne, Switzerland
[3] Logitech Europe, Lausanne, Switzerland
关键词
bone conduction; voice activity detection; TinyML; DSP; IMPLEMENTATION;
D O I
10.1145/3576842.3582365
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
The recent ubiquitous adoption of remote conferencing has been accompanied by omnipresent frustration with distorted or otherwise unclear voice communication. Audio enhancement can compensate for low-quality input signals from, for example, small true wireless earbuds, by applying noise suppression techniques. Such processing relies on voice activity detection (VAD) with low latency and the added capability of discriminating the wearer's voice from others - a task of significant computational complexity. The tight energy budget of devices as small as modern earphones, however, requires any system attempting to tackle this problem to do so with minimal power and processing overhead, while not relying on speaker-specific voice samples and training due to usability concerns. This paper presents the design and implementation of a custom research platform for low-power wireless earbuds based on novel, commercial, MEMS bone-conduction microphones. Such microphones can record the wearer's speech with much greater isolation, enabling personalized voice activity detection and further audio enhancement applications. Furthermore, the paper accurately evaluates a proposed low-power personalized speech detection algorithm based on bone conduction data and a recurrent neural network running on the implemented research platform. This algorithm is compared to an approach based on traditional microphone input. The performance of the bone conduction system, achieving detection of speech within 12.8ms at an accuracy of 95% is evaluated. Different SoC choices are contrasted, with the final implementation based on the cutting-edge Ambiq Apollo 4 Blue SoC achieving 2.64mW average power consumption at 14uJ per inference, reaching 43h of battery life on a miniature 32mAh li-ion cell and without duty cycling.
引用
收藏
页码:1 / 12
页数:12
相关论文
共 2 条
  • [1] Demo Abstract: In-Ear-Voice - Towards Milli-Watt Audio Enhancement With Bone-Conduction Microphones for In-Ear Sensing Platforms
    Schilk, Philipp
    Polvani, Niccolo
    Ronco, Andrea
    Cernak, Milos
    Magno, Michele
    PROCEEDINGS 8TH ACM/IEEE CONFERENCE ON INTERNET OF THINGS DESIGN AND IMPLEMENTATION, IOTDI 2023, 2023, : 488 - 490
  • [2] Comparison of objective and subjective methods for evaluating speech quality and intelligibility recorded through bone conduction and in-ear microphones
    Richard, J.
    Zimpfer, V.
    Roth, S.
    APPLIED ACOUSTICS, 2023, 211