Automatic acoustic mosquito tagging with Bayesian neural networks

Conference item

Deep learning models are now widely used in decision-making applications. These models must be robust to noise and carefully map to the underlying uncertainty in the data. Standard deterministic neural networks are well known to be poor at providing reliable estimates of uncertainty and often lack the robustness that is required for real-world deployment. In this paper, we work with an application that requires accurate uncertainty estimates in addition to good predictive performance. In particular, we consider the task of detecting a mosquito from its acoustic signature. We use Bayesian neural networks (BNNs) to infer predictive distributions over outputs and incorporate this uncertainty as part of an automatic labelling process. We demonstrate the utility of BNNs by performing the first fully automated data collection procedure to identify acoustic mosquito data on over 1,500 h of unlabelled field data collected with low-cost smartphones in Tanzania. We use uncertainty metrics such as predictive entropy and mutual information to help with the labelling process. We show how to bridge the gap between theory and practice by describing our pipeline from data preprocessing to model output visualisation. Additionally, we supply all of our data and code. The successful autonomous detection of mosquitoes allows us to perform analysis which is critical to the project goals of tackling mosquito-borne diseases such as malaria and dengue fever.

Authors: Kiskin, I; Cobb, AD; Sinka, M; Willis, K; Roberts, SJ

• Publication status: Published
• Peer review status: Peer reviewed
• Publisher: Springer
• Host title: Machine Learning and Knowledge Discovery in Databases. Applied Data Science Track
• Pages: 351-366
• Series: Lecture Notes in Computer Science
• Series number: 12978
• Place of publication: Cham, Switzerland
• Publication date: 2021-09-10
• Acceptance date: 2021-06-18
• Event title: European Conference on Machine Learning and Knowledge Discovery in Databases (ECML PDKK 2021)
• Event location: Virtual event
• Event website: https://2021.ecmlpkdd.org/index.html
• Event start date: 2021-09-13
• Event end date: 2021-09-17
• DOI: 10.1007/978-3-030-86514-6_22
• EISSN: 1611-3349
• ISSN: 0302-9743
• EISBN: 9783030865146
• ISBN: 9783030865139
• Language: English
• Keywords: FFR; acoustic machine learning; audio event detection; Bayesian deep learning