Automatic Mosquito Surveillance and Visualisation using Acoustic Signals

Authors

Abstract

Mosquitoes are considered to be among the biggest disease spreading flying insects causing worldwide health hazards.  In Pakistan, Malaria and Dengue fever are among the most dangerous infectious viral diseases transmitted through the bite of infected Anopheles and Aedes mosquitoes. Manual identification of these mosquitoes is hard and dangerous leading to severe health risks. This paper presents an automated system based on audio analysis and IoT sensors to identify and classify mosquito species including Aedes (transmits dengue), Anopheles (transmits Malaria), and Culex (transmits viral diseases including avian malaria) species using the acoustic recordings of their wingbeat frequency. Computational analysis of these audio signals leads to inter-species classification and behavioral study of different mosquito species under varying environmental conditions.  We demonstrate the proposed approach on a standard dataset and compare it to human annotations, with promising results.

Author Biography

Ayesha Hakim, MNS-University of Agriculture, Multan

HoD | Assistant ProfessorDepartment of Computer ScienceMNS-University of Agriculture, Multan
Old Shujabad Road, Multan, Pakistan

References

[1] Barcelona Institute of Global Health (https://www.isglobal.org)

[2] J. E., & Rechcigl, N. A. (2016). Insect pest management : techniques for environmental protection. CRC Press.

[3] Fuchida, M.; Pathmakumar, T.; Mohan, R.E.; Tan, N.; Nakamura, A. Vision-Based Perception and Classification of Mosquitoes Using Support Vector Machine. Appl. Sci. 2017, 7, 51.

[4] Favret C, Sieracki JM. Machine vision automated species identification scaled towards production levels. Syst Entomol. 2016;41(1):133–143. doi: 10.1111/syen.12146.

[5] Wang J, Lin C, Ji L, Liang A. A new automatic identification system of insect images at the order level. Knowl-Based Syst. 2012;33:102–110. doi: 10.1016/j.knosys.2012.03.014. [CrossRef] [Google Scholar]

[6] Pruszynski C. The BG-Counter: A new surveillance trap that remotely measures mosquito density in real-time. In: Sickerman SL, editor. Wing Beats. 27(1) Montgomery: Publications Press, Inc.; 2016. [Google Scholar]

[7] A. Rose, M. Weber, I. Potamitis, P. Villalonga, M. Geismar, M. Williams, J. Ecarnação, and M. Geier (2017). Automatically counting and identifying mosquitoes in real time: Latest update on the EU-funded REMOSIS project.

[8] Spitzen, J., & Takken, W. (2018). Keeping track of mosquitoes: a review of tools to track, record and analyse mosquito flight. Parasites & vectors, 11(1), 123

[9] Brogdon, W. G. (1994). Measurement of flight tone differences between female Aedes aegypti and A. albopictus (Diptera: Culicidae). Journal of medical entomology, 31(5), 700-703.

[10] H. Mukundarajan, FJH. Hol, EA Castillo, C. Newby, M. Prakash (2017) Data from: Using mobile phones as acoustic sensors for high-throughput mosquito surveillance. Dryad Digital Repository. https://doi.org/10.5061/dryad.98d7s.

[11] Raman, D. R., Gerhardt, R. R., & Wilkerson, J. B. (2007). Detecting insect flight sounds in the field: Implications for acoustical counting of mosquitoes. Transactions of the ASABE, 50(4), 1481-1485.

[12] Ouyang, T. H., Yang, E. C., Jiang, J. A., & Lin, T. T. (2015). Mosquito vector monitoring system based on optical wingbeat classification. Computers and Electronics in Agriculture, 118, 47-55.

[13] Tramonte, A. R., & Christofferson, R. C. (2019). Investigating the probability of establishment of Zika virus and detection through mosquito surveillance under different temperature conditions. PloS one, 14(3), e0214306.

[14] Li, R., Xu, L., Bjørnstad, O. N., Liu, K., Song, T., Chen, A., ... & Stenseth, N. C. (2019). Climate-driven variation in mosquito density predicts the spatiotemporal dynamics of dengue. Proceedings of the National Academy of Sciences, 116(9), 3624-3629.

[15] Caminade, C., Kovats, S., Rocklov, J., Tompkins, A. M., Morse, A. P., Colón-González, F. J., ... & Lloyd, S. J. (2014). Impact of climate change on global malaria distribution. Proceedings of the National Academy of Sciences, 111(9), 3286-3291.

[16] Jolliffe, I. (2011). Principal component analysis. In International encyclopedia of statistical science (pp. 1094-1096). Springer, Berlin, Heidelberg.

[17] Dangeti, P. (2017). Statistics for Machine Learning. Packt Publishing Ltd.

[18] Senoussaoui M, Kenny P, Stafylakis T, Dumouchel P (2014) A Study of the cosine distance-based mean shift for telephone speech diarization, audio, speech, and language processing. IEEE/ACM Trans 22(1):217–227.

[19] N. Dehak, P. Kenny, R. Dehak, P. Dumouchel, and P. Ouellet, “Front-end factor analysis for speaker verification,” IEEE Transactions on Audio, Speech, and Language Processing, Vol. 19, No. 4, May 2011, pp. 788-798.

[20] N. Dehak, R. Dehak, J. Glass, D. Reynolds, and P. Kenny, "Cosine Similarity Scoring without Score Normalization Techniques," Proc. IEEE Odyssey Workshop, Brno, Czech Republic, June 2010.

[21] N. Dehak, Z. Karam, D. Reynolds, R. Dehak, W. Campbell, and J. Glass, "A Channel-Blind System for Speaker Verification," Proc. ICASSP, pp. 4536-4539, Prague, Czech Republic, May 2011.

[22] M. Senoussaoui, P. Kenny, N. Dehak and P. Dumouchel, "An i-vector Extractor Suitable for Speaker Recognition with both Microphone and Telephone Speech," in Proc Odyssey Speaker and Language Recognition Workshop, Brno, Czech Republic, June 2010.

[23] Vaizman, Y., McFee, B., & Lanckriet, G. (2014). Codebook-based audio feature representation for music information retrieval. IEEE/ACM Transactions on Audio, Speech and Language Processing (TASLP), 22(10), 1483-1493.

[24] Van Dongen, S., & Enright, A. J. (2012). Metric distances derived from cosine similarity and Pearson and Spearman
correlations. arXiv preprint arXiv:1208.3145.

[25] Crockford, D. (2006). The application/json media type for javascript object notation (json) (No. RFC 4627).

[26] Bostock, M., Ogievetsky, V., & Heer, J. (2011). D³ data-driven documents. IEEE Transactions on Visualization & Computer Graphics, (12), 2301-2309.

[27] d3 chordial graph documentation, https://github.com/d3/d3-chord/

[28] Giannakopoulos, T. (2015). pyaudioanalysis: An open-source python library for audio signal analysis. PloS one, 10(12), e0144610.

[29] MDN web docs, https://developer.mozilla.org/en-US/docs/Web/API/AudioContext, last updated on Aug 28, 2018

Downloads

Published

2020-03-13

Issue

Section

Computer Science