(Naresuan University, Thailand)(2) Wandee Wattanachaiyingcharoen
(Naresuan University, Thailand)(3) Anantachai Suwannakom
(Naresuan University, Thailand)(4) * Surisak Prasarnpun
(University of Phayao, Thailand)*corresponding author
AbstractPrevious methods for detecting the flashing behavior of fireflies were using either a photomultiplier tube, a stopwatch, or videography. Limitations and problems are associated with these methods, i.e., errors in data collection and analysis, and it is time-consuming. This study aims to applied a computer vision approach to reduce the time of data collection and analysis as compared to the videography methods by illuminance calculation, time of flash occurrence, and optimize the position coordinate automatically and tracking each firefly individually. The Validation of the approach was performed by comparing the flashing data of male fireflies, Sclerotia aquatilis that was obtained from the analysis of the behavioral video. The pulse duration, flash interval, and flash patterns of S. aquatilis were similar to a reference study. The accuracy ratio of the tracking algorithm for tracking multiple fireflies was 0.94. The time consumption required to analyze the video decreased up to 96.82% and 76.91% when compared with videography and the stopwatch method, respectively. Therefore, this program could be employed as an alternative technique for the study of fireflies flashing behavior.
Keywordsfirefly; computer vision; flash pattern; high-throughput; software
|
DOIhttps://doi.org/10.26555/ijain.v6i1.367 |
Article metricsAbstract views : 1317 | PDF views : 253 |
Cite |
Full Text Download
|
References
[1] J. E. Lloyd, Studies on the flash communication system in Photinus fireflies. Ann Arbor: Museum of Zoology, Univ. of Michigan, 1966, available at: Google Scholar.
[2] N. Ohba, “Flash communication systems of Japanese fireflies,” Integrative and Comparative Biology, vol. 44, no. 3, pp. 225–233, 2004, doi: 10.1093/icb/44.3.225.
[3] K. Demary, C. I. Michaelidis, and S. M. Lewis, “Firefly courtship: behavioral and morphological predictors of male mating success in Photinus greeni,” Ethology, vol. 112, no. 5, pp. 485–492, 2006, doi: 10.1111/j.1439-0310.2005.01176.x.
[4] J. E. Lloyd, “Aggressive mimicry in Photuris: firefly femmes fatales,” Science, vol. 149, no. 3684, pp. 653–654, 1965, doi: 10.1126/science.149.3684.653.
[5] J. E. Lloyd, “Flashes of Photuris fireflies: their value and use in recognizing species,” Florida Entomologist, pp. 29–35, 1969, doi: 10.2307/3493705.
[6] Y. Iguchi, “The ecological impact of an introduced population on a native population in the firefly Luciola cruciata (Coleoptera: Lampyridae),” Biodiversity and conservation, vol. 18, no. 8, pp. 2119–2126, 2009, doi: 10.1007/s10531-009-9576-8.
[7] Y. Iguchi, “Temperature-dependent geographic variation in the flashes of the firefly Luciola cruciata (Coleoptera: Lampyridae),” Journal of Natural History, vol. 44, no. 13–14, pp. 861–867, 2010, doi: 10.1080/00222930903528206.
[8] J. F. Case and J. Buck, “Control of flashing in fireflies. II. Role of central nervous system,” The Biological Bulletin, vol. 125, no. 2, pp. 234–250, 1963, doi: 10.2307/1539400.
[9] J. E. Lloyd, S. R. Wing, and T. Hongtrakul, “Flash behavior and ecology of Thai Luciola fireflies (Coleoptera: Lampyridae),” Florida Entomologist, pp. 80–85, 1989, doi: 10.2307/3494969.
[10] J. F. Case, “Flight studies on photic communication by the firefly Photinus pyralis,” Integrative and comparative biology, vol. 44, no. 3, pp. 250–258, 2004, doi: 10.1093/icb/44.3.250.
[11] J. Konno et al., “TiLIA: a software package for image analysis of firefly flash patterns,” Ecology and evolution, vol. 6, no. 9, pp. 3026–3031, 2016, doi: 10.1002/ece3.2078.
[12] H. Dankert, L. Wang, E. D. Hoopfer, D. J. Anderson, and P. Perona, “Automated monitoring and analysis of social behavior in Drosophila,” Nature Methods, vol. 6, no. 4, pp. 297, 2009, doi: 10.1038/nmeth.1310.
[13] N. MacLeod, M. Benfield, and P. Culverhouse, “Time to automate identification,” Nature, vol. 467, no. 7312, pp. 154, 2010, doi: 10.1038/467154a.
[14] W. Yang, L. Duan, G. Chen, L. Xiong, and Q. Liu, “Plant phenomics and high-throughput phenotyping: accelerating rice functional genomics using multidisciplinary technologies,” Current Opinion in Plant Biology, vol. 16, no. 2, pp. 180–187, 2013, doi: 10.1016/j.pbi.2013.03.005.
[15] O. Babatunde, A. Baltes, and J. Yin, “Image-Based Identification of Cell Cultures by Machine Learning,” Journal of Advances in Mathematics and ComputerScience, vol. 23, no. 1, pp. 1-25, 2017, doi: 10.9734/JAMCS/2017/34357.
[16] K. Jia, B. Wu, Y. Tian, Q. Li, and X. Du, “An effective biophysical indicator for opium yield estimation,” Comput. Electron. Agric., vol. 75, no. 2, pp. 272–277, Feb. 2011, doi: 10.1016/j.compag.2010.12.003.
[17] J. G. A. Barbedo, “Using digital image processing for counting whiteflies on soybean leaves,” J. Asia-Pac. Entomol., vol. 17, no. 4, pp. 685–694, Dec. 2014, doi: 10.1016/j.aspen.2014.06.014.
[18] J.-F. Pekel et al., “A near real-time water surface detection method based on HSV transformation of MODIS multi-spectral time series data,” Remote Sens. Environ., vol. 140, pp. 704–716, 2014, doi: 10.1016/j.rse.2013.10.008.
[19] J. Han, C. Yang, X. Zhou, and W. Gui, “A new multi-threshold image segmentation approach using state transition algorithm,” Appl. Math. Model., vol. 44, pp. 588–601, 2017, doi: 10.1016/j.apm.2017.02.015.
[20] M.-L. Gao, X.-H. He, D.-S. Luo, J. Jiang, and Q.-Z. Teng, “Object tracking using firefly algorithm,” IET Comput. Vis., vol. 7, no. 4, pp. 227–237, 2013, doi: 10.1049/iet-cvi.2012.0207.
[21] P. Pérez, C. Hue, J. Vermaak, and M. Gangnet, “Color-based probabilistic tracking,” in In Proc. ECCV, 2002, pp. 661–675, doi: 10.1007/3-540-47969-4_44.
[22] E. Maggio, F. Smerladi, and A. Cavallaro, “Adaptive Multifeature Tracking in a Particle Filtering Framework,” IEEE Trans. Circuits Syst. Video Technol., vol. 17, no. 10, pp. 1348–1359, 2007, doi: 10.1109/TCSVT.2007.903781.
[23] O. Zakaria, B. Alaa, M. Fouad, and M. Hicham, “Deterministic Method of Visual Servoing: Robust Object Tracking by Drone,” in 2016 13th International Conference on Computer Graphics, Imaging and Visualization (CGiV), 2016, pp. 414–422, doi: 10.1109/CGiV.2016.87.
[24] X.-S. Yang, Ed., Cuckoo Search and Firefly Algorithm: Theory and Applications. Springer International Publishing, 2014, doi: 10.1007/978-3-319-02141-6.
[25] S. Saini, N. Zakaria, D. R. A. Rambli, and S. Sulaiman, “Markerless Human Motion Tracking Using Hierarchical Multi-Swarm Cooperative Particle Swarm Optimization,” PLOS ONE, vol. 10, no. 5, p. e0127833, 2015, doi: 10.1371/journal.pone.0127833.
[26] Z. Peng, K. Dong, H. Yin, and Y. Bai, “Modification of Fish Swarm Algorithm Based on Lévy Flight and Firefly Behavior,” Computational Intelligence and Neuroscience, 2018, doi: 10.1155/2018/9827372.
[27] M. Tamura, J. Yokoyama, N. Ohba, and M. Kawata, “Geographic differences in flash intervals and pre-mating isolation between populations of the Genji firefly, Luciola cruciata,” Ecological entomology, vol. 30, no. 2, pp. 241–245, 2005, doi: 10.1111/j.0307-6946.2005.00683.x.
[28] S. M. Lewis and C. K. Cratsley, “Flash signal evolution, mate choice, and predation in fireflies,” Annu. Rev. Entomol., vol. 53, pp. 293–321, 2008, doi: 10.1146/annurev.ento.53.103106.093346.
[29] L. A. Ballantyne, C. L. Lambkin, X. Luan, Y. Boontop, and S. Nak-Eiam, “Further studies on south eastern Asian Luciolinae: 1. Sclerotia Ballantyne, a new genus of fireflies with back swimming larvae 2. Triangulara Pimpasalee, a new genus from Thailand (Coleoptera: Lampyridae),” Zootaxa, vol. 4170, no. 2, pp. 201–249, 2016, doi: 10.11646/zootaxa.4170.2.1.
[30] A. Thancharoen, “The Biology and Mating Behavior of an Aquatic Firely Species, Luciola aquatilis Sp. Nov. Thancharoen (Coleoptera: Lampyridae),” PhD Thesis, Mahidol University, 2007, available at: Google Scholar.
[31] B. Ermentrout, “An adaptive model for synchrony in the firefly Pteroptyx malaccae,” Journal of Mathematical Biology, vol. 29, no. 6, pp. 571–585, 1991, doi: 10.1007/BF00164052.
[32] A. Moiseff and J. Copeland, “A new type of synchronized flashing in a North American firefly,” Journal of Insect Behavior, vol. 13, no. 4, pp. 597–612, 2000, doi: 10.1023/A:1007823904866.
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.
___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571 (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
andri.pranolo.id@ieee.org (publication issues)
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0