Deep learning mango fruits recognition based on tensorflow lite

(1) * Mas Rina Mustaffa Mail (Multimedia Department, Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia)
(2) Aainaa Azullya Idris Mail (Multimedia Department, Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia)
(3) Lili Nurliyana Abdullah Mail (Multimedia Department, Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia)
(4) Nurul Amelina Nasharuddin Mail (Multimedia Department, Faculty of Computer Science and Information Technology, Universiti Putra Malaysia, Malaysia)
*corresponding author

Abstract


Agricultural images such as fruits and vegetables have previously been recognised and classified using image analysis and computer vision techniques. Mangoes are currently being classified manually, whereby mango sellers must laboriously identify mangoes by hand. This is time-consuming and tedious. In this work, TensorFlow Lite was used as a transfer learning tool. Transfer learning is a fast approach in resolving classification problems effectively using small datasets. This work involves six categories, where four mango types are classified (Harum Manis, Langra, Dasheri and Sindhri), categories for other types of mangoes, and a non-mango category. Each category dataset comprises 100 images, and is split 70/30 between the training and testing set, respectively. This work was undertaken with a mobile-based application that can be used to distinguish various types of mangoes based on the proposed transfer learning method. The results obtained from the conducted experiment show that adopted transfer learning can achieve an accuracy of 95% for mango recognition. A preliminary user acceptance survey was also carried out to investigate the user’s requirements, the effectiveness of the proposed functionalities, and the ease of use of its proposed interfaces, with promising results.

   

DOI

https://doi.org/10.26555/ijain.v9i3.1368
      

Article metrics

Abstract views : 386 | PDF views : 157

   

Cite

   

Full Text

Download

References


[1] V. R. Lebaka, Y.-J. Wee, W. Ye, and M. Korivi, “Nutritional Composition and Bioactive Compounds in Three Different Parts of Mango Fruit,” Int. J. Environ. Res. Public Health, vol. 18, no. 2, p. 741, Jan. 2021, doi: 10.3390/ijerph18020741.

[2] G. Zahid, Y. Aka Kaçar, F. Shimira, S. Iftikhar, and M. A. Nadeem, “Recent progress in omics and biotechnological approaches for improved mango cultivars in Pakistan,” Genet. Resour. Crop Evol., vol. 69, no. 6, pp. 2047–2065, Aug. 2022, doi: 10.1007/s10722-022-01413-7.

[3] A. Swaroop, S. J. Stohs, M. Bagchi, H. Moriyama, and D. Bagchi, “Mango (Mangifera indica Linn) and Anti-Inflammatory Benefits: Versatile Roles in Mitochondrial Bio-Energetics and Exercise Physiology,” Funct. Foods Heal. Dis., vol. 8, no. 5, p. 267, May 2018, doi: 10.31989/ffhd.v8i5.526.

[4] M. Kumar et al., “Mango (Mangifera indica L.) Leaves: Nutritional Composition, Phytochemical Profile, and Health-Promoting Bioactivities,” Antioxidants, vol. 10, no. 2, p. 299, Feb. 2021, doi: 10.3390/antiox10020299.

[5] P. Choudhary, T. B. Devi, S. Tushir, R. C. Kasana, D. S. Popatrao, and N. K., “Mango Seed Kernel: A Bountiful Source of Nutritional and Bioactive Compounds,” Food Bioprocess Technol., vol. 16, no. 2, pp. 289–312, Feb. 2023, doi: 10.1007/s11947-022-02889-y.

[6] A.-J. Perea-Moreno, M.-Á. Perea-Moreno, M. P. Dorado, and F. Manzano-Agugliaro, “Mango stone properties as biofuel and its potential for reducing CO2 emissions,” J. Clean. Prod., vol. 190, pp. 53–62, Jul. 2018, doi: 10.1016/j.jclepro.2018.04.147.

[7] M. R. Murtaza, T. Mehmood, A. Ahmad, and U. A. Mughal, “With and Without Intercropping Economic Evaluation of Mango Fruits: Evidence from Southern Punjab, Pakistan,” Sarhad J. Agric., vol. 35, no. 1, pp. 192–197, 2020, doi: 10.17582/journal.sja/2020/36.1.192.197.

[8] N. Nasron, N. S. Ghazali, N. M. Shahidin, A. A. Mohamad, S. A. Pugi, and N. M. Razi, “Soil Suitability Assessment for Harumanis Mango Cultivation in UiTM Arau, Perlis,” IOP Conf. Ser. Earth Environ. Sci., vol. 620, no. 1, p. 012007, Jan. 2021, doi: 10.1088/1755-1315/620/1/012007.

[9] F. S. Baloch, N. S. Jilani, and S. S. Tahir, “Comparative analysis of taxonomic characters of sindhri and langra varieties of mango (Mangifera indica l.) found in Sindh,” Pakistan J. Bot., vol. 51, no. 4, pp. 1447–1452, 2019, doi: 10.30848/PJB2019-4(3).

[10] R. T. Gunjate, “Advances In Mango Culture In India,” Acta Hortic., vol. 820, no. 820, pp. 69–78, Apr. 2009, doi: 10.17660/ActaHortic.2009.820.5.

[11] K. Kaur, P. Kaur, S. Kumar, R. Zalpouri, and M. Singh, “Ozonation as a Potential Approach for Pesticide and Microbial Detoxification of Food Grains with a Focus on Nutritional and Functional Quality,” Food Rev. Int., pp. 1–33, Jun. 2022, doi: 10.1080/87559129.2022.2092129.

[12] M. R. Mustaffa, N. X. Yi, L. N. Abdullah, and N. A. Nasharuddin, “Durian Recognition Based On Multiple Features And Linear Discriminant Analysis,” Malaysian J. Comput. Sci., vol. 31, no. 5, pp. 57–72, Dec. 2018, doi: 10.22452/MJCS.SP2018NO1.5.

[13] J. Kong, H. Wang, X. Wang, X. Jin, X. Fang, and S. Lin, “Multi-stream hybrid architecture based on cross-level fusion strategy for fine-grained crop species recognition in precision agriculture,” Comput. Electron. Agric., vol. 185, p. 106134, Jun. 2021, doi: 10.1016/j.compag.2021.106134.

[14] D. Hussain, I. Hussain, M. Ismail, A. Alabrah, S. S. Ullah, and H. M. Alaghbari, “A Simple and Efficient Deep Learning-Based Framework for Automatic Fruit Recognition,” Comput. Intell. Neurosci., vol. 2022, pp. 1–8, Feb. 2022, doi: 10.1155/2022/6538117.

[15] A. Kamboj, R. Rani, and A. Nigam, “A comprehensive survey and deep learning-based approach for human recognition using ear biometric,” Vis. Comput., vol. 38, no. 7, pp. 2383–2416, Jul. 2022, doi: 10.1007/s00371-021-02119-0.

[16] L. Zhou, C. Zhang, F. Liu, Z. Qiu, and Y. He, “Application of Deep Learning in Food: A Review,” Compr. Rev. Food Sci. Food Saf., vol. 18, no. 6, pp. 1793–1811, Nov. 2019, doi: 10.1111/1541-4337.12492.

[17] S. Dargan, M. Kumar, M. R. Ayyagari, and G. Kumar, “A Survey of Deep Learning and Its Applications: A New Paradigm to Machine Learning,” Arch. Comput. Methods Eng., vol. 27, no. 4, pp. 1071–1092, Sep. 2020, doi: 10.1007/s11831-019-09344-w.

[18] D. Wang, W. Cao, F. Zhang, Z. Li, S. Xu, and X. Wu, “A Review of Deep Learning in Multiscale Agricultural Sensing,” Remote Sens., vol. 14, no. 3, p. 559, Jan. 2022, doi: 10.3390/rs14030559.

[19] A. A. Almisreb, N. Jamil, and N. M. Din, “Utilizing AlexNet Deep Transfer Learning for Ear Recognition,” in 2018 Fourth International Conference on Information Retrieval and Knowledge Management (CAMP), Mar. 2018, pp. 1–5, doi: 10.1109/INFRKM.2018.8464769.

[20] A. Kaya, A. S. Keceli, C. Catal, H. Y. Yalic, H. Temucin, and B. Tekinerdogan, “Analysis of transfer learning for deep neural network based plant classification models,” Comput. Electron. Agric., vol. 158, pp. 20–29, Mar. 2019, doi: 10.1016/j.compag.2019.01.041.

[21] G. Ayana, K. Dese, and S. Choe, “Transfer Learning in Breast Cancer Diagnoses via Ultrasound Imaging,” Cancers (Basel)., vol. 13, no. 4, p. 738, Feb. 2021, doi: 10.3390/cancers13040738.

[22] I. Hussain, S. Tan, W. Ali, and A. Ali, “CNN Transfer Learning for Automatic Fruit Recognition for Future Class of Fruit,” Int. J. Comput., vol. 39, no. 1, pp. 88–96, Oct. 2020. [Online]. Available at : https://ijcjournal.org/index.php/InternationalJournalOfComputer/article/view/1824.

[23] M. S. Saari, R. Md Nor, and H. A Hamid, “Web-based Image Recognition System for Detecting Harumanis Mangoes,” J. Comput. Res. Innov., vol. 5, no. 4, pp. 48–53, Nov. 2020, doi: 10.24191/jcrinn.v5i4.153.

[24] S. K. Behera, A. K. Rath, and P. K. Sethy, “Maturity status classification of papaya fruits based on machine learning and transfer learning approach,” Inf. Process. Agric., vol. 8, no. 2, pp. 244–250, Jun. 2021, doi: 10.1016/j.inpa.2020.05.003.

[25] J. Kang and J. Gwak, “Ensemble of multi-task deep convolutional neural networks using transfer learning for fruit freshness classification,” Multimed. Tools Appl., vol. 81, no. 16, pp. 22355–22377, Jul. 2022, doi: 10.1007/s11042-021-11282-4.

[26] Mobicastle, “Frutolo,” 2019. Accessed Aug. 11, 2023. [Online]. Available at: https://play.google.com/store/apps/details?id=com.frutolo.app.android&hl=en_NZ.

[27] M. V. Tech, “Musang King on the App Store,” 2021. [Online]. Available at: https://apps.apple.com/us/app/musang-king/id1537996742.

[28] R. R. Haryono, “FreshThumb,” 2019. [Online]. Available at: https://apps.apple.com/id/app/freshthumb/id1474582960.

[29] S. Boumaraf et al., “Conventional Machine Learning versus Deep Learning for Magnification Dependent Histopathological Breast Cancer Image Classification: A Comparative Study with Visual Explanation,” Diagnostics, vol. 11, no. 3, p. 528, Mar. 2021, doi: 10.3390/diagnostics11030528.

[30] R. Sujatha, J. M. Chatterjee, N. Jhanjhi, and S. N. Brohi, “Performance of deep learning vs machine learning in plant leaf disease detection,” Microprocess. Microsyst., vol. 80, p. 103615, Feb. 2021, doi: 10.1016/j.micpro.2020.103615.

[31] H. M. Rizwan Iqbal and A. Hakim, “Mango Variety and Grading Dataset,” Mendeley Data. [Online]. Available at: https://data.mendeley.com/datasets/5mc3s86982/1.

[32] S. Naik, “Mango Dataset - Studio Setup,” Mendeley Data, 2019. [Online]. Available at: https://data.mendeley.com/datasets/fmfncxjz3v/1.

[33] S. K., “Fruits and Vegetables Image Recognition Dataset,” Kaggle, 2020. [Online]. Available at: https://www.kaggle.com/datasets/kritikseth/fruit-and-vegetable-image-recognition.




Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

___________________________________________________________
International Journal of Advances in Intelligent Informatics
ISSN 2442-6571  (print) | 2548-3161 (online)
Organized by UAD and ASCEE Computer Society
Published by Universitas Ahmad Dahlan
W: http://ijain.org
E: info@ijain.org (paper handling issues)
   andri.pranolo.id@ieee.org (publication issues)

View IJAIN Stats

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0