Disease Detection of Solanaceous Crops Using Deep Learning for Robot Vision

A. H. Nurul Hidayah, Syafeeza Ahmad Radzi, Norazlina Abdul Razak, Wira Hidayat Mohd Saad, Y. C. Wong, A. Azureen Naja

Abstract


Traditionally, the farmers manage the crops from the early growth stage until the mature harvest stage by manually identifying and monitoring plant diseases, nutrient deficiencies, controlled irrigation, and controlled fertilizers and pesticides. Even the farmers have difficulty detecting crop diseases using their naked eyes due to several similar crop diseases. Identifying the correct diseases is crucial since it can improve the quality and quantity of crop production. With the advent of Artificial Intelligence (AI) technology, all crop-managing tasks can be automated using a robot that mimics a farmer's ability. However, designing a robot with human capability, especially in detecting the crop's diseases in real-time, is another challenge to consider. Other research works are focusing on improving the mean average precision and the best result reported so far is 93% of mean Average Precision (mAP) by YOLOv5. This paper focuses on object detection of the Convolutional Neural Network (CNN) architecture-based to detect the disease of solanaceous crops for robot vision. This study's contribution involved reporting the developmental specifics and a suggested solution for issues that appear along with the conducted study. In addition, the output of this study is expected to become the algorithm of the robot's vision. This study uses images of four crops (tomato, potato, eggplant, and pepper), including 23 classes of healthy and diseased crops infected on the leaf and fruits. The dataset utilized combines the public dataset (PlantVillage) and self-collected samples. The total dataset of all 23 classes is 16580 images divided into three parts: training set, validation set, and testing set. The dataset used for training is 88% of the total dataset (15000 images), 8% of the dataset performed a validation process (1400 images), and the rest of the 4% dataset is for the test process (699 images). The performances of YOLOv5 were more robust in terms of 94.2% mAP, and the speed was slightly faster than Scaled-YOLOv4. This object detection-based approach has proven to be a promising solution in efficiently detecting crop disease in real-time.

Keywords


Deep Learning; Convolutional Neural Network; Object Detection; YOLOv5; Solanaceous Crops; Crops disease

Full Text:

PDF

References


N. Moitra, A. Singh, and S. Das, “Use of Convolutional Neural Network (CNN) to Detect Plant Disease,” In Computational Advancement in Communication, Circuits and Systems, pp. 43-51, 2022.

M. B. Isman, "Challenges of Pest Management in the Twenty First Century: New Tools and Strategies to Combat Old and New Foes Alike," Frontiers in Agronomy, vol. 1, p. 2, Dec. 2019, doi: 10.3389/FAGRO.2019.00002.

M. Tahmasebi, M. Gohari, and A. Emami, "An Autonomous Pesticide Sprayer Robot with a Color-based Vision System," International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 115–123, Feb. 2022, doi: 10.31763/ijrcs.v2i1.480.

M. G. Mohanan and A. Salgaonkar, "Robotic Motion Planning in Dynamic Environments and its Applications," International Journal of Robotics and Control Systems, vol. 2, no. 4, pp. 666–691, Oct. 2022, doi: 10.31763/IJRCS.V2I4.816.

A. K. Ali and M. M. Mahmoud, "Methodologies and Applications of Artificial Intelligence in Systems Engineering," International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 201–229, Mar. 2022, doi: 10.31763/IJRCS.V2I1.532.

A. W. L. Yao and H. C. Chen, "An Intelligent Color Image Recognition and Mobile Control System for Robotic Arm," International Journal of Robotics and Control Systems, vol. 2, no. 1, pp. 97–104, Feb. 2022, doi: 10.31763/ijrcs.v2i1.557.

A. Boubakri and S. Mettali Gamar, "A New Architecture of Autonomous Vehicles: Redundant Architecture to Improve Operational Safety," International Journal of Robotics and Control Systems, vol. 1, no. 3, pp. 355–368, Sep. 2021, doi: 10.31763/ijrcs.v1i3.437.

T. Kamyab, A. Delrish, H. Daealhaq, A. M. Ghahfarokhi, and F. Beheshtinejad, "Comparison and Review of Face Recognition Methods Based on Gabor and Boosting Algorithms," International Journal of Robotics and Control Systems, vol. 2, no. 4, pp. 610–617, Sep. 2022.

L. Alzubaidi et al., "Review of deep learning: concepts, CNN architectures, challenges, applications, future directions," Journal of Big Data, vol. 8, no. 1, pp. 1–74, Mar. 2021, doi: 10.1186/S40537-021-00444-8.

A. Esteva et al., "Deep learning-enabled medical computer vision," npj Digital Medicine, vol. 4, no. 1, Dec. 2021, doi: 10.1038/S41746-020-00376-2.

I. H. Sarker, "Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions," SN Computer Science, vol. 2, no. 6, pp. 1–20, Nov. 2021, doi: 10.1007/S42979-021-00815-1.

B. Yang and Y. Xu, "Applications of deep-learning approaches in horticultural research: a review," Horticulture Research, vol. 8, no. 1, pp. 1–31, Jun. 2021, doi: 10.1038/s41438-021-00560-9.

J. Deng, X. Xuan, W. Wang, Z. Li, H. Yao, and Z. Wang, "A review of research on object detection based on deep learning," in Journal of Physics: Conference Series, vol. 1684, no. 1, Nov. 2020, doi: 10.1088/1742-6596/1684/1/012028.

S. P. Mohanty, D. P. Hughes, and M. Salathé, "Using deep learning for image-based plant disease detection," Frontiers in Plant Science, vol. 7, no. September, p. 1419, Sep. 2016, doi: 10.3389/fpls.2016.01419.

L. Alzubaidi et al., "Review of deep learning: concepts, CNN architectures, challenges, applications, future directions," Journal of Big Data, vol. 8, no. 1, pp. 1–74, Mar. 2021, doi: 10.1186/S40537-021-00444-8.

P. Bharman, S. Ahmad Saad, S. Khan, I. Jahan, M. Ray, and M. Biswas, "Deep Learning in Agriculture: A Review," Asian Journal of Research in Computer Science, pp. 28–47, Feb. 2022, doi: 10.9734/ajrcos/2022/v13i230311.

S. J. Pan and Q. Yang, "A survey on transfer learning," IEEE Transactions on Knowledge and Data Engineering, vol. 22, no. 10, pp. 1345–1359, 2010, doi: 10.1109/TKDE.2009.191.

I. H. Sarker, "Deep Learning: A Comprehensive Overview on Techniques, Taxonomy, Applications and Research Directions," SN Computer Science 2021 2:6, vol. 2, no. 6, pp. 1–20, Aug. 2021, doi: 10.1007/S42979-021-00815-1.

S. Indolia, A. K. Goswami, S. P. Mishra, and P. Asopa, "Conceptual Understanding of Convolutional Neural Network- A Deep Learning Approach," Procedia Computer Science, vol. 132, pp. 679–688, Jan. 2018, doi: 10.1016/J.PROCS.2018.05.069.

"A Comprehensive Guide to Convolutional Neural Networks — the ELI5 way | by Sumit Saha | Towards Data Science." https://towardsdatascience.com/a-comprehensive-guide-to-convolutional-neural-networks-the-eli5-way-3bd2b1164a53 (accessed May 27, 2022).

R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, "Convolutional neural networks: an overview and application in radiology," Insights into Imaging, vol. 9, no. 4, pp. 611–629, Aug. 2018, doi: 10.1007/S13244-018-0639-9.

Z. Q. Zhao, P. Zheng, S. T. Xu, and X. Wu, "Object Detection with Deep Learning: A Review," IEEE Transactions on Neural Networks and Learning Systems, vol. 30, no. 11, pp. 3212–3232, Nov. 2019, doi: 10.1109/TNNLS.2018.2876865.

J. Kaur and W. Singh, "Tools, techniques, datasets and application areas for object detection in an image: a review," Multimedia Tools and Applications, pp. 1–55, Apr. 2022, doi: 10.1007/S11042-022-13153-Y.

J. Redmon, S. Divvala, R. Girshick, and A. Farhadi, "You Only Look Once: Unified, Real-Time Object Detection," Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2016-December, pp. 779–788, Jun. 2015, doi: 10.48550/arxiv.1506.02640.

Karimi Grace, "Introduction to YOLO Algorithm for Object Detection | Engineering Education (EngEd) Program | Section," Apr. 15, 2022. https://www.section.io/engineering-education/introduction-to-yolo-algorithm-for-object-detection/ (accessed Aug. 10, 2022).

Nelson Joseph, "Your Comprehensive Guide to the YOLO Family of Models," Jun. 07, 2021. https://blog.roboflow.com/guide-to-yolo-models/ (accessed May 28, 2022).

S. N, A. M. P, and H. P. V, "Object Detection using YOLO And Mobilenet SSD: A Comparative Study," International Journal of Engineering Research & Technology, vol. 11, no. 6, Jun. 2022, doi: 10.17577/IJERTV11IS060065.

A. M. Roy and J. Bhaduri, "A Deep Learning Enabled Multi-Class Plant Disease Detection Model Based on Computer Vision," AI, vol. 2, no. 3, pp. 413–428, Aug. 2021, doi: 10.3390/ai2030026.

L. Wu, J. Ma, Y. Zhao, and H. Liu, "Apple detection in complex scene using the improved yolov4 model," Agronomy, vol. 11, no. 3, Mar. 2021, doi: 10.3390/agronomy11030476.

T. Do, "Evolution of yolo algorithm and yolov5: the state-of-the-art object detection algorithm," 2021.

S. H. Abed, A. S. Al-Waisy, H. J. Mohammed, and S. Al-Fahdawi, "A modern deep learning framework in robot vision for automated bean leaves diseases detection," Int. J. Intell. Robot. Appl., vol. 5, no. 2, pp. 235–251, 2021, doi: 10.1007/s41315-021-00174-3.

J. Schmidhuber, "Deep learning in neural networks: An overview," Neural Networks, vol. 61, pp. 85–117, Jan. 2015, doi: 10.1016/J.NEUNET.2014.09.003.

K. Santosh, N. Das, and S. Ghosh, "Deep learning models," Deep Learning Models for Medical Imaging, pp. 65–97, 2022, doi: 10.1016/B978-0-12-823504-1.00013-1.

M. Sewak, S. K. Sahay, and H. Rathore, "An overview of deep learning architecture of deep neural networks and autoencoders," J Comput Theor Nanosci, vol. 17, no. 1, pp. 182–188, 2020, doi: 10.1166/jctn.2020.8648.

R. Yamashita, M. Nishio, R. K. G. Do, and K. Togashi, "Convolutional neural networks: an overview and application in radiology," Insights into Imaging, vol. 9, no. 4, pp. 611–629, Aug. 2018, doi: 10.1007/S13244-018-0639-9.

Md. R. Karim, Mohit. Sewak, and Pradeep. Pujari, "Practical Convolutional Neural Networks : Implement advanced deep learning models using Python," p. 211, Accessed: Oct. 25, 2022. [Online]. Available: https://www.perlego.com/book/593216/practical-convolutional-neural-networks-pdf

V. Kate and P. Shukla, "A 3 Tier CNN model with deep discriminative feature extraction for discovering malignant growth in multi-scale histopathology images," Informatics in Medicine Unlocked, vol. 24, p. 100616, Jan. 2021, doi: 10.1016/J.IMU.2021.100616.

J. Wen et al., "Convolutional neural networks for classification of Alzheimer's disease: Overview and reproducible evaluation," Medical Image Analysis, vol. 63, Jul. 2020, doi: 10.1016/J.MEDIA.2020.101694.




DOI: https://doi.org/10.18196/jrc.v3i6.15948

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Syafeeza Ahmad Radzi

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik