Fruit harvesting robot

Tóm tắt

This paper introduces an automatic robot for harvesting fruits in agriculture using a 4-degree-of-freedom robotic arm and an automatic classification and detection system of fruit objects. The control system consists of an Arduino Mega microcontroller and a servo motor, NVIDIA Jetson Nano Developer Kit, 12.3MP IMX477 Camera. The color features are extracted in the HSV color space and then used as input to the OpenCV library-based processing algorithm which will automatically calculate the values for the classification threshold. The resulting objects extracted by this method are presented in binary images. The results after various test cases show that the robot performs well with the accuracy and response time satisfying the specifications in the design. It is also low-cost and highly scalable with great potential for applying in agriculture, especially in harvesting fruits. Details of how this automatic robot was implemented and the results are presented below.

Từ khóa
machine vision OpenCV library harvesting robot image processing robotic arm fruit picking position control kinematics

Tài liệu tham khảo

1.
Metta, Giorgio. (2001). An attentional system for a humanoid robot exploiting space variant vision. IEEE-RAS International Conference on Humanoid Robots 2001, Tokyo, Japan, Nov. 22-24.
2.
TQ Vinh, PM Thang, PM Duong (2010). Mạng thông tin điều khiển trong hệ thống tự động hóa tòa nhà. Tạp chí Khoa học Tự nhiên và Công nghệ, Đại học Quốc gia Hà Nội, tập 26, số 2, 129-140.
3.
Elina, Olga. (2019). Development of Innovative Technologies in Russia Agro-Industry. International Conference on Enginering Technologies and Computer Science(EnT). IEEE, DOI:10.1109/ENT.2019.00027.
4.
Buhl, Jens F., et al. (2019). A dual-arm collaborative robot system for the smart factories of the future. Procedia manufacturing 38, 333-340.
5.
Byambasuren, Bat-Erdene, et al. (2020). Apllication of image processing and industrial robot arm for quality assurance process of production. 2020 IEEE Region 10 Symposium (TENSYMP).
6.
Fu, Longsheng, et al. (2020). Application of consumer RGB-D cameras for fruits detection and localization in field: A critical review. Computers and Electronics in Agriculture, 177.
7.
Santos, Luis, et al. (2019). Deep learning applications in agriculture: A short review. In book: Robot 2019: Fourth Iberian Robotics Conference,139-151.
8.
Lottes, Philipp, et al. (2017). Effective vision - based classification for seperating sugar beets and weeds for precision farming. Journals of Field Robotics, 34-36.
9.
My, Chu A., et al. (2019). Novel robot arm design and implementation for hot forging press automation. International Journal of Production Research 57(14).
10.
Sandoval, J., et al. (2018). Collaborative framwork for robot-assisted minimally invasive surgery using 7-DOF anthropomorphic robot. Robotics and Automations Systems 106, 95-106.
11.
Wang, Yiming, et al. (2019). Autonomous 3-D reconstruction, mappping, and exploration of indoor environment with a robotic arm. IEEE Robotics and Automation Letter 4(4).
12.
Oyekan, john, et al. (2020). Applying a 6 DOF Robotic Arm and Digital Twin to Automate Fan-Blade Reconditioning for Aerospace Maintance, Repair and Overhaul. Sensor, 20(16).
13.
Pierrot, Francois, et al. (2009). Optimal design of a 4-DOF parallell manipulator: From academia to industry. IEEE Transactions on Robotics 25(2).
14.
Rahul, K. Hifur Raheman amd Vikas Paradkar. (2020). Design of a 4-DOF parallel robot arm and the firmware implementation on embedded system to transplant pot seddlings. Artificial Intelligence in Agriculture 4.
15.
Muladi, Siti Sendari and Ihlam Ari Elbaoth Zaini. (2019). Color-based PBEJCT Sorting in a Wide Range and Dense Target Points using Arm Robot. 2nd International Confrerence on Vocational Education and Training (ICOVET 2018). Netherlands: Atlantis Press.
16.
Roshanianfard, Ali, Du Mengmeng and Samira Nematzadeh. (2021). A 4-DOF SCARA robotic ảm for various farm applications: Designing, kinematic modelling and parameterization. Acta Technologica Agriculture 24(2), 61-66.