Cover Image

Implementation of a Camera Sensor Pixy 2 CMUcam5 to A Two Wheeled Robot to Follow Colored Object

Sigit Dani Perkasa, Prisma Megantoro, Hendra Ari Winarno


This article discusses the design of a colored object follower robot. The colored object used has a simple shape. For the detection process, a wheeled robot that uses sensors based on digital images of Pixy 2. Pixy2 can learn to detect objects that you teach it, just by pressing a button.  Additionally, Pixy2 has new algorithms that detect and track lines for use with line-following robots. Pixy2 camera is able to recognize and track all objects whose color has been memorized. In maneuvering, this robot has 2 wheels on the right and left. Movement control is carried out by the Arduino Uno microcontroller board. This robot moves according to the direction of movement of the object. The conclusion obtained in this research is that this wheeled robot can be examined from the left, front and right side objects properly, then it follows the direction of the detected object.


wheeled robot, pixy 2, microcontroller

Full Text:



S. Coetzee, H. Swart, P. Bosscha, and D. Oosthuizen, “Design of an Industrial All-Terrain Robot Platform,” pp. 3–6, 2012.

S. Nakajima, “Development of four-wheel-type mobile robot for rough terrain and verification of its fundamental capability of moving on rough terrain,” 2008 IEEE Int. Conf. Robot. Biomimetics, ROBIO 2008, pp. 1968–1973, 2009, doi: 10.1109/ROBIO.2009.4913302.

W. Sanngeon, N. Afzulpurkar, J. Bhuripanyo, and D. Bodhale, “Adaptive geometry track design and implementation for an all terrain mobile robot,” 2008 IEEE Int. Conf. Robot. Biomimetics, ROBIO 2008, pp. 413–418, 2009, doi: 10.1109/ROBIO.2009.4913039.

S. N. Paul, A. S. Ahmed, M. N. Mollah, M. M. Rayhan, and E. Hossain, “Simplistic approach to design a prototype of autonomous, affordable, and highly efficient agricultural sprayer robot,” 4th Int. Conf. Adv. Electr. Eng. ICAEE 2017, vol. 2018-Janua, pp. 247–252, 2017, doi: 10.1109/ICAEE.2017.8255361.

K. Kunal, A. Z. Arfianto, J. E. Poetro, F. Waseel, and R. A. Atmoko, “Accelerometer Implementation as Feedback on 5 Degree of Freedom Arm Robot,” J. Robot. Control, vol. 1, no. 1, pp. 31–34, 2020, doi: 10.18196/jrc.1107.

A. Latif, K. Shankar, and P. T. Nguyen, “Legged Fire Fighter Robot Movement Using PID,” J. Robot. Control, vol. 1, no. 1, pp. 15–18, 2020, doi: 10.18196/jrc.1104.

A. Latif, H. A. Widodo, R. Rahim, and K. Kunal, “Implementation of Line Follower Robot based Microcontroller ATMega32A,” J. Robot. Control, vol. 1, no. 2, pp. 70–74, 2020, doi: 10.18196/jrc.1316.

A. Hassan et al., “A Wirelessly Controlled Robot-based Smart Irrigation System by Exploiting Arduino,” J. Robot. Control, vol. 2, no. 1, pp. 29–34, 2020, doi: 10.18196/jrc.2148.

I. Prasojo, P. T. Nguyen, and N. Shahu, “Design of Ultrasonic Sensor and Ultraviolet Sensor Implemented on a Fire Fighter Robot Using AT89S52,” J. Robot. Control, vol. 1, no. 2, pp. 59–63, 2020, doi: 10.18196/jrc.1213.

R. Aravind, M. Daman, and B. S. Kariyappa, “Design and development of automatic weed detection and smart herbicide sprayer robot,” 2015 IEEE Recent Adv. Intell. Comput. Syst. RAICS 2015, no. December, pp. 257–261, 2016, doi: 10.1109/RAICS.2015.7488424.

B. B. Aishwarya, G. Archana, and C. Umayal, “Agriculture robotic vehicle based pesticide sprayer with efficiency optimization,” Proc. - 2015 IEEE Int. Conf. Technol. Innov. ICT Agric. Rural Dev. TIAR 2015, no. Tiar, pp. 59–65, 2015, doi: 10.1109/TIAR.2015.7358532.

J. P. Vasconez, G. A. Kantor, and F. A. Auat Cheein, “Human–robot interaction in agriculture: A survey and current challenges,” Biosyst. Eng., vol. 179, pp. 35–48, 2019, doi: 10.1016/j.biosystemseng.2018.12.005.

D. Gibson et al., “Implementation of Xenon Ultraviolet-C Disinfection Robot to Reduce Hospital Acquired Infections in Hematopoietic Stem Cell Transplant Population,” Biol. Blood Marrow Transplant., vol. 23, no. 3, p. S472, 2017, doi: 10.1016/j.bbmt.2016.12.563.

I. González and A. J. Calderón, “Integration of open source hardware Arduino platform in automation systems applied to Smart Grids/Micro-Grids,” Sustain. Energy Technol. Assessments, vol. 36, no. October, p. 100557, 2019, doi: 10.1016/j.seta.2019.100557.

V. R. Mutha, N. Kumar, and P. Pareek, “Real time standalone data acquisition system for environmental data,” 1st IEEE Int. Conf. Power Electron. Intell. Control Energy Syst. ICPEICES 2016, pp. 1–4, 2017, doi: 10.1109/ICPEICES.2016.7853337.

P. Saha, “Design and Implementation of PIC16F877A Microcontroller Based Data Acquisition System with Visual Basic Based GUI,” 2016 7th Int. Conf. Intell. Syst. Model. Simul., pp. 419–423, 2016, doi: 10.1109/ISMS.2016.32.

T. P. Tunggal, L. A. Kirana, A. Z. Arfianto, E. T. Helmy, and F. Waseel, “The Design of Tachometer Contact and Non-Contact Using Microcontroller,” J. Robot. Control, vol. 1, no. 3, pp. 65–69, 2020, doi: 10.18196/jrc.1315.

T. P. Tunggal, S. A. Juliani, H. A. Widodo, R. A. Atmoko, and P. T. Nguyen, “The Design of Digital Heart Rate Meter Using Microcontroller,” J. Robot. Control, vol. 1, no. 5, pp. 141–144, 2020, doi: 10.18196/jrc.1529.

A. Nugraha, D. A. Nurmantris, and R. Anwar, “Implementation of low cost antenna rotator based on microcontroller,” Int. J. Innov. Technol. Explor. Eng., vol. 8, no. 12, pp. 1091–1096, 2019, doi: 10.35940/ijitee.L3879.1081219.

A. K. Das and P. Pattanaik, “Pulse rate monitoring embedded system during indoor exercises using microcontroller,” Int. J. Recent Technol. Eng., vol. 8, no. 3, pp. 2064–2066, 2019, doi: 10.35940/ijrte.C4543.098319.

D. Setiawan, I. Ishak, and M. A. Sembiring, “Control System for Adjusting the Brightness Level with PWM Technique Using Visual Net Microcontroller-Based,” J. Robot. Control, vol. 1, no. 4, 2020, doi: 10.18196/jrc.1422.

R. W. Fransiska, E. M. P. Septia, W. K. Vessabhu, W. Frans, and W. Abednego, “Electrical power measurement using Arduino Uno microcontroller and LabVIEW,” 2013 3rd Int. Conf. Instrumentation, Commun. Inf. Technol. Biomed. Eng., pp. 226–229, 2013, doi: 10.1109/ICICI-BME.2013.6698497.

J. Xue et al., “Design of a wearable device for monitoring SpO2 continuously,” Proc. - 2015 IEEE 12th Int. Conf. Ubiquitous Intell. Comput. 2015 IEEE 12th Int. Conf. Adv. Trust. Comput. 2015 IEEE 15th Int. Conf. Scalable Comput. Commun. 20, pp. 1253–1257, 2016, doi: 10.1109/UIC-ATC-ScalCom-CBDCom-IoP.2015.227.

P. Asha, A. Ambati, and R. Anuhya, “Design and Development of Sensor Based Intelligent Auto Irrigation System,” IOP Conf. Ser. Mater. Sci. Eng., vol. 590, no. 1, pp. 0–6, 2019, doi: 10.1088/1757-899X/590/1/012023.

Iswanto, “Weather Monitoring Station with Remote Radio Frequency Wireless Communications,” Int. J. Embed. Syst. Appl., vol. 2, no. 3, pp. 99–106, 2012, doi: 10.5121/ijesa.2012.2311.

Iswanto, O. Wahyunggoro, and A. I. Cahyadi, “Quadrotor path planning based on modified fuzzy cell decomposition algorithm,” Telkomnika (Telecommunication Comput. Electron. Control., vol. 14, no. 2, pp. 655–664, 2016, doi: 10.12928/telkomnika.v14i2.2989.

S. Biansoongnern, B. Plungkang, and S. Susuk, “Development of Low Cost Vibration Sensor Network for Early Warning System of Landslides,” Energy Procedia, vol. 89, pp. 417–420, 2016, doi: 10.1016/j.egypro.2016.05.055.

K. Anindyaguna, N. C. Basjaruddin, and D. Saefudin, “Overtaking assistant system (OAS) with fuzzy logic method using camera sensor,” 2016 2nd Int. Conf. Ind. Mech. Electr. Chem. Eng. ICIMECE 2016, pp. 89–94, 2017, doi: 10.1109/ICIMECE.2016.7910420.

M. F. Ahmad, H. J. Rong, S. S. N. Alhady, W. Rahiman, and W. A. F. W. Othman, “Colour tracking technique by using pixy CMUcam5 for wheelchair luggage follower,” Proc. - 7th IEEE Int. Conf. Control Syst. Comput. Eng. ICCSCE 2017, vol. 2017-November, no. November, pp. 186–191, 2018, doi: 10.1109/ICCSCE.2017.8284402.

S. Rezwan, W. Ahmed, M. A. Mahia, and M. R. Islam, “IoT Based Smart Inventory Management System for Kitchen Using Weight Sensors, LDR, LED, Arduino Mega and NodeMCU (ESP8266) Wi-Fi Module with Website and App,” Proc. - 2018 4th Int. Conf. Adv. Comput. Commun. Autom. ICACCA 2018, pp. 1–6, 2018, doi: 10.1109/ICACCAF.2018.8776761.

H. Saini, A. Thakur, S. Ahuja, N. Sabharwal, and N. Kumar, “Arduino based automatic wireless weather station with remote graphical application and alerts,” 3rd Int. Conf. Signal Process. Integr. Networks, SPIN 2016, pp. 605–609, 2016, doi: 10.1109/SPIN.2016.7566768.

F. W. Wibowo and P. P. Purwacandra, “Object tracking using initial data to count object image based-on wireless sensor network,” Adv. Sci. Lett., vol. 21, no. 1, pp. 112–116, 2015, doi: 10.1166/asl.2015.5742.

O. Yaseen Ismael and J. Hedley, “Development of an Omnidirectional Mobile Robot Using Embedded Color Vision System for Ball Following,” Am. Sci. Res. J. Eng., vol. 22, no. 1, pp. 231–242, 2016, [Online]. Available:

H. A. Herman and A. Chairunnas, “Model Robot Troli Object Follower Menggunakan Pixy Cmucam5 Berbasis Arduino Uno 328P,” Komputasi J. Ilm. Ilmu Komput. dan Mat., vol. 16, no. 2, pp. 263–270, 2019, doi: 10.33751/komputasi.v16i2.1620.

Article Metrics

Abstract view : 58 times
PDF - 126 times


  • There are currently no refbacks.

Copyright (c) 2021 Journal of Robotics and Control (JRC)

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

Abstracted/Indexed by:




Journal of Robotics and Controls (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Lembaga Penelitian, Publikasi & Pengabdian Masyarakat UMY, Yogyakarta, Indonesia
Published by Universitas Muhammadiyah Yogyakarta, Yogyakarta, Indonesia
Email: ||


Creative Commons License

This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.