Smartphone Sensor-based Development and Implementation of a Remotely Controlled Robot Arm

Wael A. Salah, Anees Abu Sneineh, Arafat A. A. Shabaneh

Abstract


As a result of advances in both technology and science, it is now possible to carry out essential processes such as lifting objects and moving them by remote control of an arm. In this sense, it is much easier for a person to engage in potentially dangerous activities without running the risk of getting hurt. This article presents the development and design of a robot arm that is controlled by a smartphone device using gyroscope sensors integrated inside. Smartphones with built-in gyroscope sensors are used to operate robot arms in a flexible and affordable manner. The robot arm's movement is effectively controlled by the gyroscope sensors, which include proximity, orientation, and accelerometer sensors, to get it to the required position. The developed prototype found to capable of handling a variety of objects with a smooth movement and transporting them based on the movement of a mobile phone. The control of the arm imitates the movements of a human being, which results in the reduction of the amount of time and effort required by a person to carry out a certain process.

Keywords


Smartphone; Controlled; Robot Arm; Microcontroller; Sensor; Remotely; Human-Machine Interaction.

Full Text:

PDF

References


A. A. Sneineh and W. A. Salah, "Modelling of a high-speed precision robot for microelectromechanical systems bonding process application," Maejo International Journal of Science and Technology, vol. 12, no. 1, pp. 51-69, 2018.

J. A. Gonzalez-Aguirre et al., "Service robots: Trends and technology," Applied Sciences, vol. 11, no. 22, p. 10702, 2021.

N. Savela, T. Turja, and A. Oksanen, "Social Acceptance of Robots in Different Occupational Fields: A Systematic Literature Review," International Journal of Social Robotics, vol. 10, no. 4, pp. 493-502, 2018.

P. Polygerinos, Z. Wang, K. C. Galloway, R. J. Wood, and C. J. Walsh, "Soft robotic glove for combined assistance and at-home rehabilitation," in Robotics and Autonomous Systems, vol. 73, pp. 135-143, 2015.

W. A. Salah, B. A. Zneid, A. Abu_al_aish, and M. Nofal, "Development of Smart and Portable Controllable Syringe Pump System for Medical Applications," Journal of Engineering and Technological Sciences, vol. 55, no. 3, pp. 300-312, 2023.

A. Abu Sneineh and A. A. A. Shabaneh, "Design of a smart hydroponics monitoring system using an ESP32 microcontroller and the Internet of Things," MethodsX, vol. 11, 2023.

D. Rodriguez-Guerra, G. Sorrosal, I. Cabanes, and C. Calleja, "Human-Robot Interaction Review: Challenges and Solutions for Modern Industrial Environments," IEEE Access, vol. 9, pp. 108557-108578, 2021.

H. Oliff, Y. Liu, M. Kumar, and M. Williams, "Improving Human-Robot Interaction Utilizing Learning and Intelligence: A Human Factors-Based Approach," IEEE Transactions on Automation Science and Engineering, vol. 17, no. 3, pp. 1597-1610, 2020.

Y. Kadowaki, T. Noritsugu, M. Takaiwa, D. Sasaki, and M. Kato, "Development of soft power-assist glove and control based on human intent," Journal of Robotics and Mechatronics, vol. 23, no. 2, pp. 281-291, 2011.

L. H. Jhang, C. Santiago, and C. S. Chiu, "Multi-sensor based glove control of an industrial mobile robot arm," in 2017 International Automatic Control Conference, CACS 2017, vol. 2017, pp. 1-6, 2017.

P. Ben-Tzvi and Z. Ma, "Sensing and Force-Feedback Exoskeleton (SAFE) Robotic Glove," IEEE Transactions on Neural Systems and Rehabilitation Engineering, vol. 23, no. 6, pp. 992-1002, 2015.

Z. M. Yusoff, S. A. Nordin, A. M. Markom, and N. N. Mohammad, "Wireless hand motion controlled robotic arm using flex sensors," Indonesian Journal of Electrical Engineering and Computer Science, vol. 29, no. 1, pp. 133-140, 2023.

J. Ryu, Y. Kim, H. O. Wang, and D. H. Kim, "Wireless control of a board robot using a sensing glove," in 2014 11th International Conference on Ubiquitous Robots and Ambient Intelligence (URAI), pp. 423-428, 2014.

A. Mishra, S. Malhotra, U. Pradesh, and Ruchira, "Design of hand glove for wireless gesture control of robot," International Journal of Pure and Applied Mathematics, vol. 114, no. 8, pp. 69-79, 2017.

H. Liu, C. Wu, S. Lin, and Y. Chen, "Finger joint aligned flat tube folding structure for robotic glove design," Smart Materials Structures, vol. 33, no. 1, p. 015001, 2023.

H. Liu et al., "From Skin Movement to Wearable Robotics: The Case of Robotic Gloves," Soft Robotics, 2024.

E. Rho et al., "Multiple Hand Posture Rehabilitation System Using Vision-Based Intention Detection and Soft-Robotic Glove," IEEE Transactions on Industrial Informatics, vol. 20, no. 4, pp. 6499-6509, 2024.

N. C. Basjaruddin, E. Sutjiredjeki, and H. W. Caesar Akbar, "Developing an electronic glove based on fuzzy logic for mobile robot control," Journal of Intelligent and Fuzzy Systems, vol. 36, no. 2, pp. 1639-1645, 2019.

K. Roy, D. P. Idiwal, A. Agrawal, and B. Hazra, "Flex sensor based wearable gloves for Robotic gripper control," in ACM International Conference Proceeding Series, vol. 2, 2015.

M. A. Rahman and A. Al-Jumaily, "Design and development of a hand exoskeleton for rehabilitation following stroke," in Procedia Engineering, vol. 41, pp. 1028-1034, 2012.

S. M. Rakhtala and R. Ghayebi, "Real time control and fabrication of a soft robotic glove by two parallel sensors with MBD approach," Medical Engineering and Physics, vol. 100, 2022.

W. Huang, J. Xiao, and Z. Xu, "A variable structure pneumatic soft robot," Scientific Reports, vol. 10, no. 1, 2020.

Z. Wu, X. Li, and Z. Guo, "A Novel Pneumatic Soft Gripper with a Jointed Endoskeleton Structure," Chinese Journal of Mechanical Engineering (English Edition), vol. 32, no. 1, 2019.

K. Suphalak, N. Klanpet, N. Sikaressakul, and S. Prongnuch, "Robot Arm Control System via Ethernet with Kinect V2 Camera for use in Hazardous Areas," in 2024 1st International Conference on Robotics, Engineering, Science, and Technology, pp. 175-180, 2024.

I. J. Meem, S. Osman, K. M. H. Bashar, N. I. Tushar, and R. Khan, "Semi Wireless Underwater Rescue Drone with Robotic Arm," Journal of Robotics and Control (JRC), vol. 3, no. 4, pp. 496-504, 2022.

A. Ravendran, P. Ponpai, P. Yodvanich, W. Faichokchai, and C. H. Hsu, "Design and Development of a Low Cost Rescue Robot With Environmental Adaptability," in 2019 International Conference on System Science and Engineering (ICSSE), pp. 57-61, 2019.

R. M. Ismail, S. Muthukumaraswamy, and A. Sasikala, "Military Support and Rescue Robot," in 2020 4th International Conference on Intelligent Computing and Control Systems (ICICCS), pp. 156-162, 2020.

S. Chatterjee, S. Das, K. Ganguly, and D. Mandal, "Advancements in robotic surgery: innovations, challenges and future prospects," Journal of Robotic Surgery, vol. 18, no. 1, 2024.

A. Khan and Y. Anwar, "Robots in Healthcare: A Survey," in Advances in Computer Vision, pp. 280-292, 2020.

H. Kareemullah, D. Najumnissa, M. S. M. Shajahan, M. Abhineshjayram, V. Mohan, and S. A. Sheerin, "Robotic Arm controlled using IoT application," Computers and Electrical Engineering, vol. 105, p. 108539, 2023.

W. A. Salah and B. A. Zneid, "Evolution of microcontroller-based remote monitoring system applications," International Journal of Electrical and Computer Engineering, vol. 9, no. 4, pp. 2354-2364, 2019.

A. A. Shabaneh, S. Qaddomi, M. Hamdan, A. A. Sneineh, and T. Punithavathi, "Automatic Class Attendance System Using Biometric Facial Recognition Technique Based on Raspberry Pi," Optica Pura y Aplicada, vol. 56, no. 3, 2023.

J. Jallad and O. Badran, "Firefly algorithm tuning of PID position control of DC motor using parameter estimator toolbox," Bulletin of Electrical Engineering and Informatics, vol. 13, no. 2, pp. 916-929, 2024.

W. A. Salah and A. A. A. Shabaneh, "Development and Implementation of a Low-cost Metal Detector Device," Bulletin of Electrical Engineering and Informatics, vol. 13, no. 5, 2024.

S. Leone et al., "Design of a Wheelchair-Mounted Robotic Arm for Feeding Assistance of Upper-Limb Impaired Patients," Robotics, vol. 13, no. 3, 2024.

R. T. Yunardi, E. I. Agustin, and R. Latifah, "Application of EMG and force signals of elbow joint on robot-assisted arm training," Telkomnika (Telecommunication Computing Electronics and Control), vol. 16, no. 6, pp. 2913-2920, 2018.

W. A. Salah, M. A. M. Albreem, and B. A. B. U. Zneid, "Implementation of smart house digital applications for safety and health," Journal of Engineering Science and Technology, vol. 15, no. 4, pp. 2679-2695, 2020.

M. Leung, R. Ortiz, and B. W. Jo, "Semi-automated mid-turbinate swab sampling using a six degrees of freedom collaborative robot and cameras," IAES International Journal of Robotics and Automation, vol. 12, no. 3, pp. 240-247, 2023.

A. Turnip et al., "Development of Autonomous Medical Robot Based Artificial Intelligence and Internet of Things," International Journal of Artificial Intelligence, vol. 22, no. 2, pp. 20-37, 2024.

Y. L. Chen, F. J. Song, H. F. Yan, P. Y. Zhao, and Y. J. Gong, "Research on Human-robot Shared Control of Throat Swab Sampling Robot Based on Intention Estimation," International Journal of Control, Automation and Systems, vol. 22, no. 2, pp. 661-675, 2024.

M. Lorenz et al., "Robotic-Assisted In-Bed Mobilization in Ventilated ICU Patients with COVID-19: An Interventional, Randomized, Controlled Pilot Study (ROBEM II Study)∗," Critical Care Medicine, vol. 52, no. 5, pp. 683-693, 2024.

V. H. Benitez, R. Symonds, and D. E. Elguezabal, "Design of an affordable IoT open-source robot arm for online teaching of robotics courses during the pandemic contingency," HardwareX, vol. 8, p. e00158, 2020.

M. Okwu, L. Tartibu, O. B. Otanocha, and D. R. Enarevba, "Development of a Modular Wall Painting Robot for Hazardous Environment," in icABCD 2021 - 4th International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems, Proceedings, pp. 1-6, 2021.

T. T. Mac, D. N. Trinh, V. T. T. Nguyen, T. H. Nguyen, L. Kovács, and T. D. Nguyen, "The Development of Robotic Manipulator for Automated Test Tube," Acta Polytechnica Hungarica, vol. 21, no. 9, pp. 89-108, 2024.

J. Pitkanen and M. M. Al-Qattan, "Epidemiology of domestic chemical burns in Saudi Arabia," Burns, vol. 27, no. 4, pp. 376-378, 2001.

V. G. Nair, "Efficient Path Planning Algorithm for Mobile Robots Performing Floor Cleaning Like Operations," Journal of Robotics and Control (JRC), vol. 5, no. 1, pp. 287-300, 2024.

V. D. Cong, D. A. Duy, and L. H. Phuong, "Development of Multi-Robotic Arm System for Sorting System Using Computer Vision," Journal of Robotics and Control (JRC), vol. 3, no. 5, pp. 690-698, 2022.

M. Abdullah-Al-Noman, A. N. Eva, T. B. Yeahyea, and R. Khan, "Computer Vision-based Robotic Arm for Object Color, Shape, and Size Detection," Journal of Robotics and Control (JRC), vol. 3, no. 2, pp. 180-186, 2022.

J. Qu, F. Zhang, Y. Wang, and Y. Fu, "Human-like coordination motion learning for a redundant dual-arm robot," Robotics and Computer-Integrated Manufacturing, vol. 57, pp. 379-390, 2019.

L. Peternel, C. Fang, N. Tsagarakis, and A. Ajoudani, "A selective muscle fatigue management approach to ergonomic human-robot co-manipulation," Robotics and Computer-Integrated Manufacturing, vol. 58, pp. 69-79, 2019.

Y. Du, H. B. Amor, J. Jin, Q. Wang, and A. Ajoudani, "Learning-Based Multimodal Control for a Supernumerary Robotic System in Human-Robot Collaborative Sorting," IEEE Robotics and Automation Letters, vol. 9, no. 4, pp. 3435-3442, 2024.

P. Jha et al., "Human–machine interaction and implementation on the upper extremities of a humanoid robot," Discover Applied Sciences, vol. 6, no. 4, 2024.

X. Wang, J. Zhao, and Z. Zhang, "Human–robot kinematic mapping method based on index constraint," Mechatronics, vol. 100, 2024.

S. Monika, B. Annapurna, and T. Anuradha, "Automatic robot navigation system for object picking," in AIP Conference Proceedings, vol. 2492, 2023.

S. G. Kadam and D. Ramacandran, "Gesture control of robotic arm," in AIP Conference Proceedings, vol. 2788, 2023.

A. R. A. Tahtawi, M. Agni, and T. D. Hendrawati, "Small-scale robot arm design with pick and place mission based on inverse kinematics," Journal of Robotics and Control (JRC), vol. 2, no. 6, pp. 469-475, 2021.

J. Borrell, C. Perez-Vidal, and J. V. Segura, "Optimization of the pick-and-place sequence of a bimanual collaborative robot in an industrial production line," International Journal of Advanced Manufacturing Technology, vol. 130, no. 9-10, pp. 4221-4234, 2024.

R. M. Santhosh, H. Vishnuprasad, K. V. Dhanashyam, N. Sanjay, M. S. Prabhu, and K. S. Kumar, "Design and Fabrication of Pick and Place Robot for Shaping Machine Application," in AIP Conference Proceedings, vol. 3060, 2024.

P. Sharmila, D. Sushmitha Singh, M. Afrose Aafrin, M. Ponsheeba, and V. Peroumal, "Design of Robotic Arm with Three Degree of Freedom (DOF) operated by Bluetooth enabled Smartphones," in Proceedings of the 2nd International Conference on Intelligent and Innovative Technologies in Computing, Electrical and Electronics, pp. 1-6, 2024.

M. A. M. Albreem et al., "Green internet of things (IoT): An overview," in 2017 IEEE International Conference on Smart Instrumentation, Measurement and Applications, ICSIMA 2017, pp. 1-6, 2017.

T. N. Do, "IoT-based remote control for robotic arm," International Journal of Systems, Control and Communications, vol. 15, no. 2, pp. 146-158, 2024.

W. Shi and J. Liu, "IoT Based Assistive Robot System Design," in 2023 7th International Conference on Robotics and Automation Sciences, pp. 1-5, 2023.

N. P. Sagar, H. S. Nagpal, A. Chougle, V. Chamola, and B. Sikdar, "Computer Vision and IoT-Enabled Robotic Platform for Automated Crack Detection in Road and Bridges," in Proceedings - 2023 IEEE 6th International Conference on Multimedia Information Processing and Retrieval, pp. 5-10, 2023.




DOI: https://doi.org/10.18196/jrc.v5i4.21987

Refbacks

  • There are currently no refbacks.


Copyright (c) 2024 Wael A. Salah, Anees Abu Sneineh, Arafat A. A. Shabaneh

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik