Design and Implementation of Force Sensation and Feedback Systems for Telepresence Robotic Arm

Akhtar Un Nisa, Saifullah Samo, Raheel Ahmed Nizamani, Areesha Irfan, Zuha Anjum, Laveet Kumar

Abstract


Humans put their own lives aside to save other human’s life and perform risky and dangerous activities. The risk can be reduced by using new technologies. This research study focuses on telepresence and teleoperation systems with motion and force control systems that replace humans in hazardous workspaces. In telepresence, the system helps humans to visualize the environment in real-time. In teleoperation, the system provides sensation to assist human beings in performing out-of-reach and dangerous operations safely as in real, providing a shadow hand to the operator. In this study, a system is developed that consists of a slave robotic arm and a master wearable device with bidirectional communication between the robotic arm and operator (master wearable device). It also presents a gesture-controlled robotic arm that uses sensors to read and translate human arm movements as commands. The slave robotic arm, senses applied force on an object and a master wearable device develops the force according to sensed force, in a result operator senses/feels the same object in the control room at distance. The slave robotic arm also mimics the operator arm to reach the proper position of an object. Several experiments were conducted with untrained personnel and satisfactory results were yielded, which showed that the motion and force replication is 90-95% accurate.

Keywords


Telepresence; Teleoperation; Position measurement; Calibration; Force feedback; Force sensation

Full Text:

PDF

References


C. T. Landi, V. Villani, F. Ferraguti, L. Sabattini, C. Secchi and C. Fantuzzi, "Relieving operators' workload: Towards affective robotics in industrial scenarios," Mechatronics, vol. 54, pp. 144-154, 2018.

H. M. Gross, A. Scheidig, K. Debes, E. Einhorn, M. Eisenbach, S. Mueller, et al., "AREAS: robot coach for walking and orientation training in clinical post-stroke rehabilitation-prototype implementation and evaluation in field trials," Autonomous Robots, vol. 41, no. 3, pp. 679-698, 2017.

S. S. Lone, N. Z. Azlan, and N. Kamarudzaman, "Soft Pneumatic Exoskeleton for Wrist and Thumb Rehabilitation," International Journal of Robotics and Control Systems, vol. 1, no. 4 pp. 440-452, 2021, https://doi.org/10.31763/ijrcs.v1i4.447.

B. Fang, D. Guo, F. Sun, H. Liu and Y. Wu, "A robotic hand-arm teleoperation system using human arm/hand with a novel data glove," 2015 IEEE International Conference on Robotics and Biomimetics (ROBIO), 2015, pp. 2483-2488.

H. Hu, J. Li, Z. Xie, B. Wang, H. Liu and G. Hirzinger, "A robot arm/hand teleoperation system with telepresence and shared control," Proceedings, 2005 IEEE/ASME International Conference on Advanced Intelligent Mechatronics., 2005, pp. 1312-1317.

F. Sorgini et al., "Tactile sensing with gesture-controlled collaborative robot," 2020 IEEE International Workshop on Metrology for Industry 4.0 & IoT, 2020, pp. 364-368.

F. Kobayashi, Ge. Ikai, W. Fukui, and F. Kojima, “Two-Fingered Haptic Device for Robot Hand Teleoperation,” Journal of Robotics, 2011.

J. L. Raheja, G. A. Rajsekhar and A. Chaudhary, "Controlling a remotely located robot using hand gestures in real time: A DSP implementation," 2016 5th International Conference on Wireless Networks and Embedded Systems (WECON), 2016, pp. 1-5.

K. Tashiro, Y. Shiokawa, T. Aono and T. Maeno, "Realization of button click feeling by use of ultrasonic vibration and force feedback," World Haptics 2009 - Third Joint Euro Haptics conference and Symposium on Haptic Interfaces for Virtual Environment and Teleoperator Systems, 2009, pp. 1-6.

C. Wang, S. Huber, S. Coros and R. Poranne, "Task Autocorrection for Immersive Teleoperation," 2021 IEEE International Conference on Robotics and Automation (ICRA), 2021, pp. 3949-3955.

Z. A. Adeola-Bello and N. Z. Azlan, "Power Assist Rehabilitation Robot and Motion Intention Estimation," International Journal of Robotics and Control Systems, vol. 2, no. 2, pp. 297-316. 2022, https://doi.org/10.31763/ijrcs.v2i2.650.

Y. Deng, Y. Tang, B. Yang, W. Zheng, S. Liu and C. Liu, "A Review of Bilateral Teleoperation Control Strategies with Soft Environment," 2021 6th IEEE International Conference on Advanced Robotics and Mechatronics (ICARM), 2021, pp. 459-464.

A. M. Okamura, “Methods for haptic feedback in teleoperated robot assisted surgery,” Industrial Robot: An International Journal, vol. 31, no. 6, pp. 499-508, 2004.

T. Zhang and Y. Nakamura, “Humanoid robot rgb-d slam in the dynamic human environment,” International Journal of Humanoid Robotics, vol. 17, no. 2, p. 2050009, 2020.

C. Wang, X. Chen, Z. Yu, Y. Dong, R. Zhang and Q. Huang, "Intuitive and Versatile Full-body Teleoperation of A Humanoid Robot," 2021 IEEE International Conference on Advanced Robotics and Its Social Impacts (ARSO), 2021, pp. 176-181.

P. A. Linné and J. Andersson, "Regulating Road Vehicle Teleoperation: Back to the Near Future," 2021 IEEE Intelligent Vehicles Symposium Workshops (IV Workshops), 2021, pp. 135-140.

D. Lee, W. K. Chung and K. Kim, "Safety-oriented Teleoperation Framework for Contact-rich Tasks in Hazardous Workspaces," 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), 2021, pp. 4268-4275, doi: 10.1109/IROS51168.2021.9636093.

D. Sun, A. Kiselev, Q. Liao, T. Stoyanov, and A. Loutfi, “A new mixedreality-based teleoperation system for telepresence and maneuverability enhancement,” IEEE Transactions on Human-Machine Systems, vol. 50, no. 1, pp. 55–67, 2020.

A. Handa, K. Van Wyk, W. Yang, J. Liang, Y. W. Chao, Q. Wan, S. Birchfield, N. Ratliff, and D. Fox, “Dexpilot: Vision-based teleoperation of dexterous robotic hand-arm system,” in 2020 IEEE International Conference on Robotics and Automation (ICRA), 2020, pp. 9164–9170.

A. Sripada, H. Asokan, A. Warrier, A. Kapoor, H. Gaur, R. Patel, and R. Sridhar, “Teleoperation of a humanoid robot with motion imitation and legged locomotion,” in 3rd International Conference on Advanced Robotics and Mechatronics (ICARM), 2018, pp. 375–379.

F. Abi-Farrajl, B. Henze, A. Werner, M. Panzirsch, C. Ott, and M. A. Roa, “Humanoid teleoperation using task-relevant haptic feedback,” in International Conference on Intelligent Robots and Systems (IROS), 2018, pp. 5010–5017.

Y. Chen, C. Fu, W. S. W. Leung, and L. Shi, “Drift-free and self-aligned imu-based human gait tracking system with augmented precision and robustness,” IEEE Robotics and Automation Letters, vol. 5, no. 3, pp. 4671–4678, 2020.

K. B. Jang, C. H. Baek, and T. H. Woo, “Risk analysis of nuclear power plant (NPP) operations by artificial intelligence (AI) in robot,” Journal of Robotics and Control (JRC), vol. 3, no. 2, 2022.

A. R. A. Tahtawi, M. Agni and T. D. Hendrawati, “Small-scale Robot Arm Design with Pick and Place Mission Based on Inverse Kinematics,” Journal of Robotics and Control (JRC), vol. 2, no. 6, 2021.

A. Dietrich, K. Bussmann, F. Petit, P. Kotyczka, C. Ott, B. Lohmann, et al., "Whole-body impedance control of wheeled mobile manipulators," Autonomous Robots, vol. 40, no. 3, pp. 505-517, 2016.

A. Ajoudani, A. M. Zanchettin, S. Ivaldi, A. Albu-Schaffer, K. Kosuge and O. Khatib, "Progress and prospects of the human-robot collaboration," Autonomous Robots, vol. 42, no. 5, 2018, doi: 10.1007/s10514-017-9677-2.

K. Kunal, A. Z. Arfianto, J. E. Poetro, F. Waseel, and R. A. Atmoko, “Accelerometer Implementation as Feedback on 5 Degree of Freedom Arm Robot,” Journal of Robotics and Control (JRC), vol. 1, no. 1, 2020.

S. D. Perkasa, P. Megantoro and H. A. Winarno, “Implementation of a camera sensor pixy 2 CMUcam5 to a two wheeled robot to follow colored object,” Journal of Robotics and Control (JRC), vol. 2, no. 6, 2021.

A. A. Rafiq, W. N. Rohman, S. D. Riyanto, “Development of a simple and low-cost smartphone gimbal with MPU-6050 sensor,” Journal of Robotics and Control (JRC), vol. 1, no. 4, pp. 136–140, 2020.

A. Malaise, P. Maurice, F. Colas and S. Ivaldi, "Activity recognition for ergonomics assessment of industrial tasks with automatic feature selection," IEEE Robotics and Automation Letters, vol. 4, no. 2, 2019.

B. Busch, G. Maeda, Y. Mollard, M. Demangeat and M. Lopes, "Postural optimization for an ergonomic human-robot interaction," 2017 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS), pp. 2778-2785, 2017.

J. Romano, K. Hsiao, G. Niemeyer, S. Chitta, and K. Kuchenbecker, “Human-inspired robotic grasp control with tactile sensing,” IEEE Transactions on Robotics, vol. 27, no. 6, pp. 1067–1079, Dec 2011.

N. Nomia, S. Samo and T. Hussain, "Modeling and simulation of robotic finger using gear train mechanism," in 4th International Electrical Engineering Conference (IEEC), 2019, pp. 1-4.

N. Wettels. V. J. Santos, R. S. Johnsson, and G. E. Loeb, and G. S. Sukhatme, “Grip control using biomimetic tactile sensing systems,” IEEE/ASME Transactions on Mechatronics, vol. 14, no. 6 pp. 718-723, 2009.

T. Takaki and T. Omata, “High-performance anthropomorphic robot hand with grasping-force-magnification mechanism,” IEEE/ASME Transactions on Mechatronics, vol. 16, no. 3, pp. 583-591, 2011.

Y. Lin, S. Ren, M. Clevenger, and Y. Sun, “Learning grasping force from demonstration,” IEEE International Conference on In Robotics and Automation (ICRA), 2012, pp. 1526–1531.

P. Payeur, C. Pasca, A. M. Cretu, and E. M. Petriu, “Intelligent haptic sensor system for robotic manipulation,” IEEE Transactions on Instrumentation and Measurement, vol. 54, no. 4, pp. 1583-1592, 2005.

J. Becedas, I Payo, and V. Feliu, “Two-flexible-fingers gripper force feedback control system for its application as end effector on a 6-DOF manipulator,” IEEE Transactions on Robotics, vol. 27, no. 3 pp. 599-615, 2011

V. Lippiello, F. Ruggiero, B. Siciliano, and L. Villani, “Visual grasp planning for unknown objects using a multifingered robotic hand,” IEEE/ASME Transactions on Mechatronics, vol. 18, no. 3, pp. 1050-1059, 2013.

T. Nishimura, K. Mizushima, Y. Suzuki, T. Tsuji and T. Watanabe, "Variable-grasping-mode underactuated soft gripper with environmental contact-based operation," IEEE Robotics and Automation Letters, vol. 2, no. 2, pp. 1164-1171, 2017.

C. Della, V. Arapi, G. Averta, F. Damiani, G. Fiore, A. Settimi, M. G. Catalano, D. Bacciu, A. Bicchi and M. Bianchi, "Learning from humans how to grasp: a data-driven architecture for autonomous grasping with anthropomorphic soft hands," IEEE Robotics and Automation Letters, vol. 4, no. 2, pp. 1533-1540, Apr. 2019.

R. Hodson, "A gripping problem," Nature, vol. 577, no. 7704, pp. S23-S25, May. 2018.

A. Billard and D. Kragic, "Trends and challenges in robot manipulation," Science, vol. 363, no. 6446, pp. 1-8, Jun. 2019.

R. Li and H. Qiao, "A survey of methods and strategies for high-precision robotic grasping and assembly tasks — some new trends," IEEE/ASME Trans. on Mechatronics, vol. 24, no. 6, pp. 2718-2732, 2019.

S. Saifullah, M. A. Shuyuan and S. Bdran, “Novel miniature pneumatic pressure regulator for hopping robots,” Journal of Beijing Institute of Technology, vol. 24, no. 1, pp. 42–48, 2015.

C. R. Wagner, N. Stylopoulos, P. G. Jackson and R. D. Howe, "The benefit of force feedback in surgery: examination of blunt dissection," Teleoperators and Virtual Environments, vol. 16, no. 3, pp. 252-262, 2007.

A. Garg, S. Sen, R. Kapadia, Y. Jen, S. Mickinley, L. M. Miller, et al., "Tumor localization using automated palpation with gaussian process adaptive sampling," IEEE International Conference on Automation Science & Engineering, pp. 194-200, 2016.

A. S. Rangaprasad, E. Ayvali, L. Wang, R. Roy, N. Simaan and H. Choset, "Complementary model update: a method for simultaneous registration and stiffness mapping in flexible environment," IEEE International Conference on Robotics & Automation, pp. 924-930, 2016.




DOI: https://doi.org/10.18196/jrc.v3i5.15959

Refbacks

  • There are currently no refbacks.


Copyright (c) 2022 Akhtar Un Nisa, Saifullah Samo, Raheel Ahmed Nizamani, Areesha Irfan, Zuha Anjum, Laveet Kumar

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik