Development of a Virtual Environment-Based Electrooculogram Control System for Safe Electric Wheelchair Mobility for Individuals with Severe Physical Disabilities

Jane Phoebe Achieng Ogenga, Paul Waweru Njeri, Joseph Kamau Muguro

Abstract


Conventional wheelchairs are predominantly manual or joystick-operated electric wheelchairs. However, operating these wheelchairs can be difficult or impossible for individuals with severe physical disabilities. Due to losing control of their physical limbs, they depend on an attendant for assistance. As a remedy, bio-signals may be used as a control mechanism since they are readily available and can be acquired from any body part. This research proposes to use EOG signals to vail a control mechanism and test it in a virtual and actual electric wheelchair. The main contribution of the study is an investigation of the use of EOG to control an electric wheelchair in a virtual environment to determine safe control parameters for wheelchair use in complex environments. A customized data acquisition circuit was developed to acquire single-channel EOG signals using wet electrodes. The acquired signal was filtered and processed using feature extraction and classification techniques in MATLAB software. Two customized control environments were developed in Unity 3D, one with equally partitioned sections and the other with sections decreasing in size as the robot wheelchair approaches the target. Twenty-two test subjects (mean age 24.5, std 1.5) participated in the study, controlling the robot wheelchair in real-time with non or least instances of collision and oversteering. The system achieved an accuracy of 96.5% with a response time of 0.7s, translating to an ITR of 70.6 bits/min. Overall, the participants managed to navigate the virtual environment with a completion time of 101.94s ± 19.71 and 109.07s ± 13.25 for the male and female participants, respectively. In the scene with decreasing section sizes, 72% and 54% instances of collision and oversteering were reported, respectively, highlighting the need to consider the complexity of the control environment and the sufficiency of the participants' control skills to ensure safety in operations. The results confirm the usefulness of EOG as a control interface, with little or no need for recalibration. It provides a promising avenue for individuals with severe physical disabilities to operate wheelchairs independently in complex environments, enhancing their quality of life.

Keywords


Electrooculogram; Wheelchair; Classification; Virtual Environment; Safety; Control

Full Text:

PDF

References


M. Sasaki, M. Syaiful, A. Bin Suhaimi, K. Matsushita, S. Ito, and M. I. Rusydi, “Robot Control System Based on Electrooculography and Electromyogram,” J. Comput. Commun., vol. 03, no. 11, pp. 113–120, 2015.

L. Wagner, “Disabled People in the World: Facts and Figures,” 2021. [Online]. Available: https://www.inclusivecitymaker.com/disabled-people-in-the-world-in-2021-facts-and-figures/

S. Heera and A. Maini, “Disability Inclusion,” Flexible Strategies in VUCA Markets2018, pp. 79–88, 2018.

M. Callejas-Cuervo, A. X. González-Cely, and T. Bastos-Filho, “Control Systems and Electronic Instrumentation Applied to Autonomy in Wheelchair Mobility: The State of the Art,” Sensors, vol. 20, no. 21, p. 6326, 2020.

Z. T. Al-qaysi, B. B. Zaidan, A. A. Zaidan, and M. S. Suzani, “A review of disability EEG based wheelchair control system: Coherent taxonomy, open challenges and recommendations,” Comput. Methods Programs Biomed., vol. 164, pp. 221–237, 2018.

J. H. Choi, Y. Chung, and S. Oh, “Motion control of joystick interfaced electric wheelchair for improvement of safety and riding comfort,” Mechatronics, vol. 59, pp. 104–114, 2019.

M. Shibata, C. Zhang, T. Ishimatsu, M. Tanaka, and J. Palomino, “Improvement of a Joystick Controller for Electric Wheelchair User,” Mod. Mech. Eng., vol. 05, pp. 132–138, 2015.

M. Mrabet, Y. Rabhi, and F. Fnaiech, “Development of a New Intelligent Joystick for People with Reduced Mobility,” Appl. bionics Biomech., vol. 2018, p. 2063628, 2018.

L. Yang, N. Guo, R. Sakamoto, N. Kato, and K. Yano, “Electric Wheelchair Hybrid Operating System Coordinated with Working Range of a Robotic Arm,” J. Robot. Control, vol. 3, no. 5, pp. 679–689, 2022.

S. Anwer et al., “Eye and Voice-Controlled Human Machine Interface System for Wheelchairs Using Image Gradient Approach,” Sensors, vol. 20, no. 19, 2020.

V. Khare, S. Gupta, and K. Meena, “Voice Controlled Wheelchair,” Int. J. Electron. Electr. Comput. Syst., vol. 6, no. 4, 2017.

R. Berjón, M. Mateos, A. Barriuso, I. Muriel, and G. Villarrubia, “Head Tracking System for Wheelchair Movement Control,” in Highlights in Practical Applications of Agents and Multiagent Systems, pp. 307–315, 2011.

S. Udhaya kumar and V. M. Vinod, “EOG based wheelchair control for quadriplegics,” in 2015 International Conference on Innovations in Information, Embedded and Communication Systems (ICIIECS), pp. 1–4, 2015.

A. M. Choudhari, P. Porwal, V. Jonnalagedda, and F. Mériaudeau, “An Electrooculography based Human Machine Interface for wheelchair control,” Biocybern. Biomed. Eng., vol. 39, no. 3, pp. 673–685, 2019.

N. M. M. Noor and S. Ahmad, “Analysis of different EOG-based eye movement strength levels for wheelchair control,” Int. J. Biomed. Eng. Technol., vol. 11, no. 2, p. 175, 2013.

W.-D. Chang, “Electrooculograms for Human-Computer Interaction: A Review,” Sensors, vol. 19, no. 12, p. 2690, 2019.

H. Wang, Y. Li, J. Long, T. Yu, and Z. Gu, “An asynchronous wheelchair control by hybrid EEG-EOG brain-computer interface,” Cogn. Neurodyn., vol. 8, no. 5, pp. 399–409, 2014.

J. K. Muguro et al., “Development of Surface EMG Game Control Interface for Persons with Upper Limb Functional Impairments,” Signals, vol. 2, no. 4, pp. 834–851, 2021.

U. Chaudhary, N. Birbaumer, and A. Ramos-Murguialday, “Brain–computer interfaces for communication and rehabilitation,” Nat. Rev. Neurol., vol. 12, no. 9, pp. 513–525, 2016.

Q. Huang, Z. Zhang, T. Yu, S. He, and Y. Li, “An EEG-/EOG-Based Hybrid Brain-Computer Interface: Application on Controlling an Integrated Wheelchair Robotic Arm System,” Front. Neurosci., vol. 13, 2019.

M. Sasaki et al., “Robot control systems using bio-potential signals,” in THE 5TH International Conference on Industrial, Mechanical, Electrical, and Chemical Engineering2019 (ICIMECE 2019), 2020.

M. Plugovoy, M. Forde, T. Wang, E. Chabot, and Y. Sun, “Integrated EOG and EMG Front-End for Differentiating Intentional and Unintentional Blinks,” 43rd Annual Northeast Bioengineering Conference, 2017.

T. Triwiyanto, W. Caesarendra, V. Abdullayev, A. A. Ahmed, and H. Herianto, “Single Lead EMG signal to Control an Upper Limb Exoskeleton Using Embedded Machine Learning on Raspberry Pi,” J. Robot. Control, vol. 4, no. 1, pp. 35–45, 2023.

N. S. Shalal and W. Aboud, “Smart Robotic Exoskeleton: a 3-DOF for Wrist-forearm Rehabilitation,” J. Robot. Control, vol. 2, no. 6, pp. 476--483, 2021.

V. Ratne and M. S. Panse, “Single Channel EOG Signal Processing and Features Extraction using Virtual Instrumentation,” in International Journal of Research and Scientific Innovation (IJRSI), vol. 5, no. 4, 2018.

Y. Li, S. He, Q. Huang, Z. Gu, and Z. L. Yu, “A EOG-based switch and its application for start/stop control of a wheelchair,” Neurocomputing, vol. 275, pp. 1350–1357, 2018.

M. R. Chowdhury, M. N. Mollah, M. Raihan, A. S. Ahmed, M. A. Halim, and M. S. Hossain, “Designing a Cost Effective Prototype of an Automated Wheelchair Based on EOG (Electrooculography),” in 2018 21st International Conference of Computer and Information Technology (ICCIT), 2018.

M. Talukder, Rawdah, A. Aktar, A. Neelima, and A. Rahman, “EOG Based Home Automation System by Cursor Movement Using a Graphical User Interface (GUI),” in 2018 IEEE International WIE Conference on Electrical and Computer Engineering (WIECON-ECE), 2018.

L. Subramanyan, G. Babu, S. Divya, S. Sampley, and S. Yuvaraj, “An approach to control appliances using EOG signal for physically challenged persons,” Int. J. Pure Appl. Math., vol. 119, pp. 285–295, 2018.

D. R. Lingegowda, K. Amrutesh, and S. Ramanujam, “Electrooculography based assistive technology for ALS patients,” in 2017 IEEE International Conference on Consumer Electronics-Asia (ICCE-Asia), pp. 36-40, 2017.

A. Larson, J. Herrera, K. George, and A. Matthews, “Electrooculography based electronic communication device for individuals with ALS,” in 2017 IEEE Sensors Applications Symposium (SAS), pp. 1-5, 2017.

A. López, F. Ferrero, D. Yangüela, C. Álvarez, and O. Postolache, “Development of a Computer Writing System Based on EOG,” Sensors, vol. 17, no. 7, p. 1505, 2017.

P. Shanmugam, “A Novel Analysis of EOG Through Labview for Prosthetic Arm Control System Design Using PIC Microcontroller,” Int. J. Eng. Sci. Invent. Res. Dev., vol. 5, no. 8, 2019.

S. S. Dhankar and M. Soni, “Development of an Eog Based Human Machine Interface to Control a 3R Robot,” Int. J. Adv. Res. Innov. Ideas Educ., vol. 2, pp. 237–243, 2016.

M. Sivakumar, B. Abukalam, R. A. Kumar, S. A. Kumar, and M. H. R. Moorthy, “Microcontroller Based EOG Wheelchair,” Int. J. Innov. Res. Sci. Eng. Technol., vol. 8, pp. 49–52, 2019.

R. B. Navarro, L. B. Vázquez, and E. L. Guillén, “EOG-based wheelchair control,” in Smart Wheelchairs and Brain-Computer Interfaces, pp. 381–403, 2018.

Z. Hossain, M. M. H. Shuvo, and P. Sarker, “Hardware and software implementation of real time electrooculogram (EOG) acquisition system to control computer cursor with eyeball movement,” in 2017 4th International Conference on Advances in Electrical Engineering (ICAEE), pp. 132–137, 2017.

D. B. Anagha, M. S. Sowmya, S. Bhavani, R. N. Priya, and M. R. Usha, “Eye Gaze Controlled Wheelchair,” Int. J. Eng. Res., vol. 9, no. 5, 2020.

B. Champaty, J. Jose, K. Pal, and A. Thirugnanam, “Development of EOG based human machine interface control system for motorized wheelchair,” in 2014 Annual International Conference on Emerging Research Areas: Magnetics, Machines and Drives (AICERA/iCMMD), pp. 1-7, 2014.

N. Borkar, T. Dongare, P. Chahande, J. Bonsod, and A. B. Jirapure, “Microcontroller Based EOG and Accelerometer Guide Wheelchair,” Int. Res. J. Eng. Technol., vol. 5, no. 3, pp. 3803–3807, 2018.

A. Rajesh and M. Mantur, “Eyeball gesture controlled automatic wheelchair using deep learning,” in 2017 IEEE Region 10 Humanitarian Technology Conference (R10-HTC), pp. 387-391, 2017.

Q. Huang et al., “An EOG-Based Human-Machine Interface for Wheelchair Control,” {IEEE} Trans. Biomed. Eng., vol. 65, no. 9, pp. 2023–2032, 2018.

A. Goil, M. Derry, and B. D. Argall, “Using machine learning to blend human and robot controls for assisted wheelchair navigation,” in 2013 IEEE 13th International Conference on Rehabilitation Robotics (ICORR), p. 1-6, 2013.

F. D. Pérez-Reynoso, L. Rodriguez-Guerrero, J. C. Salgado-Ramirez, and R. Ortega-Palacios, “HumanMachine Interface: Multiclass Classification by Machine Learning on 1D EOG Signals for the Control of an Omnidirectional Robot,” Sensors, vol. 21, no. 17, p. 5882, 2021.

A.-G. A. Abdel-Samei, A. S. Ali, F. E. A. El-Samie, and A. M.Brisha, “Efficient Classification of Horizontal And Vertical EOG Signals For Human Computer Interaction,” Research Square, 2021.

J. Martínez-Cerveró et al., “Open Software/Hardware Platform for Human-Computer Interface Based on Electrooculography (EOG) Signal Classification,” Sensors, vol. 20, no. 9, p. 2443, 2020.

X. Wang, Y. Xiao, F. Deng, Y. Chen, and H. Zhang, “Eye-Movement-Controlled Wheelchair Based on Flexible Hydrogel Biosensor and WT-SVM,” Biosensors, vol. 11, no. 6, p. 198, 2021.

F. A. Azhar et al., “The Classification of Electrooculogram (EOG) Through the Application of Linear Discriminant Analysis (LDA) of Selected Time-Domain Signals,” in Lecture Notes in Electrical Engineering, pp. 583–591, 2021.

Babita, P. Syal, and P. Kumari, “Comparative Analysis of KNN, SVM, DT for EOG based Human Computer Interface,” in 2017 International Conference on Current Trends in Computer, Electrical, Electronics and Communication (CTCEEC), pp. 1023–1028, 2017.

F. A. Alturki, K. AlSharabi, A. M. Abdurraqeeb, and M. Aljalal, “EEG Signal Analysis for Diagnosing Neurological Disorders Using Discrete Wavelet Transform and Intelligent Techniques.,” Sensors (Basel)., vol. 20, no. 9, 2020.

Q. Zhang et al., “A real-time wireless wearable electroencephalography system based on Support Vector Machine for encephalopathy daily monitoring,” Int. J. Distrib. Sens. Networks, vol. 14, no. 5, p. 1550147718779562, 2018.

A. Abdelsamei, A. Ali, F. Abd El-Samie, and A. Brisha, “Efficient Classification of Horizontal And Vertical EOG Signals For Human Computer Interaction,” Research Square, 2021.

T. hussein Onn, “Analysis of Electroculography (EOG) for Controlling Wheelchair Motion,” Doctoral dissertation, Universiti Tun Hussein Onn Malaysia, 2015.

L. J. Qi and N. Alias, “Comparison of ANN and SVM for classification of eye movements in EOG signals,” J. Phys. Conf. Ser., vol. 971, p. 12012, 2018.

C. Genova et al., “A simulator for both manual and powered wheelchairs in immersive virtual reality CAVE,” Virtual Real., vol. 26, no. 1, pp. 187–203, 2022.

H. Younis, F. Ramzan, J. Khan, and M. U. Ghani Khan, “Wheelchair Training Virtual Environment for People with Physical and Cognitive Disabilities,” in 2019 15th International Conference on Emerging Technologies (ICET), pp. 1–6, 2019.

M. Eidel and A. Kübler, “Wheelchair Control in a Virtual Environment by Healthy Participants Using a P300-BCI Based on Tactile Stimulation: Training Effects and Usability,” Front. Hum. Neurosci., vol. 14, p. 265, 2020.

L. Keeler, R. L. Kirby, K. Parker, K. D. McLean, and J. A. Hayden, “Effectiveness of the Wheelchair Skills Training Program: a systematic review and meta-analysis.,” Disabil. Rehabil. Assist. Technol., vol. 14, no. 4, pp. 391–409, 2019.

C. Bigras, D. Kairy, and P. S. Archambault, “Augmented feedback for powered wheelchair training in a virtual environment,” J. Neuroeng. Rehabil., vol. 16, no. 1, p. 12, 2019.

M. Djeha, F. Sbargoud, M. Guiatni, K. Fellah, and N. Ababou, “A combined EEG and EOG signals based wheelchair control in virtual environment,” in 2017 5th International Conference on Electrical Engineering - Boumerdes (ICEE-B), pp. 1–6, 2017.

A. P. S. Haroon and D. R. Premachand, “Human Activity Recognition using Machine Learning Approach,” J. Robot. Control, vol. 2, no. 5, pp. 395–399, 2021.

L. Xi and M. Shino, “Shared Control Design Methodologies of an Electric Wheelchair for Individuals with Severe Disabilities using Reinforcement Learning,” J. Adv. Simul. Sci. Eng., vol. 7, pp. 300–319, 2020.

R. Socas, S. Dormido, and R. Dormido, “Optimal Threshold Setting for Event-Based Control Strategies,” IEEE Access, vol. 5, p. 2880-2893, 2017.

S. He and Y. Li, “A Single-Channel EOG-Based Speller,” IEEE Trans. Neural Syst. Rehabil. Eng., vol. 25, no. 11, pp. 1978–1987, 2017.

D. Kumar and A. Sharma, “Electrooculogram-based virtual reality game control using blink detection and gaze calibration,” in 2016 International Conference on Advances in Computing, Communications and Informatics (ICACCI), pp. 2358–2362, 2016.

Y. Nam, B. Koo, A. Cichocki, and S. Choi, “GOM-Face: GKP, EOG, and EMG-Based Multimodal Interface With Application to Humanoid Robot Control,” IEEE Trans. Biomed. Eng., vol. 61, no. 2, pp. 453–462, 2014.




DOI: https://doi.org/10.18196/jrc.v4i2.17165

Refbacks

  • There are currently no refbacks.


Copyright (c) 2023 Jane Phoebe Achieng Ogenga, Paul Waweru Njeri, Joseph Kamau Muguro

Creative Commons License
This work is licensed under a Creative Commons Attribution-ShareAlike 4.0 International License.

 

Journal of Robotics and Control (JRC)

P-ISSN: 2715-5056 || E-ISSN: 2715-5072
Organized by Peneliti Teknologi Teknik Indonesia
Published by Universitas Muhammadiyah Yogyakarta in collaboration with Peneliti Teknologi Teknik Indonesia, Indonesia and the Department of Electrical Engineering
Website: http://journal.umy.ac.id/index.php/jrc
Email: jrcofumy@gmail.com

Kuliah Teknik Elektro Terbaik