Electric wheelchair navigation based on hand gestures prediction using the k-Nearest Neighbor method

Khairul Anam, Safri Nahela, Muchamad Arif Hana Sasono, Naufal Ainur Rizal, Aviq Nurdiansyah Putra, Bambang Wahono, Yanuandri Putrasari, Muhammad Khristamto Aditya Wardana, Taufik Ibnu Salim

Abstract

The advancement of technology in the medical field has led to innovations in assistive devices, including wheelchairs, to enhance the mobility and independence of individuals with disabilities. This study investigates the use of electromyography (EMG) signals from hand muscles to control a wheelchair using the k-Nearest Neighbor (kNN) classification method. kNN is a classification algorithm that identifies objects based on the proximity of similar objects in the feature space. The wheelchair control process begins with the development of a kNN model trained on EMG signal data collected from five respondents over 30 seconds. The data was processed using feature extraction techniques, namely Mean Absolute Value (MAV) and Root Mean Square (RMS), to identify motion characteristics corresponding to five types of movement: forward, backward, right, left, and stop. The extracted features were classified using the kNN algorithm implemented on a Raspberry Pi 3. The classification results were then used to control the wheelchair through an Arduino UNO microcontroller connected to a BTS7960 motor driver. The study achieved an average accuracy of 96% with the MAV feature and 𝑘 = 3. Furthermore, combining MAV and RMS features significantly improved classification accuracy. The highest accuracy was obtained using the combination of MAV and RMS features with 𝑘 = 3, demonstrating the effectiveness of feature selection and parameter tuning in enhancing the system's performance.



Keywords


Assistive technology; Electromyography signal; Feature extraction; K-Nearest Neighbor classification; Wheelchair control system

Full Text:

PDF


References


P. Cordts, S. R. Cotten, T. Qu, and T. R. Bush, “Mobility challenges and perceptions of autonomous vehicles for individuals with physical disabilities,” Disabil. Health J., vol. 14, no. 4, p. 101131, Oct. 2021, doi: 10.1016/j.dhjo.2021.101131.

D. Petrović, R. M. Mijailović, and D. Pešić, “IMPROVING MOBILITY OF PERSONS WITH DISABILITIES – GLOBAL EXPERIENCES,” in XIX International Conference Road Safety in Local Community, Road Safety in Local Community, 2024, pp. 343–351. doi: 10.46793/RSafLC24.334P.

J. Hwang, W. Li, L. M. Stough, C. Lee, and K. Turnbull, “People with disabilities’ perceptions of autonomous vehicles as a viable transportation option to improve mobility: An exploratory study using mixed methods,” Int. J. Sustain. Transp., vol. 15, no. 12, pp. 924–942, Oct. 2021, doi: 10.1080/15568318.2020.1833115.

L. M. Koon, E. T. Remillard, T. L. Mitzner, and W. A. Rogers, “Aging Concerns, Challenges, and Everyday Solution Strategies (ACCESS) for adults aging with a long-term mobility disability,” Disabil. Health J., vol. 13, no. 4, p. 100936, Oct. 2020, doi: 10.1016/j.dhjo.2020.100936.

J. Woo, K. Yamaguchi, and Y. Ohyama, “Development of a Control System and Interface Design Based on an Electric Wheelchair,” J. Adv. Comput. Intell. Intell. Informatics, vol. 25, no. 5, pp. 655–663, Sep. 2021, doi: 10.20965/jaciii.2021.p0655.

W. Yang, Y. Tang, Q. Wang, Z. Lan, and H. Su, “A Control System of Electric Wheelchair,” IOP Conf. Ser. Mater. Sci. Eng., vol. 740, no. 1, p. 012009, Jan. 2020, doi: 10.1088/1757-899X/740/1/012009.

M. A. M. Azraai, S. Z. Yahaya, I. A. Chong, Z. H. C. Soh, Z. Hussain, and R. Boudville, “Head Gestures Based Movement Control of Electric Wheelchair for People with Tetraplegia,” in 2022 IEEE 12th International Conference on Control System, Computing and Engineering (ICCSCE), IEEE, Oct. 2022, pp. 163–167. doi: 10.1109/ICCSCE54767.2022.9935646.

E. Yulianto, T. B. Indrato, B. T. Mega Nugraha, and S. Suharyati, “Wheelchair for Quadriplegic Patient with Electromyography Signal Control Wireless,” Int. J. Online Biomed. Eng., vol. 16, no. 12, pp. 94–115, Oct. 2020, doi: 10.3991/ijoe.v16i12.15721.

Z. Alibhai, T. Burreson, M. Stiller, I. Ahmad, M. Huber, and A. Clark, “A Human-Computer Interface For Smart Wheelchair Control Using Forearm EMG Signals,” in 2020 3rd International Conference on Data Intelligence and Security (ICDIS), IEEE, Jun. 2020, pp. 34–39. doi: 10.1109/ICDIS50059.2020.00011.

S. Agrawal, Y. Jain, G. Naik, S. Soneji, and K. Deorukhkar, “EMG Signal Controlled Wheelchair,” Int. J. Comput. Appl., vol. 185, no. 23, pp. 46–48, Jul. 2023, doi: 10.5120/ijca2023922986.

Y. E. Prasetyo, H. Hindarto, S. Syahrorini, and A. Wisaksono, “Wheelchair Control Using Bluetooth-Based Electromyography Signals,” J. Comput. Networks, Archit. High Perform. Comput., vol. 5, no. 1, pp. 148–159, Feb. 2023, doi: 10.47709/cnahpc.v5i1.2063.

Y. Zhang, J. Shan, Y. Yang, J. Wang, G. Li, and A. Sun, “Combined control of rehabilitation wheelchair using periocular electromyography and electroencephalography,” Biomed. Signal Process. Control, vol. 90, p. 105854, Apr. 2024, doi: 10.1016/j.bspc.2023.105854.

A. Kaur, “Wheelchair control for disabled patients using EMG/EOG based human machine interface: a review,” J. Med. Eng. Technol., vol. 45, no. 1, pp. 61–74, Jan. 2021, doi: 10.1080/03091902.2020.1853838.

L. K. P. Gunarathne, D. V. D. S. Welihinda, H. M. K. K. M. B. Herath, and S. L. P. Yasakethu, “EEG-Assisted EMG-Controlled Wheelchair for Improved Mobility of Paresis Patients,” in 2023 IEEE IAS Global Conference on Emerging Technologies (GlobConET), IEEE, May 2023, pp. 1–6. doi: 10.1109/GlobConET56651.2023.10149923.

M. W. S. Gondal et al., “EMG-based Control of Wheel Chair,” in 2022 13th Asian Control Conference (ASCC), IEEE, May 2022, pp. 1–5. doi: 10.23919/ASCC56756.2022.9828265.

A. Phinyomark, R. N. Khushaba, and E. Scheme, “Feature Extraction and Selection for Myoelectric Control Based on Wearable EMG Sensors,” Sensors, vol. 18, no. 5, p. 1615, May 2018, doi: 10.3390/s18051615.

A. Ameri, M. A. Akhaee, E. Scheme, and K. Englehart, “Real-time, simultaneous myoelectric control using a convolutional neural network,” PLoS One, vol. 13, no. 9, p. e0203835, Sep. 2018, doi: 10.1371/journal.pone.0203835.

I. Vujaklija, V. Shalchyan, E. N. Kamavuako, N. Jiang, H. R. Marateb, and D. Farina, “Online mapping of EMG signals into kinematics by autoencoding,” J. Neuroeng. Rehabil., vol. 15, no. 1, p. 21, Dec. 2018, doi: 10.1186/s12984-018-0363-1.

İ. E. SAÇU, “Fractional Integration Based Feature Extractor for EMG Signals,” Balk. J. Electr. Comput. Eng., vol. 10, no. 2, pp. 132–138, Apr. 2022, doi: 10.17694/bajece.899088.

Y. Zhang et al., “Extracting time-frequency feature of single-channel vastus medialis EMG signals for knee exercise pattern recognition,” PLoS One, vol. 12, no. 7, p. e0180526, Jul. 2017, doi: 10.1371/journal.pone.0180526.

H. Deng, G. Xin, G. Zhong, and M. Mistry, “Object carrying of hexapod robots with integrated mechanism of leg and arm,” Robot. Comput. Integr. Manuf., vol. 54, pp. 145–155, Dec. 2018, doi: 10.1016/j.rcim.2017.11.014.

J. Li, Y. Fang, Y. Huang, G. Li, Z. Ju, and H. Liu, “Towards Active Muscle Pattern Analysis for Dynamic Hand Motions via sEMG,” 2019, pp. 372–382. doi: 10.1007/978-3-319-97982-3_31.

A. Ameri, “Dimensionality Reduction in EMG-Based Estimation of Wrist Kinematics,” J. Biomed. Phys. Eng., vol. 10, no. 5, Oct. 2020, doi: 10.31661/jbpe.v0i0.2004-1105.

S. Afrin, H. Mahmud, and M. K. Hasan, “EMG-Based Hand Gesture Dataset to Control Electronic Wheelchair for SCI Patients,” in Proceedings of the 2nd International Conference on Computing Advancements, New York, NY, USA: ACM, Mar. 2022, pp. 165–170. doi: 10.1145/3542954.3542979.

H. Iqbal, J. Zheng, R. Chai, and S. Chandrasekaran, “Electric powered wheelchair control using user-independent classification methods based on surface electromyography signals,” Med. Biol. Eng. Comput., vol. 62, no. 1, pp. 167–182, Jan. 2024, doi: 10.1007/s11517-023-02921-z.

T. Triwiyanto et al., “Electromyography Feature Analysis to Recognize the Hand Motion in a Prosthetic Hand Design,” J. Biomimetics, Biomater. Biomed. Eng., vol. 50, pp. 25–37, Apr. 2021, doi: 10.4028/www.scientific.net/JBBBE.50.25.

M. Gavrilescu, “Shape Variance-Based Feature Extraction for Biometric Fingerprint Analysis,” in 2021 25th International Conference on System Theory, Control and Computing (ICSTCC), IEEE, Oct. 2021, pp. 515–518. doi: 10.1109/ICSTCC52150.2021.9607310.

P. C. Petrantonakis and I. Kompatsiaris, “Fast Feature Extraction from Large Scale Connectome Data Sets Using Zero Crossing Counts Over Graphs,” in 2022 30th European Signal Processing Conference (EUSIPCO), IEEE, Aug. 2022, pp. 927–931. doi: 10.23919/EUSIPCO55093.2022.9909570.

E. A. Clancy, E. L. Morin, G. Hajian, and R. Merletti, “Tutorial. Surface electromyogram (sEMG) amplitude estimation: Best practices,” J. Electromyogr. Kinesiol., vol. 72, p. 102807, Oct. 2023, doi: 10.1016/j.jelekin.2023.102807.

C. Castellini, P. van der Smagt, G. Sandini, and G. Hirzinger, “Surface EMG for force control of mechanical hands,” in 2008 IEEE International Conference on Robotics and Automation, IEEE, May 2008, pp. 725–730. doi: 10.1109/ROBOT.2008.4543291.

M. Atzori et al., “Electromyography data for non-invasive naturally-controlled robotic hand prostheses,” Sci. Data, vol. 1, no. 1, p. 140053, Dec. 2014, doi: 10.1038/sdata.2014.53.

G. Pomboza-Junez and J. H. Terriza, “Hand gesture recognition based on sEMG signals using Support Vector Machines,” in IEEE International Conference on Consumer Electronics - Berlin, ICCE-Berlin, 2016, pp. 174–178. doi: 10.1109/ICCE-Berlin.2016.7684748.

B. Chan, I. Saad, N. Bolong, and K. E. Siew, “Preliminary Design of Portable Electromyography (EMG) System for Clinical Signal Acquisition,” in 2021 IEEE International Conference on Artificial Intelligence in Engineering and Technology (IICAIET), IEEE, Sep. 2021, pp. 1–5. doi: 10.1109/IICAIET51634.2021.9573901.

M. del Olmo and R. Domingo, “EMG Characterization and Processing in Production Engineering,” Materials (Basel)., vol. 13, no. 24, p. 5815, Dec. 2020, doi: 10.3390/ma13245815.

S. T. P. Raghu, D. T. MacIsaac, and A. D. C. Chan, “Automated Biomedical Signal Quality Assessment of Electromyograms: Current Challenges and Future Prospects,” IEEE Instrum. Meas. Mag., vol. 25, no. 1, pp. 12–19, Feb. 2022, doi: 10.1109/MIM.2022.9693438.

D. Farina and R. M. Enoka, “Evolution of surface electromyography: From muscle electrophysiology towards neural recording and interfacing,” J. Electromyogr. Kinesiol., vol. 71, p. 102796, Aug. 2023, doi: 10.1016/j.jelekin.2023.102796.

S. Bhattacharya, A. Luo, S. Dutta, M. Miura-Mattausch, and H. J. Mattausch, “Force-Sensor-Based Surface Recognition With Surface-Property-Dependent Walking-Speed Adjustment of Humanoid Robot,” IEEE Access, vol. 8, pp. 169640–169651, 2020, doi: 10.1109/ACCESS.2020.3023995.

C. Zhang, Q. Wu, and Z. Ma, “Detection of active segments of lower limbs EMG signal based on time-domain variance combined with short-term energy,” J. Phys. Conf. Ser., vol. 2395, no. 1, p. 012049, Dec. 2022, doi: 10.1088/1742-6596/2395/1/012049.

V. Kumar, “Fourier Inspection of Average & RMS Tools,” Procedia Comput. Sci., vol. 167, pp. 97–100, 2020, doi: 10.1016/j.procs.2020.03.186.

D. C. Toledo-Perez, J. Rodriguez-Resendiz, and R. A. Gomez-Loenzo, “A Study of Computing Zero Crossing Methods and an Improved Proposal for EMG Signals,” IEEE Access, vol. 8, pp. 8783–8790, 2020, doi: 10.1109/ACCESS.2020.2964678.

P. H. Putra, M. S. Novelan, and M. Rizki, “Analysis K-Nearest Neighbor Method in Classification of Vegetable Quality Based on Color,” J. Appl. Eng. Technol. Sci., vol. 3, no. 2, pp. 126–132, Jun. 2022, doi: 10.37385/jaets.v3i2.763.

A. R. Lubis, M. Lubis, and A.- Khowarizmi, “Optimization of distance formula in K-Nearest Neighbor method,” Bull. Electr. Eng. Informatics, vol. 9, no. 1, pp. 326–338, Feb. 2020, doi: 10.11591/eei.v9i1.1464.


Article Metrics

Metrics Loading ...

Metrics powered by PLOS ALM

Refbacks

  • There are currently no refbacks.




Copyright (c) 2025 Khairul Anam, Safri Nahela, Muchamad Arif Hana Sasono, Naufal Ainur Rizal, Aviq Nurdiansyah Putra, Bambang Wahono, Yanuandri Putrasari, Muhammad Khristamto Aditya Wardana, Taufik Ibnu Salim

Creative Commons License
This work is licensed under a Creative Commons Attribution-NonCommercial-ShareAlike 4.0 International License.