MEMS based eating and drinking gesture spotting using machine learning techniques

Subramani, Sivakannan; Sathish, Paavana; Subramani, Pushpalatha

doi:10.47974/JSMS-953

Open Access Research Article

MEMS based eating and drinking gesture spotting using machine learning techniques

^*Sivakannan SubramaniCorresponding authorsivakannan87@gmail.comDepartment of Advanced ComputingBangaloreSt. Joseph’s UniversityIndiaView full profile → , Paavana Sathishpaavanasathish@gmail.comDepartment of Advanced Optical TechnologiesErlangenFriedrich Alexander UniversityGermanyView full profile → , Pushpalatha Subramanilpushpa199@gmail.comDepartment of Medical ElectronicsBangaloreMVJ College of EngineeringIndiaView full profile →

* Corresponding author · click or hover a name for details

pp. 133–145Vol. 26Issue 1December 2022DOI: 10.47974/JSMS-953XML

Published Online:: 31 Dec 2022
Article type:: Research Article
Language:: EN
Article no.:: JSMS-953
Pages:: 133–145

Abstract

An effective human-computer interaction for collaborative, collective and brilliant computing is provided by the Gesture recognition. Our study uses a single 3-axis accelerometer and 3-axis gyroscope for acquiring the data. Dynamic Time Warping (DTW), time and frequency domain and gesture discrepancy features are extracted from the raw data and these features are subjected to supervised machine learning algorithms such as KNN, SVM, RF and ANN. The system is evaluated depending on the data base of more than 10,000 traces obtained from five subsets. Through this study, we intend to identify eating and drinking gestures and more broadly short activities on real time environment. Many approaches for gesture recognition in specific settings have already been explored and studied using the combined interaction of several sensors. Despite these powerful hypotheses, gesture interpretation is still fragile and often depends on the individual’s positioning relative to the cameras not with the sensors.

Keywords

Gesture recognition Dynamic time warping Machine learning Time and frequency domain features MEMS

Subject Classifications

68T07

References

[1] Pigford & Andrews (2010) Pigford T andrews AW. Feasibility and benefit of using the Nintendo Wii Fit for balance rehabilitation in an elderly patient experiencing recurrent falls. Journal of Student Physical Therapy Research. 2010; 2(1):12–20
[2] S. Mitra and T. Acharya, “Gesture recognition: A survey,” IEEE Transactions on Systems, Man and Cybernetics - Part C, vol. 37, no. 3, pp. 311–324, 2007.
[3] L. Hyeon-Kyu and H. Kim-J, “An HMM-based threshold model approach for gesture recognition,” IEEE Transactions on Pattern Analysis and Machine Intelligence, Oct. 1999.
[4] J. Alon, V. Athitsos, Q. Yuan and S. Sclaroff, “A unified framework for gesture recognition and spatiotemporal gesture segmentation,” IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 31, pp. 1685–1699, 2009.
[5] S. Zhao, W. Tan, S. Wen and Y. Liu, “An improved algorithm of hand gesture recognition under intricate background,” in ICIRA ’08: Proceedings of the First International Conference on Intelligent Robotics and Applications. Berlin, Heidelberg: Springer-Verlag, 2008, pp. 786–794.
[6] J. Alon, V. Athitsos and S. Sclaroff, “Accurate and efficient gesture spotting via pruning and sub gesture reasoning,” in In Proc. IEEE ICCV Workshop on Human Computer Interaction, 2005, pp. 189–198.
[7] X. Zhang, X. Chen, W.-h. Wang, J.-h. Yang, V. Lantz and K.-q. Wang, “Hand gesture recognition and virtual game control based on 3D accelerometer and EMG sensors,” in IUI ’09: Proceedings of the 13th international conference on Intelligent user interfaces. New York, NY, USA: ACM, 2009, pp. 401–406.
[8] C. A. Wingrave, B. Williamson, P. D. Varcholik, J. Rose, A. Miller, E. Charbonneau, J. Bott and J. J. L. Jr., “The wiimote and beyond: Spatially convenient devices for 3D user interfaces,” IEEE Computer Graphics and Applications, vol. 30, pp. 71–85, 2010.
[9] Mahendra Kumar Jangir & Karan Singh (2019) HARGRURNN: Human activity recognition using inertial body sensor gated recurrent units recurrent neural network, Journal of Discrete Mathematical Sciences and Cryptography, 22:8, 1577-1587, DOI: 10.1080/09720529.2019.1696552.
[10] Jasleen Kaur Sethi & Mamta Mittal (2019) A new feature selection method based on machine learning technique for air quality dataset, Journal of Statistics and Management Systems, 22:4, 697-705, DOI: 10.1080/09720510.2019.1609726.
[11] Dharm Singh Jat, Poonam Dhaka & Anton Limbo (2018) Applications of statistical techniques and artificial neural networks: A review, Journal of Statistics and Management Systems, 21:4, 639-645, DOI: 10.1080/09720510.2018.1475073.

Views: 234Downloads: 47Citations: 0