Physiotherapy Assistance for Patients Using Human Pose Estimation With Raspberry Pi
Article Sidebar
Main Article Content
Abstract
In this work, we employed a device that utilizes Raspberry Pi 4, a camcorder constituent, and a set of audio apparatus to provide real-time assistance to patients during rehabilitation exercises. A person’s lifestyle and physical activity explicitly influence their cerebral health. Exercise routines are crucial for maintaining a proper hormone level and physical fitness. Therefore, the workout routine must be constantly examined and adjusted if any changes are needed. With the help of this device, patients may perform their exercises without a physiotherapist. A physiotherapist can show how to perform the exercises during the first few appointments; after that, the patient can utilize the system to track their routines. This will prevent injuries caused by performing exercises inaccurately when not under the guidance of a medical practitioner. The device monitors how frequently a certain exercise is performed and guides the patient in performing the exercises correctly, promoting quicker recovery. The voice generated also helps the patients analyze and correct the exercises if needed. When detecting a slump, an alarm is triggered to alert the individual. We focused on human pose detection using the OpenCV and MediaPipe libraries to capture and dissect in real-time accurately. OpenCV and MediaPipe libraries were used to capture and detect poses accurately in real time.
Article Details
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
References
Kertesz, C. Physiotherapy Exercises Recognition Based on RGB-D Human Skeleton Models. 2013 European Modelling Symposium, Manchester, United Kingdom 2013, 21–29. https://doi.org/10.1109/EMS.2013.4
Herbert, R. D.; Maher, C. G.; Moseley, A. M.; Sherrington, C. Regular review: Effective physiotherapy. British Medical Journal 2001, 323(7316), 788–790. https://doi.org/10.1136/bmj.323.7316.788
Rucha, G. (2023, September 9). India. Physiopedia. https://www.physio-pedia.com/India
Piñero-Fuentes, E.; Canas-Moreno, S.; Rios-Navarro, A.; Domínguez-Morales, M.; Sevillano, J. L.; Linares-Barranco, A. A Deep-Learning Based Posture Detection System for Preventing Telework-Related Musculoskeletal Disorders. Sensors 2021, 21(15), 5236. https://doi.org/10.3390/s21155236
Khan, Rushina., Deogiri Inst of Engg. Management Studies. Telecommunting: The Problems Challenges During Covid-19. International Journal of Engineering Research and Technology 2020, V9(07), IJERTV9IS070432. https://doi.org/10.17577/IJERTV9IS070432
Nag, P. K. Musculoskeletal Disorders: Office Menace. In P. K. Nag, Office Buildings. 105–126. Springer Singapore 2019. https://doi.org/10.1007/978-981-13-2577-9_4
Yamao, K.; Kubota, R. Development of Human Pose Recognition System by Using Raspberry Pi and PoseNet Model. 2021 20th International Symposium on Communications and Information Technologies (ISCIT), Tottori, Japan 2021, 41–44. https://doi.org/10.1109/ISCIT52804.2021.9590593
Kulkarni, K. M.; Shenoy, S. Table Tennis Stroke Recognition Using Two-Dimensional Human Pose Estimation 2021. https://doi.org/10.48550/ARXIV.2104.09907
Zhang, Y.; You, S.; Karaoglu, S.; Gevers, T. Multi-person 3D pose estimation from a single image captured by a fisheye camera. Computer Vision and Image Understanding 2022, 222, 103505. https://doi.org/10.1016/j.cviu.2022.103505
Yeo, N. Posture detection for physical therapy application. Final Year Project (FYP), Nanyang Technological University, Singapore 2023. https://hdl.handle.net/10356/166826
Nishchal, K. A.; Prajwal, R. V.; Prakruthi, B. M.; Venika, S.; Anil, K. C. Vision Based Human Fall Detection System. International Research Journal of Modernization in Engineering Technology and Science 2023. https://doi.org/10.56726/IRJMETS37625
Kontadakis, G.; Chasiouras, D.; Proimaki, D.; Halkiadakis, M.; Fyntikaki, M.; Mania, K. Gamified platform for rehabilitation after total knee replacement surgery employing low cost and portable inertial measurement sensor node. Multimedia Tools and Applications 2020. 79(5–6), 3161–3188. https://doi.org/10.1007/s11042-018-6572-6
Thar, M. C.; Winn, K. Z. N.; Funabiki, N. A Proposal of Yoga Pose Assessment Method Using Pose Detection for Self-Learning. 2019 International Conference on Advanced Information Technologies (ICAIT) 2019, 137–142. https://doi.org/10.1109/AITC.2019.8920892
Rathour, N.; Khanam, Z.; Gehlot, A.; Singh, R.; Rashid, M.; AlGhamdi, A. S.; Alshamrani, S. S. Real-Time Facial Emotion Recognition Framework for Employees of Organizations Using Raspberry-Pi. Applied Sciences 2021, 11(22), 10540. https://doi.org/10.3390/app112210540
Ryberg, S.; Jansson, J. Real-time object detection robot control : Investigating the use of real time object detection on a Raspberry Pi for robot control (Dissertation). Retrieved from https://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-320969. 2022.
Chen, P.-J.; Hu, T.-H.; Wang, M.-S. Raspberry Pi-Based Sleep Posture Recognition System Using AIoT Technique. Healthcare 2022, 10(3), 513. https://doi.org/10.3390/healthcare10030513
Yalin, L.; Aleksandar, V.; Min, X. A Deep Learning Framework for Assessing Physical Rehabilitation Exercises. IEEE Transactions on Neural Systems and Rehabilitation Engineering 2020, 28(2), 468-477. https://doi.org/10.1109/TNSRE.2020.2966249
Lugaresi, C.; Tang, J.; Nash, H.; McClanahan, C.; Uboweja, E.; Hays, M.; Zhang, F.; Chang, C.-L.; Yong, M. G.; Lee, J.; Chang, W.-T.; Hua, W.; Georg, M.; Grundmann, M. MediaPipe: A Framework for Building Perception Pipelines (arXiv:1906.08172). arXiv. 2019. http://arxiv.org/abs/1906.08172
Lin, Y.; Jiao, X.; Zhao, L. Detection of 3D Human Posture Based on Improved Mediapipe. Journal of Computer and Communications, 2023, 11(02), 102–121. https://doi.org/10.4236/jcc.2023.112008
On-device machine learning for everyone MediaPipe. 2023. https://developers.google.com/mediapipe
Podduturi, H. V. R.; Varla, C.; Gopaldinne, K. R.; Bhukya, N.; Reddy Nallagondu, R. K.; Bapiraju, G. S. Smart Trainer using OpenCV. 2023 International Conference on Innovative Data Communication Technologies and Application (ICIDCA), Uttarakhand, India 2023, 477–480. https://doi.org/10.1109/ICIDCA56705.2023.10099780
Mahato, A. (2023, September 9). Getting started with Image Processing Using OpenCV. Retrieved from Analytics Vidhya website: https://www.analyticsvidhya.com/blog/2023/03/getting-started-with-image-processing-using-opencv/
Naveenkumar, M.; Vadivel, A. OpenCV for Computer Vision Applications [Conference session]. Conference: Proceedings of National Conference on Big Data and Cloud Computing (NCBDC’15), Trichy, India 2015. https://www.researchgate.net/publication/301590571_OpenCV_for_Computer_Vision_Applications#fullTextFileContent
Xiangxin, Zhu.; Ramanan, D. Face detection, pose estimation, and landmark localization in the wild. 2012 IEEE Conference on Computer Vision and Pattern Recognition 2012, 2879–2886. https://doi.org/10.1109/CVPR.2012.6248014
Sunil, D. K.; Nipun, K.; Kumbhkarn, Sumit, K.; Atharva, K.; Shreyash, K. Posture Detection and Comparison of Different Physical Exercises Based on Deep Learning Using Media Pipe, Opencv. International Journal of Scientific Research in Engineering and Management (IJSREM) 2023. https://ijsrem.com/download/posture-detection-and-comparison-of-different-physical-exercises-based-on-deep-learning-using-media-pipe-opencv/
Alwani, A. A.; Chahir, Y.; Goumidi, D. E.; Molina, M.; Jouen, F. 3D-Posture Recognition Using Joint Angle Representation. In A. Laurent, O. Strauss, B. Bouchon-Meunier, R. R. Yager (Eds.), Information Processing and Management of Uncertainty in Knowledge-Based Systems 2014, 443, 106–115. Springer International Publishing. https://doi.org/10.1007/978-3-319-08855-6_12
Fang, H.-S.; Li, J.; Tang, H.; Xu, C.; Zhu, H.; Xiu, Y.; Li, Y.-L.; Lu, C. AlphaPose: Whole-Body Regional Multi-Person Pose Estimation and Tracking in Real-Time. IEEE Transactions on Pattern Analysis and Machine Intelligence 2023, 45(6), 7157–7173. https://doi.org/10.1109/TPAMI.2022.3222784
Machine Vision and Intelligence Group @ SJTU. (2023, September 9). Real-Time and Accurate Full-Body Multi-Person Pose Estimation and Tracking System. Retrieved from https://github.com/MVIG-SJTU/AlphaPose
Bukschat, Y.; Vetter, M. EfficientPose: An efficient, accurate and scalable end-to-end 6D multi object pose estimation approach (arXiv:2011.04307). arXiv. 2020. http://arxiv.org/abs/2011.04307
Ybkscht. (2023, September 9). EfficientPose. Retrieved from https://github.com/ybkscht/EfficientPose