Motion-Based Serious Games for Hand Assistive Rehabilitation

ABSTRACT

Cerebral Palsy, trauma, and strokes are common causes for the loss of hand movements and the decrease in muscle strength for both children and adults. Improving fine motor skills usually involves the synchronization of wrists and fingers by performing appropriate tasks and activities. This demo introduces a novel patient-centered framework for the gamification of hand therapies in order to facilitate and encourage the rehabilitation process. This framework consists of an adaptive therapy-driven 3D environment augmented with our motion-based natural user interface. An intelligent game generator is developed, which translates the patient's gestures into navigational movements with therapy-driven goals, while adapting the level of difficulty based on the patient profile and real-time performance. A comprehensive evaluation and clinical-based assessments were conducted in a local children disability center, and highlights of the results are presented.

References

1. Imad Afyouni, Faizan Ur Rehman, Ahmad Qamar, Akhlaq Ahmad, Mohamed Abdur, and Saleh Basalamah. 2014. A GIS-based Serious Game Recommender for Online Physical Therapy. In In Proceedings of the Third International ACM SIGSPATIAL Workshop on HealthGIS (HealthGIS'14).
2. Cati Boulanger, Adam Boulanger, Lilian de Greef, Andy Kearney, Kiley Sobel, Russell Transue, Z Sweedyk, Paul H Dietz, and Steven Bathiche. 2013. Stroke rehabilitation with a sensing surface. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1243--1246.
3. Yasaman Hashemian and Ding Wang. 2014. TouchPoints: an exertion game with strategy. In Proceedings of the ?rst ACM SIGCHI annual symposium on Computer-human interaction in play. ACM, 419--420.
4. Maryam Khademi, Hossein Mousavi Hondori, Alison McKenzie, Lucy Dodakian, Cristina Videira Lopes, and Steven C Cramer. 2014. Free-hand interaction with leap motion controller for stroke rehabilitation. In Oriceedings of the CHI'14 Extended Abstracts on Human Factors in Computing Systems. ACM, 1663--1668.
5. Alexandros Lioulemes. 2016. Adaptive User and Haptic Interfaces for Smart Assessment and Training. In Companion Publication of the 21st International Conference on Intelligent User Interfaces. ACM, 130--133.

Index Terms

• Computer systems organization

  • Embedded and cyber-physical systems

  • Real-time systems

• Computing methodologies

  • Machine learning