Adaptive User and Haptic Interfaces for Smart Assessment and Training

ABSTRACT

My research is focusing on developing smart robotic rehabilitation interfaces that use machine intelligence to adjust the level of difficulty, assess physical and mental obstacles on the part of the user, and provide analysis of the multi-sensing data collected in real time as the user exercises. The main goal of the interfaces is to engage the patient in repetitive exercise sessions and to provide better data visualization to the therapist for the patient's recovery progress. In this doctoral consortium, I will present three prototype user interfaces that can be applied in assistive environments and enhance the productivity and interaction among therapist and patient. The data processing and the decision making algorithms compose the core components of this study.

References

1. Li, C., Rusák, Z., Horváth, I., Ji, L., & Hou, Y. (2014, May). "Current status of robotic stroke rehabilitation and opportunities for a cyber-physically assisted upper limb stroke rehabilitation". TMCE 2014, Budapest, Hungary, May 19-23.
2. Srujana, G., Lioulemes, A., Gieser, S., Sassaman, P., Athitsos, V., & Makedon, F (2016), "MAGNI: A Real-time Robot-assisted Game-based Tele-Rehabilitation System". In Universal Access in Human-Computer Interaction. Manuscript has been accepted for publication.
3. Kruskall, J., & Liberman, M., 1983, "The symmetric time warping algorithm: From continuous to discrete. Time Warps". String Edits and Macromolecules.
4. Bellotti, F., Kapralos, B., Lee, K., Moreno-Ger, P., & Berta, R., "Assessment in and of Serious Games: An Overview," Advances in Human-Computer Interaction, vol. 2013, Article ID 136864, 11 pages, 2013.
5. Stroop, J. R. (1935). "Studies of interference in serial verbal reactions". Journal of Experimental Psychology, 18(6), 643--662.
6. Tulsky, D. S., Carlozzi, N., Chiaravalloti, N. D., Beaumont, J. L., Kisala, P. A., Mungas, D., & Gershon, R. (2014). "NIH Toolbox Cognition Battery (NIHTB-CB): List Sorting Test to Measure Working Memory". Journal of the International Neuropsychological Society, 20(06), 599--610.
7. McMurrough, C. D., Lioulemes, A., Phan, S., & Makedon, F. (2015, July). "3D mapping of visual attention for smart rehabilitation". In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (p. 95). ACM.
8. P.I. Corke, "Robotics, Vision & Control", Springer 2011, ISBN 978-3-642-20143-1.
9. Abujelala, M., Lioulemes, A., Sassaman, P., & Makedon, F. (2015, July). "Robot-aided rehabilitation using force analysis". In Proceedings of the 8th ACM International Conference on PErvasive Technologies Related to Assistive Environments (p. 97). ACM.
10. Phan, S., Lioulemes, A., Lutterodt, C., Makedon, F., & Metsis, V., "Guided physical therapy through the use of the Barrett WAM robotic arm", in Haptic, Audio and Visual Environments and Games (HAVE), 2014 IEEE International Symposium, pp.24--28, 10-11 Oct. 2014
11. Lioulemes, A., Sassaman, P., Gieser, S. N., Karkaletsis, V., Makedon, F., & Metsis, V., "Self-managed patient-game interaction using the barrett WAM arm for motion analysis". PETRA (p. 34). ACM.
12. Cheeba, B., Ebert, D., Lioulemes, A., Abujelala, M., Becker, Eric., Makedon., F., (ASEE 2016). Serious Gaming for Cognitive and Physiological Assessment. Figure 5: Fuzzy logic control for force regulator strategy Figure 4: Dynamic modeling of user's behavior

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision tasks

        • Scene understanding

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information systems applications

    • Multimedia information systems