Motor-impaired touchscreen interactions in the wild

ABSTRACT

Touchscreens are pervasive in mainstream technologies; they offer novel user interfaces and exciting gestural interactions. However, to interpret and distinguish between the vast ranges of gestural inputs, the devices require users to consistently perform interactions inline with the predefined location, movement and timing parameters of the gesture recognizers. For people with variable motor abilities, particularly hand tremors, performing these input gestures can be extremely challenging and impose limitations on the possible interactions the user can make with the device. In this paper, we examine touchscreen performance and interaction behaviors of motor-impaired users on mobile devices. The primary goal of this work is to measure and understand the variance of touchscreen interaction performances by people with motor-impairments. We conducted a four-week in-the-wild user study with nine participants using a mobile touchscreen device. A Sudoku stimulus application measured their interaction performance abilities during this time. Our results show that not only does interaction performance vary significantly between users, but also that an individual's interaction abilities are significantly different between device sessions. Finally, we propose and evaluate the effect of novel tap gesture recognizers to accommodate for individual variances in touchscreen interactions.

References

1. Buschek, D., Rogers, S. and Murray-Smith, R. 2013. User-specific touch models in a cross-device context. In Proceedings of the 15th international conference on Human-computer interaction with mobile devices and services (MobileHCI '13). ACM, New York, NY, USA, 382--391
2. Chapuis, O., Blanch, R. and Beaudouin-Lafon, M. (2007). Fitts' law in the wild: A field study of aimed movements. LRI Technical Repport Number 1480 (December 2007). Orsay, France: Universite de Paris Sud.
3. Guerreiro, T., Nicolau, H., Jorge, J. and Gonçalves, D. 2010. Towards accessible touch interfaces. In Proceedings of the 12th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '10). ACM, New York, NY, USA, 19--26.
4. Henze, N., Rukzio, E. and Boll, S. 2012. Observational and experimental investigation of typing behaviour using virtual keyboards for mobile devices. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '12). ACM, New York, NY, USA, 2659--2668.
5. Holz, C. and Baudisch, P. 2011. Understanding touch. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). ACM, New York, NY, USA, 2501--2510.
6. Hurst, A., Mankoff, J. and Hudson, S.E. 2008. Understanding pointing problems in real world computing environments. In Proceedings of the 10th international ACM SIGACCESS conference on Computers and accessibility (Assets '08). ACM, New York, NY, USA, 43--50.
7. Hurst, A., Trewin, S., Hudson, S.E. and Mankoff, J. 2008. Automatically detecting pointing performance. In Proceedings of the 13th international conference on Intelligent user interfaces (IUI '08). ACM, New York, NY, USA, 11--19.
8. Koester, H.H., LoPresti, E. and Simpson, R.C. 2005. Toward Goldilocks' pointing device: determining a "just right" gain setting for users with physical impairments. In Proceedings of the 7th international ACM SIGACCESS conference on Computers and accessibility (Assets '05). ACM, New York, NY, USA, 84--89.
9. Montague, K., Hanson, V.L. and Cobley, A. 2012. Designing for individuals: usable touch-screen interaction through shared user models. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '12). ACM, New York, NY, USA, 151--158.
10. Nicolau, H. and Jorge, J. 2012. Elderly text-entry performance on touchscreens. In Proceedings of the 14th international ACM SIGACCESS conference on Computers and accessibility (ASSETS '12). ACM, New York, NY, USA, 127--134.
11. Trewin, S. 2003. Automating accessibility: the dynamic keyboard. In Proceedings of the 6th international ACM SIGACCESS conference on Computers and accessibility (Assets '04). ACM, New York, NY, USA, 71--78.
12. Trewin, S., Keates, S. and Moffatt, K. 2006. Developing steady clicks:: a method of cursor assistance for people with motor impairments. In Proceedings of the 8th international ACM SIGACCESS conference on Computers and accessibility (Assets '06). ACM, New York, NY, USA, 26--33.
13. Trewin, S., Swart, C. and Pettick, D. 2013. Physical accessibility of touchscreen smartphones. the 15th International ACM SIGACCESS Conference. (Oct. 2013), 19--8.
14. Wacharamanotham, C., Hurtmanns, J., Mertens, A., Kronenbuerger, M., Schlick, C. and Borchers, J. 2011. Evaluating swabbing: a touchscreen input method for elderly users with tremor. (New York, NY, USA, May 2011), 623.
15. Weir, D., Rogers, S., Murray-Smith, R. and Löchtefeld, M. 2012. A user-specific machine learning approach for improving touch accuracy on mobile devices. In Proceedings of the 25th annual ACM symposium on User interface software and technology (UIST '12). ACM, New York, NY, USA, 465--476.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

• Social and professional topics

  • Professional topics

    • Computing profession

      • Assistive technologies

  • User characteristics

    • People with disabilities