Touch behavior with different postures on soft smartphone keyboards

ABSTRACT

Text entry on smartphones is far slower and more error-prone than on traditional desktop keyboards, despite sophisticated detection and auto-correct algorithms. To strengthen the empirical and modeling foundation of smartphone text input improvements, we explore touch behavior on soft QWERTY keyboards when used with two thumbs, an index finger, and one thumb. We collected text entry data from 32 participants in a lab study and describe touch accuracy and precision for different keys. We found that distinct patterns exist for input among the three hand postures, suggesting that keyboards should adapt to different postures. We also discovered that participants' touch precision was relatively high given typical key dimensions, but there were pronounced and consistent touch offsets that can be leveraged by keyboard algorithms to correct errors. We identify patterns in our empirical findings and discuss implications for design and improvements of soft keyboards.

References

1. Bao, P., Pierce, P., Whittaker, S., and Zhai, S. (2011). Smart phone use by non-mobile business users. Proc. MobileHCI '11, 445--454.
2. Clarkson, E., Lyons, K., Clawson, J., and Starner, T. (2007). Revisiting and validating a model of two-thumb text entry. Proc. CHI '07, 163--166.
3. Clawson, J., Lyons, K., Rudnick, A., Iannucci, Jr., R., and Starner, T. (2008). Automatic whiteout++: correcting mini-QWERTY typing errors using keypress timing. Proc. CHI '08, 573--582.
4. Findlater, L., Wobbrock, J. O., and Wigdor, D. (2011). Typing on flat glass: examining ten-finger expert typing patterns on touch surfaces. Proc. CHI '11, 2453--2462.
5. Gong, J., Tarasewich, P., and MacKenzie, I. S. (2008). Improved word list ordering for text entry on ambiguous keypads. Proc. NordiCHI '08, 152--161.
6. Goodman, J., Venolia, G., Steury, K., Parker, C. 2002. Language modeling for soft keyboards. Proc. IUI '02, 194--195.
7. Gunawardana, A., Paek, T., and Meek, C. (2010). Usability guided key-target resizing for soft keyboards. Proc. IUI '10, 111--118.
8. Henze, N., Rukzio, E., and Boll, S. (2011). 100,000,000 taps: analysis and improvement of touch performance in the large. Proc. MobileHCI '11, 133--142.
9. Himberg, J., Häkkilä, J., Kangas, P., and Mäntyjärvi, J. (2003). On-line personalization of a touch screen based keyboard. Proc. IUI '03, 77--84.
10. Hoggan, E., Brewster, S., & Johnston, J. (2008). Investigating the effectiveness of tactile feedback for mobile touchscreens. Proc. of CHI '08, 1573--1582.
11. Holz, C. and Baudisch, P. (2010). The Generalized Per-ceived Input Point Model and How to Double Touch Accuracy by Extracting Fingerprints. Proc. CHI '10, 581--590.
12. Holz, C. and Baudisch, P. (2011). Understanding Touch. Proc. CHI '11, 2501--2510.
13. Kristensson, P.-O., Zhai, S. (2005). Relaxing Stylus Typing Precision by Geometric Pattern Matching. Proc. IUI '05, 151--158.
14. Kristensson, P. O. and Zhai, S. (2004). SHARK2: A Large Vocabulary Shorthand Writing System for Pen-based Computers. Proc. UIST '04, 43--52.
15. Kristensson, P. O., and Vertanen, K. (2012). Performance comparisons of phrase sets and presentation styles for text entry evaluations. Proc. IUI '12, 29--32.
16. Lee, S., Zhai, S. (2009). The performance of touch screen soft buttons. Proc. CHI '09, 309--318.
17. MacKenzie, I. S. and Soukoreff, R. W. (2003). Phrase Sets for Evaluating Text Entry Techniques. Proc. EACHI '03. 754--755
18. MacKenzie, I. S. and Soukoreff, R. W. (2002). A Model of Two-Thumb Text Entry. Proc. GI '02, 117--124.
19. MacKenzie, I. S., Zhang, S. X. (1999) The design and evaluation of a high-performance soft keyboard. Proc. CHI '99, 25--31.
20. Paek, T., and Hsu, B.-J. P. (2011). Sampling representative phrase sets for text entry experiments: a procedure and public resource. Proc. CHI '11, 2477--2480.
21. Rudchenko, D., Paek, T., and Badger, E. (2011). Text Text Revolution: A game that improves text entry on mobile touchscreen keyboards. Proc. Pervasive '11, 206--213.
22. Kumiko Tanaka-ishii. (2007). Word-based predictive text entry using adaptive language models. Nat. Lang. Eng. 13, 1 51--74.
23. Wang, F. and Ren, X. (2009). Empirical evaluation for finger input properties in multi-touch interaction. Proc. CHI '09, 1063--1072.
24. Wobbrock, J. O., and Myers, B. A. (2006). Analyzing the input stream for character-level errors in unconstrained text entry evaluations. ACM TOCHI 13 (4), pp. 458--489.
25. Wobbrock, J. O., Myers, B. A., and Aung, H. H. (2008) The performance of hand postures in front- and back-of-device interaction for mobile computing. Int. J. Hum.-Comput. Stud. 66, 12, 857--875.
26. Yamada, H. (1980). A historical study of typewriters and typing methods: from the position of planning Japanese parallels. Journal of Information Processing, 1980. 2(4): 175--20.
27. Zhai, S. and Kristensson, P.-O. (2003). Shorthand Writing on Stylus Keyboard. Proc. CHI '03, 97--104.
28. Zhai, S. and Kristensson, P. O. (2006). Introduction to Shape Writing. IBM Research Report RJ10393 (also as Chapter 7 of I. S. MacKenzie and K. Tanaka-Ishii (eds), Text Entry Systems: Mobility, Accessibility, Universality, Morgan Kaufmann Publishers, 139--158.

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)