Xiaojun Bi
Ciprian Chelba
Shumin Zhai
ABSTRACT
Gesture keyboards represent an increasingly popular way to input text on mobile devices today. However, current gesture keyboards are exclusively unimanual. To take advantage of the capability of modern multi-touch screens, we created a novel bimanual gesture text entry system, extending the gesture keyboard paradigm from one finger to multiple fingers. To address the complexity of recognizing bimanual gesture, we designed and implemented two related interaction methods, finger-release and space-required, both based on a new multi-stroke gesture recognition algorithm. A formal experiment showed that bimanual gesture behaviors were easy to learn. They improved comfort and reduced the physical demand relative to unimanual gestures on tablets. The results indicated that these new gesture keyboards were valuable complements to unimanual gesture and regular typing keyboards.
Supplemental Material
- Anthony, L. and Wobbrock, J.O. (2010). A lightweight multistroke recognizer for user interface prototypes. Graphics Interface 245--252. Google Scholar
Digital Library
- Balakrishnan, R., and Hinckley, K. (2000). Symmetric bimanual interaction. ACM CHI. 33--40 Google ScholarDigital Library
- Balakrishnan, R., and Kurtenbach, G. (1999). Exploring bimanual camera control and object manipulation in 3D graphics interfaces. ACM CHI. 56--6 Google ScholarDigital Library
- Bier, E. A., Stone, M., Pier, K., Buxton, W. & DeRose. T. (1993). Toolglass and magic lenses: the see-throughGoogle Scholar
- interface. SIGGRAPH, 73--80.Google Scholar
- Bi, X., Smith, B., and Zhai, S. (2010). Quasi-qwerty soft keyboard optimization. ACM CHI. 283--28 Google ScholarDigital Library
- Bi, X., Smith, B., and Zhai, S. (2012) Multilingual Touchscreen Keyboard Design and Optimization, Hu-man Computer Interaction, to appear. Available online.Google Scholar
- Buxton, W., and Myers, B. (1986). A study in two-handed input. ACM CHI, 321--326. Google ScholarDigital Library
- Findlater, L., Wobbrock, O., Wigdor, D. (2011). Typing on flat glass: examining ten-finger expert typing pat-terns on touch surfaces. ACM CHI 2453--2462. Google ScholarDigital Library
- Guiard, Y. (1987). Asymmetric division of labor in hu-man skilled bimanual action: The kinematic chain as a model. Journal of Motor Behavior, 19(4), pp. 486--517.Google ScholarCross Ref
- Hart, S. and Staveland, L. 1988. Development of NASA-TLX (Task Load Index): Results of empirical and theoretical research. In Human Mental Workload P. A. Hancock and N. Meshkati, Eds., North-Holland: Elsevier Science, 139--183.Google Scholar
- 1Kane, S.K., Wobbrock, J.O. and Ladner, R.E. (2011) Usable gestures for blind people: Understanding prefer-ence and performance. ACM CHI. 413 422 Google ScholarDigital Library
- Kristensson, P.O,. Zhai, S. (2007) Command Strokes with and without Preview: Using Pen Gestures on Key-board for Command Selection, ACM CHI. 1137 1146 Google ScholarDigital Library
- Kristensson, P-O., Zhai, S., S (2004) SHARK2: A Large Vocabulary Shorthand Writing System for Pen-based Computers, ACM UIST, 43--52. Google ScholarDigital Library
- Kristensson, P-O., Zhai, S. (2005) Relaxing Stylus Typ-ing Precision by Geometric Pattern Matching. ACM IUI 151--158. Google ScholarDigital Library
- Li, F.C.Y, Guy, R.T., Yatani, K., Truong, K.N. (2011). The 1line keyboard: a QWERTY layout in a single line. ACM UIST, 461--470. Google ScholarDigital Library
- Li, Y. (2010). Protractor: A Fast and Accurate Gesture Recognizer, ACM CHI, 2169 2172 Google ScholarDigital Library
- Li, Y. (2010). Gesture Search: A Tool for Fast Mobile Data Access ACM UIST, 87 96 Google ScholarDigital Library
- MacKenzie, I.S., Soukoreff, R. W. (2003). Phrase sets for evaluating text entry techniques. Extended Abstracts CHI, 754--755. Google ScholarDigital Library
- Ouyang, T., and Davis, R. (2009). A Visual Approach to Sketched Symbol Recognition, IJCAI, 1463 1468 Google ScholarDigital Library
- Ouyang, T., and Li, Y. (2012), Bootstrapping Personal Gesture Shortcuts with the Wisdom of the Crowd and Handwriting Recognition, ACM CHI, to appear. Google ScholarDigital Library
- 2Rick, J. (2010). Performance optimizations of virtual keyboards for stroke-based text entry on a touch-based tabletop. ACM UIST, 77--86. Google ScholarDigital Library
- 2Soukoreff, R.W., MacKenzie, I.S. (2003) Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. ACM CHI, 113--120. Google ScholarDigital Library
- Wobbrock, J.O. (2007) Measures of text entry perfor-mance. In Text Entry Systems: Mobility, Accessibility, Universality, I. S. MacKenzie and K. Tanaka-Ishii (eds.) San Francisco: Morgan Kaufmann, 47--74Google Scholar
- Wobbrock, J.O., Wilson, A.D. and Li, Y. (2007). Gestures without libraries, toolkits or training: A $1 recognizer for user interface prototypes. ACM UIST 159--168. Google ScholarDigital Library
- www.americannationalcorpus.org/Google Scholar
- Zhai, S. Kristensson, P.O. Introduction to Shape Writ-ing, IBM Research Report RJ10393 (A0611-006), No-vember1, 2006Google Scholar
- Zhai, S., Kristensson, P-O., (2003) Shorthand Writing on Stylus Keyboard, ACM CHI. 97--104. Google ScholarDigital Library
- Zhai, S., Kristensson, P.O., Gong, P., Greiner, M., Peng, S., Liu, L. Dunnigan, A., (2009) Shapewriter on the iPhone: from the laboratory to theGoogle Scholar
Index Terms
Bimanual gesture keyboard
Recommendations
Arranging touch screen software keyboard split-keys based on contact surface
CHI EA '10: CHI '10 Extended Abstracts on Human Factors in Computing SystemsTouch screen devices, which have become ubiquitous in our daily lives, offer users flexible input and output operations. Typical operation methods for touch screen devices include the use of a stylus or a finger. A touch screen user can select a stylus ...
Investigating Tilt-based Gesture Keyboard Entry for Single-Handed Text Entry on Large Devices
CHI '17: Proceedings of the 2017 CHI Conference on Human Factors in Computing SystemsThe popularity of mobile devices with large screens is making single-handed interaction difficult. We propose and evaluate a novel design point around a tilt-based text entry technique which supports single handed usage. Our technique is based on the ...
ContextType: using hand posture information to improve mobile touch screen text entry
CHI '13: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe challenge of mobile text entry is exacerbated as mobile devices are used in a number of situations and with a number of hand postures. We introduce ContextType, an adaptive text entry system that leverages information about a user's hand posture (...
Comments