skip to main content
research-article

The Effects of Predictive Features of Mobile Keyboards on Text Entry Speed and Errors

Published:04 November 2020Publication History
Skip Abstract Section

Abstract

Mobile users rely on typing assistant mechanisms such as prediction and autocorrect. Previous studies on mobile keyboards showed decreased performance for heavy use of word prediction, which identifies a need for more research to better understand the effectiveness of predictive features for different users. Our work aims at such a better understanding of user interaction with autocorrections and the prediction panel while entering text, in particular when these approaches fail. We present a crowd-sourced mobile text entry study with 170 participants. Our mobile web application simulates autocorrection and word prediction to capture user behaviours around these features. We found that using word prediction saves an average of 3.43 characters per phrase but also adds an average of two seconds compared to actually typing the word, resulting in a negative effect on text entry speed. We also identified that the time to fix wrong autocorrections is on average 5.5 seconds but that autocorrection does not have a significant effect on typing speed.

References

  1. Ohoud Alharbi, Ahmed Sabbir Arif, Wolfgang Stuerzlinger, Mark D. Dunlop, and Andreas Komninos. 2019. WiseType: A tablet keyboard with color-coded visualization and various editing options for error correction. In Proceedings - Graphics Interface. https://doi.org/10.20380/GI2019.04Google ScholarGoogle Scholar
  2. Jessalyn Alvina, Joseph Malloch, and Wendy E. Mackay. 2016. Expressive keyboards: Enriching gesture-typing on mobile devices. In UIST 2016 - Proceedings of the 29th Annual Symposium on User Interface Software and Technology. https://doi.org/10.1145/2984511.2984560Google ScholarGoogle Scholar
  3. Denis Anson, Penni Moist, Mary Przywara, Heather Wells, Heather Saylor, and Hantz Maxime. 2006. The effects of word completion and word prediction on typing rates using on-screen keyboards. Assistive Technology (2006). https://doi.org/10.1080/10400435.2006.10131913Google ScholarGoogle Scholar
  4. Ahmed Sabbir Arif, Sunjun Kim, Wolfgang Stuerzlinger, Geehyuk Lee, and Ali Mazalek. 2016. Evaluation of a smartrestorable backspace technique to facilitate text entry error correction. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (2016) (2016), 5151--5162. https://doi.org/10.1145/2858036.2858407Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2009. Analysis of text entry performance metrics. In Proceedings of the IEEE Toronto International Conference - Science and Technology for Humanity - TIC-STH '09. IEEE, 100--105. https://doi.org/10.1109/TIC-STH.2009.5444533Google ScholarGoogle ScholarCross RefCross Ref
  6. Ahmed Sabbir Arif and Wolfgang Stuerzlinger. 2010. Predicting the cost of error correction in character-based text entry technologies. In Proceedings of the 28th international conference on Human factors in computing systems - CHI '10. https://doi.org/10.1145/1753326.1753329Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Kenneth C. Arnold, Krzysztof Z. Gajos, and Adam T. Kalai. 2016. On Suggesting Phrases vs. Predicting Words for Mobile Text Composition. Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16 (2016), 603--608. https://doi.org/10.1145/2984511.2984584Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Xiaojun Bi and Shumin Zhai. 2016. IJQwerty: What Difference Does One Key Change Make? Gesture Typing Keyboard Optimization Bounded by One Key Position Change from Qwerty. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 (2016). https://doi.org/10.1145/2858036.2858421Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Daniel Buschek, Benjamin Bisinger, and Florian Alt. 2018. ResearchIME: A Mobile Keyboard Application for Studying Free Typing Behaviour in the Wild. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018). https://doi.org/10.1145/3173574.3173829Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Daniel Buschek, Julia Kinshofer, and Florian Alt. 2018. A Comparative Evaluation of Spatial Targeting Behaviour Patterns for Finger and Stylus Tapping on Mobile Touchscreen Devices. Proceedings of the ACM on Interactive, Mobile, Wearable and Ubiquitous Technologies (2018). https://doi.org/10.1145/3161160Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Tanzeem Choudhury, Gaetano Borriello, Sunny Consolvo, Dirk Haehnel, Beverly Harrison, Bruce Hemingway, Jeffrey Hightower, Predrag "Pedja" Klasnja, Karl Koscher, Anthony LaMarca, James A. Landay, Louis LeGrand, Jonathan Lester, Ali Rahimi, Adam Rea, and Danny Wyatt. 2008. The Mobile Sensing Platform: An Embedded Activity Recognition System. IEEE Pervasive Computing (2008). https://doi.org/10.1109/MPRV.2008.39Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Vivek Dhakal, Anna Maria Feit, Per Ola Kristensson, and Antti Oulasvirta. 2018. Observations on typing from 136 million keystrokes. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018). https://doi.org/10.1145/3173574.3174220Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Mark D. Dunlop and Andrew Crossan. 2000. Predictive text entry methods for mobile phones. Personal Technologies (2000), 134--143. https://doi.org/10.1007/BF01324120Google ScholarGoogle Scholar
  14. Abigail Evans and Jacob O. Wobbrock. 2012. Taming Wild Behavior: The Input Observer for Obtaining Text Entry and Mouse Pointing Measures from Everyday Computer Use. In Proceedings of the 2012 CHI Conference on Human Factors in Computing Systems - CHI '12 (2012). https://doi.org/10.1145/2207676.2208338Google ScholarGoogle Scholar
  15. Andrew Fowler, Kurt Partridge, Ciprian Chelba, Xiaojun Bi, Tom Ouyang, and Shumin Zhai. 2015. Effects of Language Modeling and its Personalization on Touchscreen Typing Performance. Proceedings of the ACM CHI'15 Conference on Human Factors in Computing Systems 1 (2015), 649--658. https://doi.org/10.1145/2702123.2702503Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jon Froehlich, Mike Y Chen, Sunny Consolvo, Beverly Harrison, and James A Landay. 2007. MyExperience: a system for in situ tracing and capturing of user feedback on mobile phones. In The 5th International Conference on Mobile Systems, Applications, and Services. https://doi.org/10.1145/1247660.1247670Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Mayank Goel, Leah Findlater, and Jacob O. Wobbrock. 2012. WalkType: Using Accelerometer Data to Accomodate Situational Impairments in Mobile Touch Screen Text Entry. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. https://doi.org/10.1145/2207676.2208662Google ScholarGoogle Scholar
  18. Niels Henze, Enrico Rukzio, and Susanne Boll. 2012. Observational and experimental investigation of typing behaviour using virtual keyboards on mobile devices. In InProceedings of the 2012 CHI Conference on Human Factors in Computing Systems - CHI '12 (2012). https://doi.org/10.1145/2207676.2208658Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Cl James and Km Reischel. 2001. Text input for mobile devices: comparing model prediction to actual performance. Proceedings of the 2001 CHI Conference on Human Factors in Computing Systems - CHI '01 (2001) (2001), 365--371. https://doi.org/10.1145/365024.365300Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Anthony Jameson. 2007. Adaptive Interfaces and Agents. In The human-computer interaction handbook 2007. CRC Press, 459--484.Google ScholarGoogle ScholarCross RefCross Ref
  21. Anthony Jameson and Per Ola Kristensson. 2017. Understanding and supporting modality choices. In The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations - Volume 1. ACM, 201--238. https://doi.org/10.1145/3015783.3015790Google ScholarGoogle Scholar
  22. Alex Jansen, Findlater Leah, and Jacob O. Wobbrock. 2011. From the lab to the world: Lessons from extending a pointing technique for real-world use. In CHI'11 Extended Abstracts on Human Factors in Computing Systems (2011).Google ScholarGoogle Scholar
  23. Shaoxiong Ji, Shirui Pan, Guodong Long, Xue Li, Jing Jiang, and Zi Huang. 2019. Learning Private Neural Language Modeling with Attentive Aggregation. In Proceedings of the International Joint Conference on Neural Networks. https: //doi.org/10.1109/IJCNN.2019.8852464Google ScholarGoogle ScholarCross RefCross Ref
  24. Jussi P.P. Jokinen, Sayan Sarcar, Antti Oulasvirta, Chaklam Silpasuwanchai, Zhenxin Wang, and Xiangshi Ren. 2017. Modelling learning of new keyboard layouts. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems - CHI '16 (2017). https://doi.org/10.1145/3025453.3025580Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Heidi Horstmann Koester and Simon P. Levine. 1994. Modeling the Speed of Text Entry with a Word Prediction Interface. IEEE Transactions on Rehabilitation Engineering 2, 3 (1994), 177--187. https://doi.org/10.1109/86.331567Google ScholarGoogle ScholarCross RefCross Ref
  26. Heidi Horstmann Koester and Simon P. Levine. 1996. Effect of a word prediction feature on user performance. AAC: Augmentative and Alternative Communication (1996). https://doi.org/10.1080/07434619612331277608Google ScholarGoogle Scholar
  27. Per Ola Kristensson and Keith Vertanen. 2012. Performance comparisons of phrase sets and presentation styles for text entry evaluations. In International Conference on Intelligent User Interfaces, Proceedings IUI. https://doi.org/10. 1145/2166966.2166972Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Vladimir I. Levenshtein. 1966. Binary codes capable of correcting deletions, insertions, and reversals. Soviet Physics Doklady 10, 8 (1966), 707--710.Google ScholarGoogle Scholar
  29. Ying Liu, Kai Ding, and Ning Liu. 2009. Immediate user performances with touch Chinese text entry solutions on handheld devices. In ACM International Conference Proceeding Series.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Ying Liu and Kari Jouko Räihä. 2010. Predicting Chinese text entry speeds on mobile phones. In Conference on Human Factors in Computing Systems - Proceedings. https://doi.org/10.1145/1753326.1753657Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. I. Scott MacKenzie and R. William Soukoreff. 2002. Text entry for mobile computing: Models and methods, theory and practice. Human-Computer Interaction (2002). https://doi.org/10.1207/S15327051HCI172Google ScholarGoogle Scholar
  32. I. Scott MacKenzie and Shawn X. Zhang. 1999. The design and evaluation of a high-performance soft keyboard. In Proceedings of the SIGCHI conference on Human factors in computing systems the CHI is the limit - CHI '99. ACM Press, New York, 25--31. https://doi.org/10.1145/302979.302983Google ScholarGoogle Scholar
  33. Mishaal Rahman. 2020. Android Version Distribution statistics will now only be available in Android Studio. https: //www.xda-developers.com/android-version-distribution-statistics-android-studio/Google ScholarGoogle Scholar
  34. Emma Nicol, Andreas Komninos, and Mark D Dunlop. 2016. A Participatory Design and Formal Study Investigation into Mobile Text Entry for Older Adults. International Journal of Mobile Human Computer Interaction 8, 2 (2016), 20--46. https://doi.org/10.4018/IJMHCI.2016040102.oaGoogle ScholarGoogle ScholarDigital LibraryDigital Library
  35. Jianwei Niu, Yang Liu, Jialiu Lin, Like Zhu, and Kongqiao Wang. 2014. Stroke++: A new Chinese input method for touch screen mobile phones. International Journal of Human Computer Studies (2014). https://doi.org/10.1016/j.ijhcs. 2014.01.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Sharon Oviatt, Bjorn Schuller, Philip R. Cohen, Daniel Sonntag, Gerasimos Potamianos, and Antonio Kruger. 2017. The Handbook of Multimodal-Multisensor Interfaces: Foundations, User Modeling, and Common Modality Combinations - Volume 1. 633 pages. https://doi.org/10.1145/3015783Google ScholarGoogle Scholar
  37. Kseniia Palin, Anna Maria Feit, Sunjun Kim, Per Ola Kristensson, and Antti Oulasvirta. 2019. How do people type on mobile devices? Observations from a study with 37,000 volunteers. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services, MobileHCI 2019. https://doi.org/10.1145/3338286.3340120Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Felix Putze, Tilman Ihrig, Tanja Schultz, and Wolfgang Stuerzlinger. 2020. Platform for Studying Self-Repairing Auto- Corrections in Mobile Text Entry based on Brain Activity, Gaze, and Context. https://doi.org/10.1145/3313831.3376815Google ScholarGoogle Scholar
  39. Felix Putze, Maik Schünemann, Tanja Schultz, and Wolfgang Stuerzlinger. 2017. Automatic classification of autocorrection errors in predictive text entry based on EEG and context information. In ICMI 2017 - Proceedings of the 19th ACM International Conference on Multimodal Interaction. https://doi.org/10.1145/3136755.3136784Google ScholarGoogle Scholar
  40. Philip Quinn and Andy Cockburn. 2018. Loss Aversion and Preferences in Interaction. Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18 (2018). https://doi.org/10.1080/07370024.2018.1433040Google ScholarGoogle Scholar
  41. Philip Quinn and Shumin Zhai. 2016. A Cost-Benefit Study of Text Entry Suggestion Interaction. Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems - CHI '16 (2016), 83--88. https://doi.org/10.1145/2858036.2858305Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Shyam Reyal, Shumin Zhai, and Per Ola Kristensson. 2015. Performance and User Experience of Touchscreen and Gesture Keyboards in a Lab Setting and in the Wild. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15 (2015), 679--688. https://doi.org/10.1145/2702123.2702597Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Yvonne Rogers. 2011. Interaction design gone wild: striving for wild theory. interactions (2011). https://doi.org/10. 1145/1978822.1978834Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Richard Schlögl and Thomas Grechenig. 2019. Hyper Typer : A Serious Game for Measuring Mobile Text Entry Performance in the Wild menu. (2019), 1--6.Google ScholarGoogle Scholar
  45. Klaus U. Schulz and Stoyan Mihov. 2003. Fast string correction with Levenshtein automata. International Journal on Document Analysis and Recognition (2003). https://doi.org/10.1007/s10032-002-0082--8Google ScholarGoogle Scholar
  46. Luo Si and Jamie Callan. 2001. A statistical model for scientific readability. https://doi.org/10.1145/502585.502695Google ScholarGoogle Scholar
  47. Shyamli Sindhwani, Christof Lutteroth, and Gerald Weber. 2019. ReType: Quick Text Editing with Keyboard and Gaze. Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19 (2019), 1--13. https: //doi.org/10.1145/3290605.3300433Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. R. William Soukoreff and I. Scott MacKenzie. 2003. Metrics for text entry research: an evaluation of MSD and KSPC, and a new unified error metric. In Proceedings of the conference on Human factors in computing systems - CHI '03, Fabio Paternò (Ed.). ACM Press, New York, 113--120. https://doi.org/10.1145/642611.642632Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Kumiko Tanaka-Ishii, Jin Dong Kim, and Ming Zhou. 2007. Text Entry in East Asian Languages. In Text Entry Systems. https://doi.org/10.1016/B978-012373591--1/50011--5Google ScholarGoogle Scholar
  50. Pin Shen Teh, Andrew Beng Jin Teoh, and Shigang Yue. 2013. A Survey of Keystroke Dynamics Biometrics. The Scientific World Journal (2013). https://doi.org/10.1155/2013/408280Google ScholarGoogle Scholar
  51. Keith Trnka, John Mccaw, Debra Yarrington, Kathleen F. Mccoy, and Christopher Pennington. 2009. User interaction with word prediction:The effects of prediction quality. ACM Transactions on Accessible Computing (2009). https: //doi.org/10.1145/1497302.1497307Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Keith Vertanen, Justin Emge, Haythem Memmi, and Per Ola Kristensson. 2014. Text blaster. In CHI'14 Extended Abstracts on Human Factors in Computing Systems. https://doi.org/10.1145/2559206.2574802Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Keith Vertanen and Per Ola Kristensson. 2011. A versatile dataset for text entry evaluations based on genuine mobile emails. In Proceedings of the 13th International Conference on Human Computer Interaction with Mobile Devices and Services - MobileHCI '11. ACM Press, New York, 295. https://doi.org/10.1145/2037373.2037418Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Keith Vertanen and Per Ola Kristensson. 2014. Complementing text entry evaluations with a composition task. ACM Transactions on Computer-Human Interaction 21, 2 (2014), 1--33. https://doi.org/10.1145/2555691Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Keith Vertanen, Haythem Memmi, Justin Emge, Shyam Reyal, and Per Ola Kristensson. 2015. VelociTap: Investigating Fast Mobile Text Entry using Sentence-Based Decoding of Touchscreen Keyboard Input. Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems - CHI '15 (2015), 659--668. https://doi.org/10.1145/2702123. 2702135Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Daryl Weir, Henning Pohl, Simon Rogers, Keith Vertanen, and Per Ola Kristensson. 2014. Uncertain text entry on mobile devices. In Proceedings of the 2014 CHI Conference on Human Factors in Computing Systems - CHI '14 (2014). https://doi.org/10.1145/2556288.2557412Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Jacob O. Wobbrock. 2007. Measures of Text Entry Performance. In Text Entry Systems. https://doi.org/10.1016/ B978-012373591--1/50003--6Google ScholarGoogle Scholar
  58. Xing Wu, Zhaowang Liang, and Jianjia Wang. 2020. Fedmed: A federated learning framework for language modeling. Sensors (2020). https://doi.org/10.3390/s20144048Google ScholarGoogle Scholar
  59. Xin Yi, Chun Yu, Weijie Xu, Xiaojun Bi, and Yuanchun Shi. 2015. ATK: Enabling Ten-Finger Freehand Typing in Air Based on 3D Hand Tracking Data. Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology - UIST '15 (2015). https://doi.org/10.1145/2807442.2807510Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Mingrui Zhang, He Wen, and Jacob O. Wobbrock. 2019. Type, then correct: Intelligent text correction techniques for mobile text entry using neural networks. In UIST 2019 - Proceedings of the 32nd Annual ACM Symposium on User Interface Software and Technology. https://doi.org/10.1145/3332165.3347924Google ScholarGoogle Scholar
  61. Mingrui Zhang, Shumin Zhai, and Jacob O. Wobbroc. 2019. Text Entry Throughput. 2019 CHI Conference on Human Factors in Computing Systems Proceedings (CHI 2019), (2019), 1--13.Google ScholarGoogle Scholar

Index Terms

  1. The Effects of Predictive Features of Mobile Keyboards on Text Entry Speed and Errors

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!