skip to main content
research-article

Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues

Authors Info & Claims
Published:29 May 2021Publication History
Skip Abstract Section

Abstract

The continued advancement in user interfaces comes to the era of virtual reality that requires a better understanding of how users will interact with 3D buttons in mid-air. Although virtual reality owns high levels of expressiveness and demonstrates the ability to simulate the daily objects in the physical environment, the most fundamental issue of designing virtual buttons is surprisingly ignored. To this end, this paper presents four variants of virtual buttons, considering two design dimensions of key representations and multi-modal cues (audio, visual, haptic). We conduct two multi-metric assessments to evaluate the four virtual variants and the baselines of physical variants. Our results indicate that the 3D-lookalike buttons help users with more refined and subtle mid-air interactions (i.e. lesser press depth) when haptic cues are available; while the users with 2D-lookalike buttons unintuitively achieve better keystroke performance than the 3D counterparts. We summarize the findings, and accordingly, suggest the design choices of virtual reality buttons among the two proposed design dimensions.

References

  1. Jindvrich Adolf, Peter Kán, Benjamin Outram, Hannes Kaufmann, Jarom'ir Dolevzal, and Lenka Lhotská. 2019. Juggling in VR: Advantages of Immersive Virtual Reality in Juggling Learning. In 25th ACM Symposium on Virtual Reality Software and Technology (Parramatta, NSW, Australia) (VRST '19). Association for Computing Machinery, New York, NY, USA, Article 31, 5 pages. https://doi.org/10.1145/3359996.3364246 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Faisal Arafsha, Longyu Zhang, Haiwei Dong, and Abdulmotaleb El Saddik. 2015. Contactless haptic feedback: State of the art. 2015 IEEE International Symposium on Haptic, Audio and Visual Environments and Games, HAVE 2015 - Proceedings (2015). https://doi.org/10.1109/HAVE.2015.7359447Google ScholarGoogle ScholarCross RefCross Ref
  3. Gerd Berget and Frode Eika Sandnes. 2015. On the Understandability of Public Domain Icons: Effects of Gender and Age. In Universal Access in Human-Computer Interaction. Access to Today's Technologies, Margherita Antona and Constantine Stephanidis (Eds.). Springer International Publishing, Cham, 387--396.Google ScholarGoogle Scholar
  4. Mourad Bouzit, Grigore Burdea, George Popescu, and Rares Boian. 2002. The Rutgers Master II-new design force-feedback glove. IEEE/ASME Transactions on mechatronics, Vol. 7, 2 (2002), 256--263.Google ScholarGoogle ScholarCross RefCross Ref
  5. Sara Bouzit, Gaëlle Calvary, Denis Chêne, and Jean Vanderdonckt. 2016. A design space for engineering graphical adaptive menus. In Proceedings of the 8th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 239--244. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Doug A Bowman, Ryan P McMahan, and Eric D Ragan. 2012. Questioning naturalism in 3D user interfaces. Commun. ACM, Vol. 55, 9 (2012), 78--88. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Doug A Bowman, Christopher J Rhoton, and Marcio S Pinho. 2002. Text input techniques for immersive virtual environments: An empirical comparison. In Proceedings of the human factors and ergonomics society annual meeting, Vol. 46. SAGE Publications Sage CA: Los Angeles, CA, 2154--2158.Google ScholarGoogle ScholarCross RefCross Ref
  8. Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013a. UltraHaptics : Multi-Point Mid-Air Haptic Feedback for Touch Surfaces. (2013).Google ScholarGoogle Scholar
  9. Tom Carter, Sue Ann Seah, Benjamin Long, Bruce Drinkwater, and Sriram Subramanian. 2013b. UltraHaptics: multi-point mid-air haptic feedback for touch surfaces. In Proceedings of the 26th annual ACM symposium on User interface software and technology. 505--514. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Andy Cockburn and Stephen Brewster. 2005. Multimodal feedback for the acquisition of small targets. Ergonomics, Vol. 48, 9 (2005), 1129--1150.Google ScholarGoogle ScholarCross RefCross Ref
  11. Gennaro Costagliola, Vittorio Fuccella, and Michele Di Capua. 2011. Text Entry with KeyScretch. In Proceedings of the 16th International Conference on Intelligent User Interfaces (Palo Alto, CA, USA) (IUI '11). Association for Computing Machinery, New York, NY, USA, 277--286. https://doi.org/10.1145/1943403.1943445 Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Xiaowei Dai, Jiawei Gu, Xiang Cao, J Edward Colgate, and Hong Tan. 2012. SlickFeel: sliding and clicking haptic feedback on a touchscreen. In Adjunct proceedings of the 25th annual ACM symposium on User interface software and technology. 21--22. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. C Doerrer and R Werthschuetzky. 2002. Simulating push-buttons using a haptic display: Requirements on force resolution and force-displacement curve. In Proc. EuroHaptics. 41--46.Google ScholarGoogle Scholar
  14. Tafadzwa Joseph Dube and Ahmed Sabbir Arif. 2019. Text entry in virtual reality: A comprehensive review of the literature. In International Conference on Human-Computer Interaction. Springer, 419--437.Google ScholarGoogle ScholarCross RefCross Ref
  15. John Dudley, Hrvoje Benko, Daniel Wigdor, and Per Ola Kristensson. 2019. Performance Envelopes of Virtual Keyboard Text Input Strategies in Virtual Reality. In 2019 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). IEEE, 289--300.Google ScholarGoogle Scholar
  16. Elham Ebrahimi, Sabarish V Babu, Christopher C Pagano, and Sophie Jörg. 2016. An empirical evaluation of visuo-haptic feedback on physical reaching behaviors during 3D interaction in real and immersive virtual environments. ACM Transactions on Applied Perception (TAP), Vol. 13, 4 (2016), 1--21. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Adam Faeth and Chris Harding. 2014. Emergent effects in multimodal feedback from virtual buttons. ACM Transactions on Computer-Human Interaction (TOCHI), Vol. 21, 1 (2014), 3. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Massimiliano Gabardi, Massimiliano Solazzi, Daniele Leonardis, and Antonio Frisoli. 2016. A new wearable fingertip haptic interface for the rendering of virtual shapes and surface features. IEEE Haptics Symposium, HAPTICS, Vol. 2016-April (2016), 140--146. https://doi.org/10.1109/HAPTICS.2016.7463168Google ScholarGoogle ScholarCross RefCross Ref
  19. Gabriel González, José P Molina, Arturo S Garc'ia, Diego Mart'inez, and Pascual González. 2009. Evaluation of text input techniques in immersive virtual environments. In New Trends on Human-Computer Interaction. Springer, 109--118.Google ScholarGoogle Scholar
  20. Mitchell L Gordon and Shumin Zhai. 2019. Touchscreen Haptic Augmentation Effects on Tapping, Drag and Drop, and Path Following. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Jay Henderson, Jeff Avery, Laurent Grisoni, and Edward Lank. 2019. Leveraging Distal Vibrotactile Feedback for Target Acquisition. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jeong Ho, Lovenoor Aulck, Michael C Bartha, Christy A Harper, and Peter W Johnson. 2014. Differences in typing forces, muscle activity, comfort, and typing performance among virtual, notebook, and desktop keyboards. Applied Ergonomics, Vol. 45, 6 (2014), 1406--1413. https://doi.org/10.1016/j.apergo.2014.04.001Google ScholarGoogle ScholarCross RefCross Ref
  23. Eve Hoggan, Stephen A. Brewster, and Jody Johnston. 2008. Investigating the Effectiveness of Tactile Feedback for Mobile Touchscreens. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). Association for Computing Machinery, New York, NY, USA, 1573--1582. https://doi.org/10.1145/1357054.1357300 Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Takayuki Hoshi. 2011. Development of aerial-input and aerial-tactile-feedback system. In 2011 IEEE World Haptics Conference. IEEE, 569--573.Google ScholarGoogle ScholarCross RefCross Ref
  25. HyunKi In, Kyu-Jin Cho, KyuRi Kim, and BumSuk Lee. 2011. Jointless structure and under-actuation mechanism for compact hand exoskeleton. In Rehabilitation Robotics (ICORR), 2011 IEEE International Conference on. IEEE, 1--6.Google ScholarGoogle Scholar
  26. Thalmic Labs Inc. 2017 (accessed August 6, 2017) a. Myo. https://www.myo.com/.Google ScholarGoogle Scholar
  27. Thalmic Labs Inc. 2017 (accessed August 6, 2017) b. Unity - Game Engine. https://unity3d.com/.Google ScholarGoogle Scholar
  28. Robert J.K. Jacob, Audrey Girouard, Leanne M. Hirshfield, Michael S. Horn, Orit Shaer, Erin Treacy Solovey, and Jamie Zigelbaum. 2008. Reality-Based Interaction: A Framework for Post-WIMP Interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Florence, Italy) (CHI '08). Association for Computing Machinery, New York, NY, USA, 201--210. https://doi.org/10.1145/1357054.1357089 Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Lars-Erik Janlert. 2014. The Ubiquitous Button. Interactions, Vol. 21, 3 (May 2014), 26--33. https://doi.org/10.1145/2592234 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Nikolaos Kaklanis, Juan González Calleros, Jean Vanderdonckt, and Dimitrios Tzovaras. 2008. A haptic rendering engine of web pages for blind users. In Proceedings of the working conference on Advanced visual interfaces. 437--440. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Akriti Kaur and Pradeep G Yammiyavar. 2017. A comparative study of 2D and 3D mobile keypad user interaction preferences in virtual reality graphic user interfaces. In Proceedings of the 23rd ACM Symposium on Virtual Reality Software and Technology. 1--2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Cédric Kervegant, Félix Raymond, Delphine Graeff, and Julien Castet. 2017. Touch hologram in mid-air. In ACM SIGGRAPH 2017 Emerging Technologies. ACM, 23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Wolf Kienzle and Ken Hinckley. 2014. LightRing: always-available 2D input on any surface. In Proceedings of the 27th annual ACM symposium on User interface software and technology. ACM, 157--160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Hwan Kim, Minhwan Kim, and Woohun Lee. 2016a. HapThimble : A Wearable Haptic Device towards Usable Virtual Touch Screen. Chi '16 (2016), 3694--3705. https://doi.org/10.1145/2858036.2858196 Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Hwan Kim, Minhwan Kim, and Woohun Lee. 2016b. Hapthimble: A wearable haptic device towards usable virtual touch screen. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. 3694--3705. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Sangyeon Kim and Sangwon Lee. 2020. Touch Digitality: Affordance Effects of Visual Properties on Gesture Selection. In Extended Abstracts of the 2020 CHI Conference on Human Factors in Computing Systems Extended Abstracts (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--8. https://doi.org/10.1145/3334480.3382914 Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Pascal Knierim, Valentin Schwind, Anna Maria Feit, Florian Nieuwenhuizen, and Niels Henze. 2018. Physical Keyboards in Virtual Reality: Analysis of Typing Performance and Effects of Avatar Hands. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 345. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Akemi Kobayashi, Ryosuke Aoki, Norimichi Kitagawa, Toshitaka Kimura, Youichi Takashima, and Tomohiro Yamada. 2016. Towards Enhancing Force-Input Interaction by Visual-Auditory Feedback as an Introduction of First Use. In International Conference on Human-Computer Interaction. Springer, 180--191. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Laurens R Krol, Dzmitry Aliakseyeu, and Sriram Subramanian. 2009. Haptic feedback in remote pointing. In CHI'09 Extended Abstracts on Human Factors in Computing Systems. 3763--3768. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Falko Kuester, Michelle Chen, Mark E Phair, and Carsten Mehring. 2005. Towards keyboard independent touch typing in VR. In Proceedings of the ACM symposium on Virtual reality software and technology. ACM, 86--95. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Markos Kyritsis, Stephen R Gulliver, Sonali Morar, and Robert Stevens. 2013. Issues and benefits of using 3D interfaces: visual and verbal tasks. In Proceedings of the Fifth International Conference on Management of Emergent Digital EcoSystems. 241--245. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Anatole Lécuyer, J-M Burkhardt, Sabine Coquillart, and Philippe Coiffet. 2001. " Boundary of illusion": an experiment of sensory integration with a pseudo-haptic system. In Proceedings IEEE Virtual Reality 2001. IEEE, 115--122. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Hojin Lee, Hojun Cha, Junsuk Park, Seungmoon Choi, Hyung-Sik Kim, and Soon-Cheol Chung. 2016. LaserStroke. Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16 Adjunct (2016), 73--74. https://doi.org/10.1145/2984751.2985708 Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Ju-Hwan Lee and Charles Spence. 2008. Assessing the benefits of multimodal feedback on dual-task performance under demanding conditions. In Proceedings of the 22nd British HCI Group Annual Conference on People and Computers: Culture, Creativity, Interaction-Volume 1. British Computer Society, 185--192. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. L.H. Lee and P. Hui. 2018. Interaction Methods for Smart Glasses: A Survey. IEEE Access, Vol. 6 (2018), 28712--28732.Google ScholarGoogle ScholarCross RefCross Ref
  46. L.H. Lee, K.Y. Lam, T. Li, T. Braud, X. Su, and P. Hui. 2019. Quadmetric Optimized Thumb-to-Finger Interaction for Force Assisted One-Handed Text Entry on Mobile Headsets. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol., Vol. 3, 3, Article 94 (Sept. 2019), 27 pages. https://doi.org/10.1145/3351252 Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. L.H. Lee, Y. Zhu, Y.P. Yau, T. Braud, X. SU, and P. Hui. 2020. One-thumb Text Acquisition on Force-assisted Miniature Interfaces for Mobile Headsets. In 2020 IEEE International Conference on Pervasive Computing and Communications (PerCom). 1--10.Google ScholarGoogle Scholar
  48. L. H. Lee, K. Yung Lam, Y. P. Yau, T. Braud, and P. Hui. 2019. HIBEY: Hide the Keyboard in Augmented Reality. In 2019 IEEE International Conference on Pervasive Computing and Communications (PerCom. 1--10. https://doi.org/10.1109/PERCOM.2019.8767420Google ScholarGoogle Scholar
  49. Minkyung Lee, Woontack Woo, et al. 2003. ARKB: 3D vision-based Augmented Reality Keyboard. In ICAT.Google ScholarGoogle Scholar
  50. Seungyon Lee and Shumin Zhai. 2009. The performance of touch screen soft buttons. In Proceedings of the SIGCHI conference on human factors in computing systems. 309--318. Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Wei Li, Xuan Zhang, and Yi Shen Zhang. 2018. How Animation Improve Children's Cognition in User Interface: A Study of the Kids VOD Application. In Design, User Experience, and Usability: Users, Contexts and Case Studies, Aaron Marcus and Wentao Wang (Eds.). Springer International Publishing, Cham, 196--217.Google ScholarGoogle Scholar
  52. Robert W Lindeman, John L Sibert, and James K Hahn. 1999. Towards usable VR: an empirical study of user interfaces for immersive virtual environments. In Proceedings of the SIGCHI conference on Human Factors in Computing Systems. ACM, 64--71. Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Zhaoyuan Ma, Darren Edge, Leah Findlater, and Hong Z. Tan. 2015. Haptic keyclick feedback improves typing speed and reduces typing errors on a flat keyboard. IEEE World Haptics Conference, WHC 2015 (2015), 220--227. https://doi.org/10.1109/WHC.2015.7177717Google ScholarGoogle Scholar
  54. I Scott MacKenzie. 1992. Fitts' law as a research and design tool in human-computer interaction. Human-computer interaction, Vol. 7, 1 (1992), 91--139. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Anders Markussen, Mikkel Rønne Jakobsen, and Kasper Hornbæk. 2014. Vulture: a mid-air word-gesture keyboard. In Proceedings of the 32nd annual ACM conference on Human factors in computing systems. ACM, 1073--1082. Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Sven Mayer, Valentin Schwind, Robin Schweigert, and Niels Henze. 2018. The Effect of Offset Correction and Cursor on Mid-Air Pointing in Real and Virtual Environments. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 653. Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Lorna McKnight and Janet C. Read. 2009. Designing the "record" Button: Using Children's Understanding of Icons to Inform the Design of a Musical Interface. In Proceedings of the 8th International Conference on Interaction Design and Children (Como, Italy) (IDC '09). Association for Computing Machinery, New York, NY, USA, 258--261. https://doi.org/10.1145/1551788.1551847 Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Paul Milgram, Haruo Takemura, Akira Utsumi, and Fumio Kishino. 1994. Augmented reality: A class of displays on the reality-virtuality continuum. Telemanipulator and Telepresence Technologies, Vol. 2351 (01 1994). https://doi.org/10.1117/12.197321Google ScholarGoogle Scholar
  59. Y Nam, M Park, and R Yamane. 2007. Smart glove: hand master using magnetorheological fluid actuators. In Proc. SPIE, Vol. 6794. 679434--1.Google ScholarGoogle Scholar
  60. Tao Ni, Doug Bowman, and Chris North. 2011. AirStroke: bringing unistroke text entry to freehand gesture interfaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 2473--2476. Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Yoichi Ochiai, Kota Kumagai, Takayuki Hoshi, Satoshi Hasegawa, and Yoshio Hayasaki. 2016. Cross-Field Aerial Haptics : Rendering Haptic Feedback in Air with Light and Acoustic Fields. Chi '16 (2016), 3238--3247. https://doi.org/10.1145/2858036.2858489 Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Taihei Ogitani, Yoshitaka Arahori, Yusuke Shinyama, and Katsuhiko Gondow. 2018. Space saving text input method for head mounted display with virtual 12-key keyboard. In 2018 IEEE 32nd International Conference on Advanced Information Networking and Applications (AINA). IEEE, 342--349.Google ScholarGoogle ScholarCross RefCross Ref
  63. Kseniia Palin, Anna Maria Feit, Sunjun Kim, Per Ola Kristensson, and Antti Oulasvirta. 2019. How do people type on mobile devices? Observations from a study with 37,000 volunteers. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services. 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Evan Pezent, Ali Israr, Majed Samad, Shea Robinson, Priyanshu Agarwal, Hrvoje Benko, and Nick Colonnese. 2019. Tasbi: Multisensory squeeze and vibrotactile wrist haptics for augmented and virtual reality. In 2019 IEEE World Haptics Conference (WHC). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  65. Majed Samad, Elia Gatti, Anne Hermes, Hrvoje Benko, and Cesare Parise. 2019. Pseudo-Haptic Weight: Changing the Perceived Weight of Virtual Objects By Manipulating Control-Display Ratio. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (Glasgow, Scotland Uk) (CHI '19). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3290605.3300550 Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Roy Shilkrot, Jochen Huber, Jürgen Steimle, Suranga Nanayakkara, and Pattie Maes. 2015. Digital digits: A comprehensive survey of finger augmentation devices. ACM Computing Surveys (CSUR), Vol. 48, 2 (2015), 30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Rajinder Sodhi, Ivan Poupyrev, Matthew Glisson, and Ali Israr. 2013. AIREAL: interactive tactile experiences in free air. ACM Transactions on Graphics (TOG), Vol. 32, 4 (2013), 134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Marco Speicher, Jan Ehrlich, Vito Gentile, Donald Degraen, Salvatore Sorce, and Antonio Krüger. 2019. Pseudo-haptic Controls for Mid-air Finger-based Menu Interaction. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems. 1--6. Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Marco Speicher, Anna Maria Feit, Pascal Ziegler, and Antonio Krüger. 2018. Selection-based Text Entry in Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 647. Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Patrick L. Strandholt, Oana A. Dogaru, Niels C. Nilsson, Rolf Nordahl, and Stefania Serafin. 2020. Knock on Wood: Combining Redirected Touching and Physical Props for Tool-Based Interaction in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (Honolulu, HI, USA) (CHI '20). Association for Computing Machinery, New York, NY, USA, 1--13. https://doi.org/10.1145/3313831.3376303 Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Ke Sun, Wei Wang, Alex X. Liu, and Haipeng Dai. 2018. Depth Aware Finger Tapping on Virtual Displays. In Proceedings of the 16th Annual International Conference on Mobile Systems, Applications, and Services (Munich, Germany) (MobiSys '18). Association for Computing Machinery, New York, NY, USA, 283--295. https://doi.org/10.1145/3210240.3210315 Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. CyberGlove Systems. 2020. CyberTouch. http://www.cyberglovesystems.com/cybertouch.Google ScholarGoogle Scholar
  73. Jennifer L Tennison and Jenna L Gorlewicz. 2019. Non-visual perception of lines on a multimodal touchscreen tablet. ACM Transactions on Applied Perception (TAP), Vol. 16, 1 (2019), 1--19. Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Andries van Dam. 1997. Post-WIMP User Interfaces. Commun. ACM, Vol. 40, 2 (Feb. 1997), 63--67. https://doi.org/10.1145/253671.253708 Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Cheng-Yao Wang, Wei-Chen Chu, Po-Tsung Chiu, Min-Chieh Hsiu, Yih-Harn Chiang, and Mike Y Chen. 2015. PalmType: Using palms as keyboards for smart glasses. In Proceedings of the 17th International Conference on Human-Computer Interaction with Mobile Devices and Services. 153--160. Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Chien-Min Wu, Chih-Wen Hsu, Tzu-Kuei Lee, and Shana Smith. 2017. A virtual reality keyboard with realistic haptic feedback in a fully immersive virtual environment. Virtual Reality, Vol. 21, 1 (2017), 19--29. Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Yi Yang, Yuru Zhang, Zhu Hou, and Betty Lemaire-Semail. 2011. Adding haptic feedback to touch screens at the right time. In Proceedings of the 13th international conference on multimodal interfaces. 73--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  78. Hui-Shyong Yeo, Xiao-Shen Phang, Taejin Ha, Woontack Woo, and Aaron Quigley. 2017. TiTAN: exploring midair text entry using freehand input. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. ACM, 3041--3049. Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. Hui-Shyong Yeo and Aaron Quigley. 2017. Radar Sensing in Human-Computer Interaction. Interactions, Vol. 25, 1 (Dec. 2017), 70--73. https://doi.org/10.1145/3159651 Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Xu Zhao, Takehiro Niikura, and Takashi Komuro. 2014. Evaluation of Visuo-haptic Feedback in a 3D Touch Panel Interface. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces. 299--304. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Exploring Button Designs for Mid-air Interaction in Virtual Reality: A Hexa-metric Evaluation of Key Representations and Multi-modal Cues

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Human-Computer Interaction
        Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue EICS
        EICS
        June 2021
        546 pages
        EISSN:2573-0142
        DOI:10.1145/3468527
        Issue’s Table of Contents

        Copyright © 2021 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 29 May 2021
        Published in pacmhci Volume 5, Issue EICS

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!