skip to main content
research-article

HybridPointing for Touch: Switching Between Absolute and Relative Pointing on Large Touch Screens

Published:05 November 2021Publication History
Skip Abstract Section

Abstract

We propose CursorTap, an extension of Forlines et al.'s mixed, absolute and relative "HybridPointing" to large wall-sized multitouch displays. Our technique uses a relative pointing quasimode activated with one hand, while the other hand controls a distant cursor similar to a large touchpad. A controlled experiment compares the technique to standard absolute touch input as a baseline and a whole-display "Drag" technique representing a common alternate approach. Results show CursorTap is fastest for the common usage scenario of reaching distant targets and then returning to nearby targets. Overall, median selection times across distances are similar with CursorTap, but linearly increase with the other techniques. As further validation, a second study explore show people use CursorTap in a two-person game. The results found just over half of the participants choose to use CursorTap for half of the primary interactions where "enemies" are eliminated using a tap, drag, or lasso "tool".

Skip Supplemental Material Section

Supplemental Material

V5iss495sVF.mp4

Supplemental video

References

  1. Martha Abednego, Joong-Ho Lee, Won Moon, and Ji-Hyung Park. 2009. I-Grabber: Expanding Physical Reach in a Large-Display Tabletop Environment through the Use of a Virtual Grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS '09). Association for Computing Machinery, New York, NY, USA, 61--64. https://doi.org/10.1145/1731903.1731917Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Alec Azad, Jaime Ruiz, Daniel Vogel, Mark Hancock, and Edward Lank. 2012. Territoriality and Behaviour on and Around Large Vertical Publicly-shared Displays. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS '12). ACM, New York, NY, USA, 468--477. https://doi.org/10.1145/2317956.2318025Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ravin Balakrishnan. 2004. "Beating" Fitts' law: virtual enhancements for pointing facilitation. International Journal of Human-Computer Studies , Vol. 61, 6 (2004), 857--874.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An In-air Pointing Technique to Manipulate Out-of-reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS '11). ACM, New York, NY, USA, 11--20. https://doi.org/10.1145/2076354.2076357Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Patrick Baudisch, Edward Cutrell, Dan Robbins, Mary Czerwinski, Peter Tandler, Benjamin Bederson, Alex Zierlinger, and others. 2003. Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. In Proceedings of INTERACT , Vol. 3. 57--64.Google ScholarGoogle Scholar
  6. Anastasia Bezerianos and Ravin Balakrishnan. 2005. The Vacuum: Facilitating the Manipulation of Distant Objects .Association for Computing Machinery, New York, NY, USA, 361--370. https://doi.org/10.1145/1054972.1055023Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Géry Casiez and Nicolas Roussel. 2011. No More Bricolage! Methods and Tools to Characterize, Replicate and Compare Pointing Transfer Functions. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 603--614. https://doi.org/10.1145/2047196.2047276Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1 € Filter: A Simple Speed-based Low-pass Filter for Noisy Input in Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 2527--2530. https://doi.org/10.1145/2207676.2208639Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Maxime Collomb, Mountaz Hascoët, Patrick Baudisch, and Brian Lee. 2005. Improving Drag-and-Drop on Wall-Size Displays. In Proceedings of Graphics Interface 2005 (Victoria, British Columbia) (GI '05). Canadian Human-Computer Communications Society, Waterloo, CAN, 25--32.Google ScholarGoogle Scholar
  10. Terence Dickson. 2017. HybridPointing Touch: A Technique to Switch Between Absolute and Relative Pointing on Large Touch Screens . Master's thesis. University of Waterloo, Canada. http://hdl.handle.net/10012/12593Google ScholarGoogle Scholar
  11. Clifton Forlines, Daniel Vogel, and Ravin Balakrishnan. 2006. HybridPointing: Fluid Switching between Absolute and Relative Pointing with a Direct Input Device. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST '06). Association for Computing Machinery, New York, NY, USA, 211--220. https://doi.org/10.1145/1166253.1166286Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jérémie Gilliot, Géry Casiez, and Nicolas Roussel. 2014. Direct and Indirect Multi-touch Interaction on a Wall Display. In Proceedings of the 26th Conference on L'Interaction Homme-Machine (Villeneuve d'Ascq, France) (IHM '14). ACM, New York, NY, USA, 147--152. https://doi.org/10.1145/2670444.2670445Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Yves Guiard. 1987. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior , Vol. 19, 4 (1987), 486--517.Google ScholarGoogle Scholar
  14. Kaori Ikematsu and Itiro Siio. 2016. Carbon Copy Metaphor: Mode Switching Technique for Trackpad-Based Manipulations. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 439--444. https://doi.org/10.1145/2992154.2996795Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Mikkel R. Jakobsen, Yvonne Jansen, Sebastian Boring, and Kasper Hornbæk. 2015. Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction .Springer International Publishing, Cham, 455--473. https://doi.org/10.1007/978--3--319--22698--9_31Google ScholarGoogle Scholar
  16. Azam Khan, George Fitzmaurice, Don Almeida, Nicolas Burtnyk, and Gordon Kurtenbach. 2004. A Remote Control Interface for Large Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST '04). ACM, New York, NY, USA, 127--136. https://doi.org/10.1145/1029632.1029655Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Sunjun Kim, Jihyun Yu, and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, 295--298. http://dl.acm.org/citation.cfm?id=2414585Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Ulrike Kister, Patrick Reipschl"ager, and Raimund Dachselt. 2014. Multi-Touch Manipulation of Magic Lenses for Information Visualization. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (Dresden, Germany) (ITS '14). Association for Computing Machinery, New York, NY, USA, 431--434. https://doi.org/10.1145/2669485.2669528Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle arms-down mid-air interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 63--71. http://dl.acm.org/citation.cfm?id=2807489Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. David C. McCallum and Pourang Irani. 2009. ARC-Pad: AbsoluteGoogle ScholarGoogle Scholar
  21. relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09). Association for Computing Machinery, New York, NY, USA, 153--156. https://doi.org/10.1145/1622176.1622205Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Miguel A. Nacenta, Dzmitry Aliakseyeu, Sriram Subramanian, and Carl Gutwin. 2005. A Comparison of Techniques for Multi-Display Reaching .Association for Computing Machinery, New York, NY, USA, 371--380. https://doi.org/10.1145/1054972.1055024Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Mathieu Nancel, Olivier Chapuis, Emmanuel Pietriga, Xing-Dong Yang, Pourang P. Irani, and Michel Beaudouin-Lafon. 2013. High-Precision Pointing on Large Wall Displays Using Small Handheld Devices .Association for Computing Machinery, New York, NY, USA, 831--840. https://doi.org/10.1145/2470654.2470773Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Mathieu Nancel, Emmanuel Pietriga, Olivier Chapuis, and Michel Beaudouin-Lafon. 2015. Mid-air pointing on ultra-walls. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 22, 5 (2015), 21.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. J. Karen Parker, Regan L. Mandryk, and Kori M. Inkpen. 2005. TractorBeam: seamless integration of local and remote pointing for tabletop displays. In Proceedings of Graphics interface 2005 . Canadian Human-Computer Communications Society, 33--40. http://dl.acm.org/citation.cfm?id=1089515Google ScholarGoogle Scholar
  26. Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. Partially-Indirect Bimanual Input with Gaze, Pen, and Touch for Pan, Zoom, and Ink Interaction .Association for Computing Machinery, New York, NY, USA, 2845--2856. https://doi.org/10.1145/2858036.2858201Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Jef Raskin. 2000. The humane interface: new directions for designing interactive systems .Addison-Wesley Professional.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Hanae Rateau, Yosra Rekik, Laurent Grisoni, and Joaquim Jorge. 2016. Talaria: Continuous Drag & Drop on a Wall Display. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 199--204. https://doi.org/10.1145/2992154.2992164Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Adrian Reetz, Carl Gutwin, Tadeusz Stach, Miguel Nacenta, and Sriram Subramanian. 2006. Superflick: a natural and efficient technique for long-distance object placement on digital tables. In Proceedings of Graphics interface 2006 . Canadian Information Processing Society, 163--170. http://dl.acm.org/citation.cfm?id=1143106Google ScholarGoogle Scholar
  30. Abigail J Sellen, Gordon P Kurtenbach, and William AS Buxton. 1992. The prevention of mode errors through sensory feedback. Human-computer interaction , Vol. 7, 2 (1992), 141--164.Google ScholarGoogle Scholar
  31. Ben Shneiderman. 1991. Touch screens now offer compelling uses. IEEE software , Vol. 8, 2 (1991), 93--94.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Garth Shoemaker, Anthony Tang, and Kellogg S. Booth. 2007. Shadow Reaching: A New Perspective on Interaction for Large Displays. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (Newport, Rhode Island, USA) (UIST '07). ACM, New York, NY, USA, 53--56. https://doi.org/10.1145/1294211.1294221Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Garth Shoemaker, Takayuki Tsukitani, Yoshifumi Kitamura, and Kellogg S. Booth. 2010. Body-Centric Interaction Techniques for Very Large Wall Displays. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (Reykjavik, Iceland) (NordiCHI '10). Association for Computing Machinery, New York, NY, USA, 463--472. https://doi.org/10.1145/1868914.1868967Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Qingkun Su, Oscar Kin-Chung Au, Pengfei Xu, Hongbo Fu, and Chiew-Lan Tai. 2016. 2D-Dragger: unified touch-based target acquisition with constant effective width. ACM Press, 170--179. https://doi.org/10.1145/2935334.2935339Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays (UIST '05). Association for Computing Machinery, New York, NY, USA, 33--42. https://doi.org/10.1145/1095034.1095041Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. James R Wallace, Daniel Vogel, and Edward Lank. 2014. The effect of interior bezel presence and width on magnitude judgement. In Proceedings of Graphics Interface 2014. Canadian Information Processing Society, 175--182.Google ScholarGoogle Scholar
  37. Rina R. Wehbe, Terence Dickson, Anastasia Kuzminykh, Lennart E. Nacke, and Edward Lank. 2020. Personal Space in Play: Physical and Digital Boundaries in Large-Display Cooperative and Competitive Games .Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376319Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). 143--146.Google ScholarGoogle Scholar
  39. Haijun Xia, Ken Hinckley, Michel Pahud, Xiao Tu, and Bill Buxton. 2017. WritLarge: Ink Unleashed by Unified Scope, Action, & Zoom .Association for Computing Machinery, New York, NY, USA, 3227--3240. https://doi.org/10.1145/3025453.3025664Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Jibin Yin and Hua Liu. 2010. Lever Cursor: A bimanual selection technique for multitouch tabletop. In The 2010 IEEE International Conference on Information and Automation . 105--109. https://doi.org/10.1109/ICINFA.2010.5512341Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. HybridPointing for Touch: Switching Between Absolute and Relative Pointing on Large Touch Screens

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Human-Computer Interaction
        Proceedings of the ACM on Human-Computer Interaction  Volume 5, Issue ISS
        ISS
        November 2021
        481 pages
        EISSN:2573-0142
        DOI:10.1145/3498314
        Issue’s Table of Contents

        Copyright © 2021 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 5 November 2021
        Published in pacmhci Volume 5, Issue ISS

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!