Abstract

We propose CursorTap, an extension of Forlines et al.'s mixed, absolute and relative "HybridPointing" to large wall-sized multitouch displays. Our technique uses a relative pointing quasimode activated with one hand, while the other hand controls a distant cursor similar to a large touchpad. A controlled experiment compares the technique to standard absolute touch input as a baseline and a whole-display "Drag" technique representing a common alternate approach. Results show CursorTap is fastest for the common usage scenario of reaching distant targets and then returning to nearby targets. Overall, median selection times across distances are similar with CursorTap, but linearly increase with the other techniques. As further validation, a second study explore show people use CursorTap in a two-person game. The results found just over half of the participants choose to use CursorTap for half of the primary interactions where "enemies" are eliminated using a tap, drag, or lasso "tool".
Supplemental Material
- Martha Abednego, Joong-Ho Lee, Won Moon, and Ji-Hyung Park. 2009. I-Grabber: Expanding Physical Reach in a Large-Display Tabletop Environment through the Use of a Virtual Grabber. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Banff, Alberta, Canada) (ITS '09). Association for Computing Machinery, New York, NY, USA, 61--64. https://doi.org/10.1145/1731903.1731917Google Scholar
Digital Library
- Alec Azad, Jaime Ruiz, Daniel Vogel, Mark Hancock, and Edward Lank. 2012. Territoriality and Behaviour on and Around Large Vertical Publicly-shared Displays. In Proceedings of the Designing Interactive Systems Conference (Newcastle Upon Tyne, United Kingdom) (DIS '12). ACM, New York, NY, USA, 468--477. https://doi.org/10.1145/2317956.2318025Google Scholar
Digital Library
- Ravin Balakrishnan. 2004. "Beating" Fitts' law: virtual enhancements for pointing facilitation. International Journal of Human-Computer Studies , Vol. 61, 6 (2004), 857--874.Google Scholar
Digital Library
- Amartya Banerjee, Jesse Burstyn, Audrey Girouard, and Roel Vertegaal. 2011. Pointable: An In-air Pointing Technique to Manipulate Out-of-reach Targets on Tabletops. In Proceedings of the ACM International Conference on Interactive Tabletops and Surfaces (Kobe, Japan) (ITS '11). ACM, New York, NY, USA, 11--20. https://doi.org/10.1145/2076354.2076357Google Scholar
Digital Library
- Patrick Baudisch, Edward Cutrell, Dan Robbins, Mary Czerwinski, Peter Tandler, Benjamin Bederson, Alex Zierlinger, and others. 2003. Drag-and-pop and drag-and-pick: Techniques for accessing remote screen content on touch-and pen-operated systems. In Proceedings of INTERACT , Vol. 3. 57--64.Google Scholar
- Anastasia Bezerianos and Ravin Balakrishnan. 2005. The Vacuum: Facilitating the Manipulation of Distant Objects .Association for Computing Machinery, New York, NY, USA, 361--370. https://doi.org/10.1145/1054972.1055023Google Scholar
Digital Library
- Géry Casiez and Nicolas Roussel. 2011. No More Bricolage! Methods and Tools to Characterize, Replicate and Compare Pointing Transfer Functions. In Proceedings of the 24th Annual ACM Symposium on User Interface Software and Technology (Santa Barbara, California, USA) (UIST '11). Association for Computing Machinery, New York, NY, USA, 603--614. https://doi.org/10.1145/2047196.2047276Google Scholar
Digital Library
- Géry Casiez, Nicolas Roussel, and Daniel Vogel. 2012. 1 € Filter: A Simple Speed-based Low-pass Filter for Noisy Input in Interactive Systems. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 2527--2530. https://doi.org/10.1145/2207676.2208639Google Scholar
Digital Library
- Maxime Collomb, Mountaz Hascoët, Patrick Baudisch, and Brian Lee. 2005. Improving Drag-and-Drop on Wall-Size Displays. In Proceedings of Graphics Interface 2005 (Victoria, British Columbia) (GI '05). Canadian Human-Computer Communications Society, Waterloo, CAN, 25--32.Google Scholar
- Terence Dickson. 2017. HybridPointing Touch: A Technique to Switch Between Absolute and Relative Pointing on Large Touch Screens . Master's thesis. University of Waterloo, Canada. http://hdl.handle.net/10012/12593Google Scholar
- Clifton Forlines, Daniel Vogel, and Ravin Balakrishnan. 2006. HybridPointing: Fluid Switching between Absolute and Relative Pointing with a Direct Input Device. In Proceedings of the 19th Annual ACM Symposium on User Interface Software and Technology (Montreux, Switzerland) (UIST '06). Association for Computing Machinery, New York, NY, USA, 211--220. https://doi.org/10.1145/1166253.1166286Google Scholar
Digital Library
- Jérémie Gilliot, Géry Casiez, and Nicolas Roussel. 2014. Direct and Indirect Multi-touch Interaction on a Wall Display. In Proceedings of the 26th Conference on L'Interaction Homme-Machine (Villeneuve d'Ascq, France) (IHM '14). ACM, New York, NY, USA, 147--152. https://doi.org/10.1145/2670444.2670445Google Scholar
Digital Library
- Yves Guiard. 1987. Asymmetric division of labor in human skilled bimanual action: The kinematic chain as a model. Journal of motor behavior , Vol. 19, 4 (1987), 486--517.Google Scholar
- Kaori Ikematsu and Itiro Siio. 2016. Carbon Copy Metaphor: Mode Switching Technique for Trackpad-Based Manipulations. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 439--444. https://doi.org/10.1145/2992154.2996795Google Scholar
Digital Library
- Mikkel R. Jakobsen, Yvonne Jansen, Sebastian Boring, and Kasper Hornbæk. 2015. Should I Stay or Should I Go? Selecting Between Touch and Mid-Air Gestures for Large-Display Interaction .Springer International Publishing, Cham, 455--473. https://doi.org/10.1007/978--3--319--22698--9_31Google Scholar
- Azam Khan, George Fitzmaurice, Don Almeida, Nicolas Burtnyk, and Gordon Kurtenbach. 2004. A Remote Control Interface for Large Displays. In Proceedings of the 17th Annual ACM Symposium on User Interface Software and Technology (Santa Fe, NM, USA) (UIST '04). ACM, New York, NY, USA, 127--136. https://doi.org/10.1145/1029632.1029655Google Scholar
Digital Library
- Sunjun Kim, Jihyun Yu, and Geehyuk Lee. 2012. Interaction techniques for unreachable objects on the touchscreen. In Proceedings of the 24th Australian Computer-Human Interaction Conference. ACM, 295--298. http://dl.acm.org/citation.cfm?id=2414585Google Scholar
Digital Library
- Ulrike Kister, Patrick Reipschl"ager, and Raimund Dachselt. 2014. Multi-Touch Manipulation of Magic Lenses for Information Visualization. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces (Dresden, Germany) (ITS '14). Association for Computing Machinery, New York, NY, USA, 431--434. https://doi.org/10.1145/2669485.2669528Google Scholar
Digital Library
- Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle arms-down mid-air interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology. ACM, 63--71. http://dl.acm.org/citation.cfm?id=2807489Google Scholar
Digital Library
- David C. McCallum and Pourang Irani. 2009. ARC-Pad: AbsoluteGoogle Scholar
- relative Cursor Positioning for Large Displays with a Mobile Touchscreen. In Proceedings of the 22nd Annual ACM Symposium on User Interface Software and Technology (Victoria, BC, Canada) (UIST '09). Association for Computing Machinery, New York, NY, USA, 153--156. https://doi.org/10.1145/1622176.1622205Google Scholar
Digital Library
- Miguel A. Nacenta, Dzmitry Aliakseyeu, Sriram Subramanian, and Carl Gutwin. 2005. A Comparison of Techniques for Multi-Display Reaching .Association for Computing Machinery, New York, NY, USA, 371--380. https://doi.org/10.1145/1054972.1055024Google Scholar
Digital Library
- Mathieu Nancel, Olivier Chapuis, Emmanuel Pietriga, Xing-Dong Yang, Pourang P. Irani, and Michel Beaudouin-Lafon. 2013. High-Precision Pointing on Large Wall Displays Using Small Handheld Devices .Association for Computing Machinery, New York, NY, USA, 831--840. https://doi.org/10.1145/2470654.2470773Google Scholar
Digital Library
- Mathieu Nancel, Emmanuel Pietriga, Olivier Chapuis, and Michel Beaudouin-Lafon. 2015. Mid-air pointing on ultra-walls. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 22, 5 (2015), 21.Google Scholar
Digital Library
- J. Karen Parker, Regan L. Mandryk, and Kori M. Inkpen. 2005. TractorBeam: seamless integration of local and remote pointing for tabletop displays. In Proceedings of Graphics interface 2005 . Canadian Human-Computer Communications Society, 33--40. http://dl.acm.org/citation.cfm?id=1089515Google Scholar
- Ken Pfeuffer, Jason Alexander, and Hans Gellersen. 2016. Partially-Indirect Bimanual Input with Gaze, Pen, and Touch for Pan, Zoom, and Ink Interaction .Association for Computing Machinery, New York, NY, USA, 2845--2856. https://doi.org/10.1145/2858036.2858201Google Scholar
Digital Library
- Jef Raskin. 2000. The humane interface: new directions for designing interactive systems .Addison-Wesley Professional.Google Scholar
Digital Library
- Hanae Rateau, Yosra Rekik, Laurent Grisoni, and Joaquim Jorge. 2016. Talaria: Continuous Drag & Drop on a Wall Display. In Proceedings of the 2016 ACM International Conference on Interactive Surfaces and Spaces (Niagara Falls, Ontario, Canada) (ISS '16). Association for Computing Machinery, New York, NY, USA, 199--204. https://doi.org/10.1145/2992154.2992164Google Scholar
Digital Library
- Adrian Reetz, Carl Gutwin, Tadeusz Stach, Miguel Nacenta, and Sriram Subramanian. 2006. Superflick: a natural and efficient technique for long-distance object placement on digital tables. In Proceedings of Graphics interface 2006 . Canadian Information Processing Society, 163--170. http://dl.acm.org/citation.cfm?id=1143106Google Scholar
- Abigail J Sellen, Gordon P Kurtenbach, and William AS Buxton. 1992. The prevention of mode errors through sensory feedback. Human-computer interaction , Vol. 7, 2 (1992), 141--164.Google Scholar
- Ben Shneiderman. 1991. Touch screens now offer compelling uses. IEEE software , Vol. 8, 2 (1991), 93--94.Google Scholar
Digital Library
- Garth Shoemaker, Anthony Tang, and Kellogg S. Booth. 2007. Shadow Reaching: A New Perspective on Interaction for Large Displays. In Proceedings of the 20th Annual ACM Symposium on User Interface Software and Technology (Newport, Rhode Island, USA) (UIST '07). ACM, New York, NY, USA, 53--56. https://doi.org/10.1145/1294211.1294221Google Scholar
Digital Library
- Garth Shoemaker, Takayuki Tsukitani, Yoshifumi Kitamura, and Kellogg S. Booth. 2010. Body-Centric Interaction Techniques for Very Large Wall Displays. In Proceedings of the 6th Nordic Conference on Human-Computer Interaction: Extending Boundaries (Reykjavik, Iceland) (NordiCHI '10). Association for Computing Machinery, New York, NY, USA, 463--472. https://doi.org/10.1145/1868914.1868967Google Scholar
Digital Library
- Qingkun Su, Oscar Kin-Chung Au, Pengfei Xu, Hongbo Fu, and Chiew-Lan Tai. 2016. 2D-Dragger: unified touch-based target acquisition with constant effective width. ACM Press, 170--179. https://doi.org/10.1145/2935334.2935339Google Scholar
Digital Library
- Daniel Vogel and Ravin Balakrishnan. 2005. Distant Freehand Pointing and Clicking on Very Large, High Resolution Displays (UIST '05). Association for Computing Machinery, New York, NY, USA, 33--42. https://doi.org/10.1145/1095034.1095041Google Scholar
Digital Library
- James R Wallace, Daniel Vogel, and Edward Lank. 2014. The effect of interior bezel presence and width on magnitude judgement. In Proceedings of Graphics Interface 2014. Canadian Information Processing Society, 175--182.Google Scholar
- Rina R. Wehbe, Terence Dickson, Anastasia Kuzminykh, Lennart E. Nacke, and Edward Lank. 2020. Personal Space in Play: Physical and Digital Boundaries in Large-Display Cooperative and Competitive Games .Association for Computing Machinery, New York, NY, USA, 1--14. https://doi.org/10.1145/3313831.3376319Google Scholar
Digital Library
- Jacob O. Wobbrock, Leah Findlater, Darren Gergle, and James J. Higgins. 2011. The Aligned Rank Transform for Nonparametric Factorial Analyses Using Only Anova Procedures . In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '11). 143--146.Google Scholar
- Haijun Xia, Ken Hinckley, Michel Pahud, Xiao Tu, and Bill Buxton. 2017. WritLarge: Ink Unleashed by Unified Scope, Action, & Zoom .Association for Computing Machinery, New York, NY, USA, 3227--3240. https://doi.org/10.1145/3025453.3025664Google Scholar
Digital Library
- Jibin Yin and Hua Liu. 2010. Lever Cursor: A bimanual selection technique for multitouch tabletop. In The 2010 IEEE International Conference on Information and Automation . 105--109. https://doi.org/10.1109/ICINFA.2010.5512341Google Scholar
Cross Ref
Index Terms
HybridPointing for Touch: Switching Between Absolute and Relative Pointing on Large Touch Screens
Recommendations
Air+touch: interweaving touch & in-air gestures
UIST '14: Proceedings of the 27th annual ACM symposium on User interface software and technologyWe present Air+Touch, a new class of interactions that interweave touch events with in-air gestures, offering a unified input modality with expressiveness greater than each input modality alone. We demonstrate how air and touch are highly complementary: ...
Touch+Finger: Extending Touch-based User Interface Capabilities with "Idle" Finger Gestures in the Air
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyIn this paper, we present Touch+Finger, a new interaction technique that augments touch input with multi-finger gestures for rich and expressive interaction. The main idea is that while one finger is engaged in a touch event, a user can leverage the ...
A study on touch & hover based interaction for zooming
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsProximity is a useful medium for interaction with high interactive digital contents. It can be used in different contexts such as for navigation through depth in 3D space in zoomable interfaces. In this paper, we propose hover-based zoom interaction as ...






Comments