Abstract

This paper presents a multitouch vocabulary for interacting with parallel coordinates plots on wall-sized displays. The gesture set relies on principles such as two-finger range definition, a functional distinction of background and foreground for applying the Hold-and-Move concept to wall-sized displays as well as fling-based interaction for triggering and controlling long-range movements. Our implementation demonstrates that out-of-reach problems and limitations regarding multitouch technology and display size can be tackled by the coherent integration of our multitouch gestures. Expert reviews indicate that our gesture vocabulary helps to solve typical analysis tasks that require interaction beyond arms' reach, and it also shows how often certain gestures were used.
Supplemental Material
- Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, Atlanta, Georgia, USA, April 10--15, 2010, Elizabeth D. Mynatt, Don Schoner, Geraldine Fitzpatrick, Scott E. Hudson, W. Keith Edwards, and Tom Rodden (Eds.). ACM, 55--64. https://doi.org/10.1145/1753326.1753336Google Scholar
Digital Library
- Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization, Vol. 10, 4 (2011), 341--355. https://doi.org/10.1177/1473871611415997Google Scholar
Digital Library
- Robert Ball and Chris North. 2007. Realizing embodied interaction for visual analytics through large displays. Comput. Graph., Vol. 31, 3 (2007), 380--400. https://doi.org/10.1016/j.cag.2007.01.029Google Scholar
Digital Library
- Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the 2007 Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, USA, April 28 - May 3, 2007, Mary Beth Rosson and David J. Gilmore (Eds.). ACM, 191--200. https://doi.org/10.1145/1240624.1240656Google Scholar
- Dominikus Baur, Bongshin Lee, and Sheelagh Carpendale. 2012. TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs. In Interactive Tabletops and Surfaces, ITS'12, Cambridge/Boston, MA, USA, November 11--14, 2012, Orit Shaer, Chia Shen, Meredith Ringel Morris, and Michael S. Horn (Eds.). ACM, 255--264. https://doi.org/10.1145/2396636.2396675Google Scholar
Digital Library
- Anastasia Bezerianos and Petra Isenberg. 2012. Perception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2516--2525. https://doi.org/10.1109/TVCG.2012.251Google Scholar
Digital Library
- John Brooke. 1996. SUS--A quick and dirty usability scale. Usability evaluation in industry, Vol. 189, 194 (1996), 4--7.Google Scholar
- Thorsten Bü ring, Jens Gerken, and Harald Reiterer. 2006. User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion. IEEE Trans. Vis. Comput. Graph., Vol. 12, 5 (2006), 829--836. https://doi.org/10.1109/TVCG.2006.187Google Scholar
Digital Library
- Mohammad Chegini, Shao Lin, Dirk Joachim Lehmann, Keith Andrews, and Tobias Schreck. 2017. Interaction Concepts for Collaborative Visual Analysis of Scatterplots on Large Vertically-Mounted High-Resolution Multi-Touch Displays. In Proceedings of the 10th Forum Media Technology and 3rd All Around Audio Symposium, St. Pö lten, Austria, November 29--30, 2017 (CEUR Workshop Proceedings, Vol. 2009),, Wolfgang Aigner, Thomas Moser, Kerstin Blumenstein, Matthias Zeppelzauer, Michael Iber, and Grischa Schmiedl (Eds.). CEUR-WS.org, 90--96. http://ceur-ws.org/Vol-2009/fmt-proceedings-2017-paper13.pdfGoogle Scholar
- Raimund Dachselt and Robert Buchholz. 2009. Natural throw and tilt interaction between mobile phones and distant displays. In Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, Extended Abstracts Volume, Boston, MA, USA, April 4--9, 2009, Dan R. Olsen Jr., Richard B. Arthur, Ken Hinckley, Meredith Ringel Morris, Scott E. Hudson, and Saul Greenberg (Eds.). ACM, 3253--3258. https://doi.org/10.1145/1520340.1520467Google Scholar
Digital Library
- Steven Mark Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and m. c. schraefel. 2013. TouchViz: a case study comparing two interfaces for data analytics on tablets. In 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI '13, Paris, France, April 27 - May 2, 2013, Wendy E. Mackay, Stephen A. Brewster, and Susanne Bødker (Eds.). ACM, 2301--2310. https://doi.org/10.1145/2470654.2481318Google Scholar
Digital Library
- Niklas Elmqvist, Pierre Dragicevic, and Jean-Daniel Fekete. 2008. Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation. IEEE Trans. Vis. Comput. Graph., Vol. 14, 6 (2008), 1539--1148. https://doi.org/10.1109/TVCG.2008.153Google Scholar
Cross Ref
- G. W. Furnas. 1986. Generalized Fisheye Views. SIGCHI Bull., Vol. 17, 4 (April 1986), 16--23. https://doi.org/10.1145/22339.22342Google Scholar
Digital Library
- Jé ré mie Gilliot, Gé ry Casiez, and Nicolas Roussel. 2014. Direct and indirect multi-touch interaction on a wall display. In Proceedings of the 26th Conference on l'Interaction Homme-Machine, Villeneuve d'Ascq, France, October 28--31, 2014, Gé ry Casiez, Thomas Pietrzak, Olivier Chapuis, and Sté phane Conversy (Eds.). ACM, 147--152. https://doi.org/10.1145/2670444.2670445Google Scholar
Digital Library
- Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3653--3656. https://doi.org/10.1145/2702123.2702133Google Scholar
Digital Library
- Mathias Heilig, Stephan Huber, Mischa Demarmels, and Harald Reiterer. 2010. ScatterTouch: a multi touch rubber sheet scatter plot visualization for co-located data exploration. In ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, Saarbrü cken, Germany, November 7--10, 2010, Antonio Krü ger, Johannes Schö ning, Daniel Wigdor, and Michael Haller (Eds.). ACM, 263--264. https://doi.org/10.1145/1936652.1936707Google Scholar
Digital Library
- Julian Heinrich and Daniel Weiskopf. 2013. State of the Art of Parallel Coordinates. In Eurographics 2013 - State of the Art Reports, Girona, Spain, May 6--10, 2013, Mateu Sbert and Lá szló Szirmay-Kalos (Eds.). Eurographics Association, 95--116. https://doi.org/10.2312/conf/EG2013/stars/095--116Google Scholar
- Tom Horak, Sriram Karthik Badam, Niklas Elmqvist, and Raimund Dachselt. 2018. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 19. https://doi.org/10.1145/3173574.3173593Google Scholar
Digital Library
- Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 4169--4178. https://doi.org/10.1145/2702123.2702312Google Scholar
- Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Comput. Graph. Forum, Vol. 36, 3 (2017), 503--514. https://doi.org/10.1111/cgf.13206Google Scholar
Digital Library
- Robert Kosara. 2011. Indirect multi-touch interaction for brushing in parallel coordinates. In Visualization and Data Analysis 2011, San Francisco Airport, CA, USA, January 24--25, 2011 (SPIE Proceedings, Vol. 7868),, Pak Chung Wong, Jinah Park, Ming C. Hao, Chaomei Chen, Katy Bö rner, David L. Kao, and Jonathan C. Roberts (Eds.). SPIE, 786809. https://doi.org/10.1117/12.872645Google Scholar
Cross Ref
- Alexander Kulik, Jan Dittrich, and Bernd Froehlich. 2012. The hold-and-move gesture for multi-touch interfaces. In Mobile HCI '12, Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, San Francsico, CA, USA, September 21--24, 2012, Elizabeth F. Churchill, Sriram Subramanian, Patrick Baudisch, and Kenton O'Hara (Eds.). ACM, 49--58. https://doi.org/10.1145/2371574.2371583Google Scholar
Digital Library
- Ricardo Langner, Ulrike Kister, and Raimund Dachselt. 2019. Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances. IEEE Trans. Vis. Comput. Graph., Vol. 25, 1 (2019), 608--618. https://doi.org/10.1109/TVCG.2018.2865235Google Scholar
Digital Library
- Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2689--2698. https://doi.org/10.1109/TVCG.2012.204Google Scholar
Digital Library
- Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Pawel Wozniak. 2017. Interaction techniques for window management on large high-resolution displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia, MUM 2017, Stuttgart, Germany, November 26 - 29, 2017, Niels Henze, Pawel Wozniak, Kaisa V"a "a n"a nen, Julie Williamson, and Stefan Schneegass (Eds.). ACM, 241--247. https://doi.org/10.1145/3152832.3152852Google Scholar
Digital Library
- Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of display size and navigation type on a classification task. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 4147--4156. https://doi.org/10.1145/2556288.2557020Google Scholar
- Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle Arms-down Mid-air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, UIST 2015, Charlotte, NC, USA, November 8--11, 2015, Celine Latulipe, Bjoern Hartmann, and Tovi Grossman (Eds.). ACM, 63--71. https://doi.org/10.1145/2807442.2807489Google Scholar
Digital Library
- Meredith Ringel Morris, Andreea Danielescu, Steven Mark Drucker, Danyel Fisher, Bongshin Lee, m. c. schraefel, and Jacob O. Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. Interactions, Vol. 21, 3 (2014), 40--45. https://doi.org/10.1145/2591689Google Scholar
Digital Library
- Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy E. Mackay. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proceedings of the International Conference on Human Factors in Computing Systems, CHI 2011, Vancouver, BC, Canada, May 7--12, 2011, Desney S. Tan, Saleema Amershi, Bo Begole, Wendy A. Kellogg, and Manas Tungare (Eds.). ACM, 177--186. https://doi.org/10.1145/1978942.1978969Google Scholar
- Jakob Nielsen. 1993. Usability engineering .Academic Press.Google Scholar
Digital Library
- PQLabs. [n.d.]. Support Center. https://www.pqlabs.com/support_wall.html. Accessed: 03/2019.Google Scholar
- Arnaud Prouzeau, Anastasia Bezerianos, and Olivier Chapuis. 2017. Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays. IEEE Trans. Vis. Comput. Graph., Vol. 23, 8 (2017), 1936--1951. https://doi.org/10.1109/TVCG.2016.2592906Google Scholar
Digital Library
- Renata G. Raidou, Martin Eisemann, Marcel Breeuwer, Elmar Eisemann, and Anna Vilanova. 2016. Orientation-Enhanced Parallel Coordinate Plots. IEEE Trans. Vis. Comput. Graph., Vol. 22, 1 (2016), 589--598. https://doi.org/10.1109/TVCG.2015.2467872Google Scholar
Digital Library
- Fateme Rajabiyazdi, Jagoda Walny, Carrie Mah, John Brosz, and Sheelagh Carpendale. 2015. Understanding Researchers' Use of a Large, High-Resolution Display Across Disciplines. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, ITS 2015, Funchal, Portugal, November 15--18, 2015, Nuno Jardim Nunes, Enrico Costanza, Patrick Olivier, and Johannes Schö ning (Eds.). ACM, 107--116. https://doi.org/10.1145/2817721.2817735Google Scholar
Digital Library
- Khairi Reda, Andrew E. Johnson, Michael E. Papka, and Jason Leigh. 2015. Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 2759--2768. https://doi.org/10.1145/2702123.2702406Google Scholar
Digital Library
- Patrick Riehmann, Gabriela Molina León, Joshua Reibert, Florian Echtler, and Bernd Froehlich. 2020. Short-Contact Touch-Manipulation of Scatterplot Matrices on Wall Displays. Computer Graphics Forum (2020). https://doi.org/10.1111/cgf.13979Google Scholar
- Patrick Riehmann, Joshua Reibert, Jens Opolka, and Bernd Frö hlich. 2018. Touch the Time: Touch-Centered Interaction Paradigms for Time-Oriented Data. In Eurographics Conference on Visualization, EuroVis 2018, Short Papers, Brno, Czech Republic, 4--8 June 2018, Jimmy Johansson, Filip Sadlo, and Tobias Schreck (Eds.). Eurographics Association, 113--117. https://doi.org/10.2312/eurovisshort.20181088Google Scholar
- Jonathan C. Roberts, Panagiotis D. Ritsos, Sriram Karthik Badam, Dominique Brodbeck, Jessie Kennedy, and Niklas Elmqvist. 2014. Visualization beyond the Desktop-the Next Big Thing. IEEE Computer Graphics and Applications, Vol. 34, 6 (2014), 26--34. https://doi.org/10.1109/MCG.2014.82Google Scholar
Cross Ref
- Richard C. Roberts, Robert S. Laramee, Gary A. Smith, Paul Brookes, and Tony D'Cruze. 2019. Smart Brushing for Parallel Coordinates. IEEE Trans. Vis. Comput. Graph., Vol. 25, 3 (2019), 1575--1590. https://doi.org/10.1109/TVCG.2018.2808969Google Scholar
Cross Ref
- George G. Robertson, Mary Czerwinski, Patrick Baudisch, Brian Meyers, Daniel C. Robbins, Greg Smith, and Desney S. Tan. 2005. The Large-Display User Experience. IEEE Computer Graphics and Applications, Vol. 25, 4 (2005), 44--51. https://doi.org/10.1109/MCG.2005.88Google Scholar
Digital Library
- V'i t Rusná k, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 142. https://doi.org/10.1145/3173574.3173716Google Scholar
- Jeffrey M. Rzeszotarski and Aniket Kittur. 2014. Kinetica: naturalistic multi-touch data visualization. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 897--906. https://doi.org/10.1145/2556288.2557231Google Scholar
- Ramik Sadana, Meeshu Agnihotri, and John T. Stasko. 2018. Touching Data: A Discoverability-based Evaluation of a Visualization Interface for Tablet Computers. CoRR, Vol. abs/1806.06084 (2018). arxiv: 1806.06084 http://arxiv.org/abs/1806.06084Google Scholar
- Ramik Sadana and John T. Stasko. 2014. Designing and implementing an interactive scatterplot visualization for a tablet computer. In International Working Conference on Advanced Visual Interfaces, AVI 2014, Como, Italy, May 27--29, 2014, Paolo Paolini and Franca Garzotto (Eds.). ACM, 265--272. https://doi.org/10.1145/2598153.2598163Google Scholar
Digital Library
- Ramik Sadana and John T. Stasko. 2016. Designing Multiple Coordinated Visualizations for Tablets. Comput. Graph. Forum, Vol. 35, 3 (2016), 261--270. https://doi.org/10.1111/cgf.12902Google Scholar
Digital Library
- Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In CHI '20: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, April 25--30, 2020, Regina Bernhaupt, Florian 'Floyd' Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjøn, Shengdong Zhao, Briane Paul Samson, and Rafal Kocielnik (Eds.). ACM, 1--13. https://doi.org/10.1145/3313831.3376782Google Scholar
- Theophanis Tsandilas, Anastasia Bezerianos, and Thibaut Jacob. 2015. SketchSliders: Sketching Widgets for Visual Exploration on Wall Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3255--3264. https://doi.org/10.1145/2702123.2702129Google Scholar
Digital Library
- Ulrich von Zadow, Wolfgang Bü schel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS 2014, Dresden, Germany, November 16 - 19, 2014, Raimund Dachselt, T. C. Nicholas Graham, Kasper Hornbæk, and Miguel A. Nacenta (Eds.). ACM, 129--138. https://doi.org/10.1145/2669485.2669507Google Scholar
Digital Library
- Bowen Yu and Xiaoru Yuan. 2011. Parallel Coordinates on iPad. In Poster Proceedings of IEEE Pacific Visualization Symposium (PacificVis 2011). IEEE, 21--22.Google Scholar
Index Terms
Multitouch Interaction with Parallel Coordinates on Large Vertical Displays
Recommendations
Effects of the Display Angle and Physical Size on Large Touch Displays in the Work Place
ISS '17: Proceedings of the 2017 ACM International Conference on Interactive Surfaces and SpacesLarge display and touch screens are becoming ubiquitous within the work place including multiple display screens. There is limited evidence on what configurations and arrangements of the display screens are most effective for data analysis. We conducted ...
Screen arrangements and interaction areas for large display work places
PerDis '16: Proceedings of the 5th ACM International Symposium on Pervasive DisplaysSize and resolution of computer screens are constantly increasing. Individual screens can easily be combined to wall-sized displays. This enables computer displays that are folded, straight, bow shaped or even spread. As possibilities for arranging the ...
Towards standardized distributed multitouch interaction
MindTrek '09: Proceedings of the 13th International MindTrek Conference: Everyday Life in the Ubiquitous EraWe introduce an extension of an existing interaction framework that allows a grouping of input data in multitouch (MT) setups to "hands", "users" and "pens". The data of users and pens is analyzed by an interaction wrapper that informs registered ...






Comments