skip to main content
research-article

Multitouch Interaction with Parallel Coordinates on Large Vertical Displays

Authors Info & Claims
Published:04 November 2020Publication History
Skip Abstract Section

Abstract

This paper presents a multitouch vocabulary for interacting with parallel coordinates plots on wall-sized displays. The gesture set relies on principles such as two-finger range definition, a functional distinction of background and foreground for applying the Hold-and-Move concept to wall-sized displays as well as fling-based interaction for triggering and controlling long-range movements. Our implementation demonstrates that out-of-reach problems and limitations regarding multitouch technology and display size can be tackled by the coherent integration of our multitouch gestures. Expert reviews indicate that our gesture vocabulary helps to solve typical analysis tasks that require interaction beyond arms' reach, and it also shows how often certain gestures were used.

Skip Supplemental Material Section

Supplemental Material

V4issA199.mp4

Supplemental video

References

  1. Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the 28th International Conference on Human Factors in Computing Systems, CHI 2010, Atlanta, Georgia, USA, April 10--15, 2010, Elizabeth D. Mynatt, Don Schoner, Geraldine Fitzpatrick, Scott E. Hudson, W. Keith Edwards, and Tom Rodden (Eds.). ACM, 55--64. https://doi.org/10.1145/1753326.1753336Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Christopher Andrews, Alex Endert, Beth Yost, and Chris North. 2011. Information visualization on large, high-resolution displays: Issues, challenges, and opportunities. Information Visualization, Vol. 10, 4 (2011), 341--355. https://doi.org/10.1177/1473871611415997Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Robert Ball and Chris North. 2007. Realizing embodied interaction for visual analytics through large displays. Comput. Graph., Vol. 31, 3 (2007), 380--400. https://doi.org/10.1016/j.cag.2007.01.029Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Robert Ball, Chris North, and Doug A. Bowman. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the 2007 Conference on Human Factors in Computing Systems, CHI 2007, San Jose, California, USA, April 28 - May 3, 2007, Mary Beth Rosson and David J. Gilmore (Eds.). ACM, 191--200. https://doi.org/10.1145/1240624.1240656Google ScholarGoogle Scholar
  5. Dominikus Baur, Bongshin Lee, and Sheelagh Carpendale. 2012. TouchWave: kinetic multi-touch manipulation for hierarchical stacked graphs. In Interactive Tabletops and Surfaces, ITS'12, Cambridge/Boston, MA, USA, November 11--14, 2012, Orit Shaer, Chia Shen, Meredith Ringel Morris, and Michael S. Horn (Eds.). ACM, 255--264. https://doi.org/10.1145/2396636.2396675Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Anastasia Bezerianos and Petra Isenberg. 2012. Perception of Visual Variables on Tiled Wall-Sized Displays for Information Visualization Applications. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2516--2525. https://doi.org/10.1109/TVCG.2012.251Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. John Brooke. 1996. SUS--A quick and dirty usability scale. Usability evaluation in industry, Vol. 189, 194 (1996), 4--7.Google ScholarGoogle Scholar
  8. Thorsten Bü ring, Jens Gerken, and Harald Reiterer. 2006. User Interaction with Scatterplots on Small Screens - A Comparative Evaluation of Geometric-Semantic Zoom and Fisheye Distortion. IEEE Trans. Vis. Comput. Graph., Vol. 12, 5 (2006), 829--836. https://doi.org/10.1109/TVCG.2006.187Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Mohammad Chegini, Shao Lin, Dirk Joachim Lehmann, Keith Andrews, and Tobias Schreck. 2017. Interaction Concepts for Collaborative Visual Analysis of Scatterplots on Large Vertically-Mounted High-Resolution Multi-Touch Displays. In Proceedings of the 10th Forum Media Technology and 3rd All Around Audio Symposium, St. Pö lten, Austria, November 29--30, 2017 (CEUR Workshop Proceedings, Vol. 2009),, Wolfgang Aigner, Thomas Moser, Kerstin Blumenstein, Matthias Zeppelzauer, Michael Iber, and Grischa Schmiedl (Eds.). CEUR-WS.org, 90--96. http://ceur-ws.org/Vol-2009/fmt-proceedings-2017-paper13.pdfGoogle ScholarGoogle Scholar
  10. Raimund Dachselt and Robert Buchholz. 2009. Natural throw and tilt interaction between mobile phones and distant displays. In Proceedings of the 27th International Conference on Human Factors in Computing Systems, CHI 2009, Extended Abstracts Volume, Boston, MA, USA, April 4--9, 2009, Dan R. Olsen Jr., Richard B. Arthur, Ken Hinckley, Meredith Ringel Morris, Scott E. Hudson, and Saul Greenberg (Eds.). ACM, 3253--3258. https://doi.org/10.1145/1520340.1520467Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Steven Mark Drucker, Danyel Fisher, Ramik Sadana, Jessica Herron, and m. c. schraefel. 2013. TouchViz: a case study comparing two interfaces for data analytics on tablets. In 2013 ACM SIGCHI Conference on Human Factors in Computing Systems, CHI '13, Paris, France, April 27 - May 2, 2013, Wendy E. Mackay, Stephen A. Brewster, and Susanne Bødker (Eds.). ACM, 2301--2310. https://doi.org/10.1145/2470654.2481318Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Niklas Elmqvist, Pierre Dragicevic, and Jean-Daniel Fekete. 2008. Rolling the Dice: Multidimensional Visual Exploration using Scatterplot Matrix Navigation. IEEE Trans. Vis. Comput. Graph., Vol. 14, 6 (2008), 1539--1148. https://doi.org/10.1109/TVCG.2008.153Google ScholarGoogle ScholarCross RefCross Ref
  13. G. W. Furnas. 1986. Generalized Fisheye Views. SIGCHI Bull., Vol. 17, 4 (April 1986), 16--23. https://doi.org/10.1145/22339.22342Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jé ré mie Gilliot, Gé ry Casiez, and Nicolas Roussel. 2014. Direct and indirect multi-touch interaction on a wall display. In Proceedings of the 26th Conference on l'Interaction Homme-Machine, Villeneuve d'Ascq, France, October 28--31, 2014, Gé ry Casiez, Thomas Pietrzak, Olivier Chapuis, and Sté phane Conversy (Eds.). ACM, 147--152. https://doi.org/10.1145/2670444.2670445Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Faizan Haque, Mathieu Nancel, and Daniel Vogel. 2015. Myopoint: Pointing and Clicking Using Forearm Mounted Electromyography and Inertial Motion Sensors. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3653--3656. https://doi.org/10.1145/2702123.2702133Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Mathias Heilig, Stephan Huber, Mischa Demarmels, and Harald Reiterer. 2010. ScatterTouch: a multi touch rubber sheet scatter plot visualization for co-located data exploration. In ACM International Conference on Interactive Tabletops and Surfaces, ITS 2010, Saarbrü cken, Germany, November 7--10, 2010, Antonio Krü ger, Johannes Schö ning, Daniel Wigdor, and Michael Haller (Eds.). ACM, 263--264. https://doi.org/10.1145/1936652.1936707Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Julian Heinrich and Daniel Weiskopf. 2013. State of the Art of Parallel Coordinates. In Eurographics 2013 - State of the Art Reports, Girona, Spain, May 6--10, 2013, Mateu Sbert and Lá szló Szirmay-Kalos (Eds.). Eurographics Association, 95--116. https://doi.org/10.2312/conf/EG2013/stars/095--116Google ScholarGoogle Scholar
  18. Tom Horak, Sriram Karthik Badam, Niklas Elmqvist, and Raimund Dachselt. 2018. When David Meets Goliath: Combining Smartwatches with a Large Vertical Display for Visual Data Exploration. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 19. https://doi.org/10.1145/3173574.3173593Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Mikkel R. Jakobsen and Kasper Hornbæk. 2015. Is Moving Improving?: Some Effects of Locomotion in Wall-Display Interaction. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 4169--4178. https://doi.org/10.1145/2702123.2702312Google ScholarGoogle Scholar
  20. Ulrike Kister, Konstantin Klamka, Christian Tominski, and Raimund Dachselt. 2017. GraSp: Combining Spatially-aware Mobile Devices and a Display Wall for Graph Visualization and Interaction. Comput. Graph. Forum, Vol. 36, 3 (2017), 503--514. https://doi.org/10.1111/cgf.13206Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Robert Kosara. 2011. Indirect multi-touch interaction for brushing in parallel coordinates. In Visualization and Data Analysis 2011, San Francisco Airport, CA, USA, January 24--25, 2011 (SPIE Proceedings, Vol. 7868),, Pak Chung Wong, Jinah Park, Ming C. Hao, Chaomei Chen, Katy Bö rner, David L. Kao, and Jonathan C. Roberts (Eds.). SPIE, 786809. https://doi.org/10.1117/12.872645Google ScholarGoogle ScholarCross RefCross Ref
  22. Alexander Kulik, Jan Dittrich, and Bernd Froehlich. 2012. The hold-and-move gesture for multi-touch interfaces. In Mobile HCI '12, Proceedings of the 14th international conference on Human-computer interaction with mobile devices and services, San Francsico, CA, USA, September 21--24, 2012, Elizabeth F. Churchill, Sriram Subramanian, Patrick Baudisch, and Kenton O'Hara (Eds.). ACM, 49--58. https://doi.org/10.1145/2371574.2371583Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ricardo Langner, Ulrike Kister, and Raimund Dachselt. 2019. Multiple Coordinated Views at Large Displays for Multiple Users: Empirical Findings on User Behavior, Movements, and Distances. IEEE Trans. Vis. Comput. Graph., Vol. 25, 1 (2019), 608--618. https://doi.org/10.1109/TVCG.2018.2865235Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Bongshin Lee, Petra Isenberg, Nathalie Henry Riche, and Sheelagh Carpendale. 2012. Beyond Mouse and Keyboard: Expanding Design Considerations for Information Visualization Interactions. IEEE Trans. Vis. Comput. Graph., Vol. 18, 12 (2012), 2689--2698. https://doi.org/10.1109/TVCG.2012.204Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Pawel Wozniak. 2017. Interaction techniques for window management on large high-resolution displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia, MUM 2017, Stuttgart, Germany, November 26 - 29, 2017, Niels Henze, Pawel Wozniak, Kaisa V"a "a n"a nen, Julie Williamson, and Stefan Schneegass (Eds.). ACM, 241--247. https://doi.org/10.1145/3152832.3152852Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Can Liu, Olivier Chapuis, Michel Beaudouin-Lafon, Eric Lecolinet, and Wendy E. Mackay. 2014. Effects of display size and navigation type on a classification task. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 4147--4156. https://doi.org/10.1145/2556288.2557020Google ScholarGoogle Scholar
  27. Mingyu Liu, Mathieu Nancel, and Daniel Vogel. 2015. Gunslinger: Subtle Arms-down Mid-air Interaction. In Proceedings of the 28th Annual ACM Symposium on User Interface Software & Technology, UIST 2015, Charlotte, NC, USA, November 8--11, 2015, Celine Latulipe, Bjoern Hartmann, and Tovi Grossman (Eds.). ACM, 63--71. https://doi.org/10.1145/2807442.2807489Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Meredith Ringel Morris, Andreea Danielescu, Steven Mark Drucker, Danyel Fisher, Bongshin Lee, m. c. schraefel, and Jacob O. Wobbrock. 2014. Reducing legacy bias in gesture elicitation studies. Interactions, Vol. 21, 3 (2014), 40--45. https://doi.org/10.1145/2591689Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Mathieu Nancel, Julie Wagner, Emmanuel Pietriga, Olivier Chapuis, and Wendy E. Mackay. 2011. Mid-air pan-and-zoom on wall-sized displays. In Proceedings of the International Conference on Human Factors in Computing Systems, CHI 2011, Vancouver, BC, Canada, May 7--12, 2011, Desney S. Tan, Saleema Amershi, Bo Begole, Wendy A. Kellogg, and Manas Tungare (Eds.). ACM, 177--186. https://doi.org/10.1145/1978942.1978969Google ScholarGoogle Scholar
  30. Jakob Nielsen. 1993. Usability engineering .Academic Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. PQLabs. [n.d.]. Support Center. https://www.pqlabs.com/support_wall.html. Accessed: 03/2019.Google ScholarGoogle Scholar
  32. Arnaud Prouzeau, Anastasia Bezerianos, and Olivier Chapuis. 2017. Evaluating Multi-User Selection for Exploring Graph Topology on Wall-Displays. IEEE Trans. Vis. Comput. Graph., Vol. 23, 8 (2017), 1936--1951. https://doi.org/10.1109/TVCG.2016.2592906Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Renata G. Raidou, Martin Eisemann, Marcel Breeuwer, Elmar Eisemann, and Anna Vilanova. 2016. Orientation-Enhanced Parallel Coordinate Plots. IEEE Trans. Vis. Comput. Graph., Vol. 22, 1 (2016), 589--598. https://doi.org/10.1109/TVCG.2015.2467872Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Fateme Rajabiyazdi, Jagoda Walny, Carrie Mah, John Brosz, and Sheelagh Carpendale. 2015. Understanding Researchers' Use of a Large, High-Resolution Display Across Disciplines. In Proceedings of the 2015 International Conference on Interactive Tabletops & Surfaces, ITS 2015, Funchal, Portugal, November 15--18, 2015, Nuno Jardim Nunes, Enrico Costanza, Patrick Olivier, and Johannes Schö ning (Eds.). ACM, 107--116. https://doi.org/10.1145/2817721.2817735Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Khairi Reda, Andrew E. Johnson, Michael E. Papka, and Jason Leigh. 2015. Effects of Display Size and Resolution on User Behavior and Insight Acquisition in Visual Exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 2759--2768. https://doi.org/10.1145/2702123.2702406Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Patrick Riehmann, Gabriela Molina León, Joshua Reibert, Florian Echtler, and Bernd Froehlich. 2020. Short-Contact Touch-Manipulation of Scatterplot Matrices on Wall Displays. Computer Graphics Forum (2020). https://doi.org/10.1111/cgf.13979Google ScholarGoogle Scholar
  37. Patrick Riehmann, Joshua Reibert, Jens Opolka, and Bernd Frö hlich. 2018. Touch the Time: Touch-Centered Interaction Paradigms for Time-Oriented Data. In Eurographics Conference on Visualization, EuroVis 2018, Short Papers, Brno, Czech Republic, 4--8 June 2018, Jimmy Johansson, Filip Sadlo, and Tobias Schreck (Eds.). Eurographics Association, 113--117. https://doi.org/10.2312/eurovisshort.20181088Google ScholarGoogle Scholar
  38. Jonathan C. Roberts, Panagiotis D. Ritsos, Sriram Karthik Badam, Dominique Brodbeck, Jessie Kennedy, and Niklas Elmqvist. 2014. Visualization beyond the Desktop-the Next Big Thing. IEEE Computer Graphics and Applications, Vol. 34, 6 (2014), 26--34. https://doi.org/10.1109/MCG.2014.82Google ScholarGoogle ScholarCross RefCross Ref
  39. Richard C. Roberts, Robert S. Laramee, Gary A. Smith, Paul Brookes, and Tony D'Cruze. 2019. Smart Brushing for Parallel Coordinates. IEEE Trans. Vis. Comput. Graph., Vol. 25, 3 (2019), 1575--1590. https://doi.org/10.1109/TVCG.2018.2808969Google ScholarGoogle ScholarCross RefCross Ref
  40. George G. Robertson, Mary Czerwinski, Patrick Baudisch, Brian Meyers, Daniel C. Robbins, Greg Smith, and Desney S. Tan. 2005. The Large-Display User Experience. IEEE Computer Graphics and Applications, Vol. 25, 4 (2005), 44--51. https://doi.org/10.1109/MCG.2005.88Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. V'i t Rusná k, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing Coherent Gesture Sets for Multi-scale Navigation on Tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems, CHI 2018, Montreal, QC, Canada, April 21--26, 2018, Regan L. Mandryk, Mark Hancock, Mark Perry, and Anna L. Cox (Eds.). ACM, 142. https://doi.org/10.1145/3173574.3173716Google ScholarGoogle Scholar
  42. Jeffrey M. Rzeszotarski and Aniket Kittur. 2014. Kinetica: naturalistic multi-touch data visualization. In CHI Conference on Human Factors in Computing Systems, CHI'14, Toronto, ON, Canada - April 26 - May 01, 2014, Matt Jones, Philippe A. Palanque, Albrecht Schmidt, and Tovi Grossman (Eds.). ACM, 897--906. https://doi.org/10.1145/2556288.2557231Google ScholarGoogle Scholar
  43. Ramik Sadana, Meeshu Agnihotri, and John T. Stasko. 2018. Touching Data: A Discoverability-based Evaluation of a Visualization Interface for Tablet Computers. CoRR, Vol. abs/1806.06084 (2018). arxiv: 1806.06084 http://arxiv.org/abs/1806.06084Google ScholarGoogle Scholar
  44. Ramik Sadana and John T. Stasko. 2014. Designing and implementing an interactive scatterplot visualization for a tablet computer. In International Working Conference on Advanced Visual Interfaces, AVI 2014, Como, Italy, May 27--29, 2014, Paolo Paolini and Franca Garzotto (Eds.). ACM, 265--272. https://doi.org/10.1145/2598153.2598163Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Ramik Sadana and John T. Stasko. 2016. Designing Multiple Coordinated Visualizations for Tablets. Comput. Graph. Forum, Vol. 35, 3 (2016), 261--270. https://doi.org/10.1111/cgf.12902Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Arjun Srinivasan, Bongshin Lee, Nathalie Henry Riche, Steven M. Drucker, and Ken Hinckley. 2020. InChorus: Designing Consistent Multimodal Interactions for Data Visualization on Tablet Devices. In CHI '20: CHI Conference on Human Factors in Computing Systems, Honolulu, HI, USA, April 25--30, 2020, Regina Bernhaupt, Florian 'Floyd' Mueller, David Verweij, Josh Andres, Joanna McGrenere, Andy Cockburn, Ignacio Avellino, Alix Goguey, Pernille Bjøn, Shengdong Zhao, Briane Paul Samson, and Rafal Kocielnik (Eds.). ACM, 1--13. https://doi.org/10.1145/3313831.3376782Google ScholarGoogle Scholar
  47. Theophanis Tsandilas, Anastasia Bezerianos, and Thibaut Jacob. 2015. SketchSliders: Sketching Widgets for Visual Exploration on Wall Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems, CHI 2015, Seoul, Republic of Korea, April 18--23, 2015, Bo Begole, Jinwoo Kim, Kori Inkpen, and Woontack Woo (Eds.). ACM, 3255--3264. https://doi.org/10.1145/2702123.2702129Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Ulrich von Zadow, Wolfgang Bü schel, Ricardo Langner, and Raimund Dachselt. 2014. SleeD: Using a Sleeve Display to Interact with Touch-sensitive Display Walls. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces, ITS 2014, Dresden, Germany, November 16 - 19, 2014, Raimund Dachselt, T. C. Nicholas Graham, Kasper Hornbæk, and Miguel A. Nacenta (Eds.). ACM, 129--138. https://doi.org/10.1145/2669485.2669507Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Bowen Yu and Xiaoru Yuan. 2011. Parallel Coordinates on iPad. In Poster Proceedings of IEEE Pacific Visualization Symposium (PacificVis 2011). IEEE, 21--22.Google ScholarGoogle Scholar

Index Terms

  1. Multitouch Interaction with Parallel Coordinates on Large Vertical Displays

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!