skip to main content
research-article

Maps Around Me: 3D Multiview Layouts in Immersive Spaces

Published:04 November 2020Publication History
Skip Abstract Section

Abstract

Visual exploration of maps often requires a contextual understanding at multiple scales and locations. Multiview map layouts, which present a hierarchy of multiple views to reveal detail at various scales and locations, have been shown to support better performance than traditional single-view exploration on desktop displays. This paper investigates the extension of such layouts of 2D maps into 3D immersive spaces, which are not limited by the real-estate barrier of physical screens and support sensemaking through spatial interaction. Based on our initial implementation of immersive multiview maps, we conduct an exploratory study with 16 participants aimed at understanding how people place and view such maps in immersive space. We observe the layouts produced by users performing map exploration search, comparison and route-planning tasks. Our qualitative analysis identifies patterns in layoutgeometry (spherical, spherical cap, planar),overview-detail relationship (central window, occluding, coordinated) andinteraction strategy. Based on these observations, along with qualitative feedback from a user walkthrough session, we identify implications and recommend features for immersive multiview map systems. Our main findings are that participants tend to prefer and arrange multiview maps in a spherical cap layout around them and that they often rearrange the views during tasks.

Skip Supplemental Material Section

Supplemental Material

V4issA201.mp4

Supplemental video

References

  1. R. Alghofaili, M. S. Solah, H. Huang, Y. Sawahata , M. Pomplun, and L. Yu. 2019. Optimizing Visual Element Placement via Visual Attention Analysis. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 464--473.Google ScholarGoogle Scholar
  2. Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 55--64.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Christopher Andrews and Chris North. 2012. Analyst's Workspace: An embodied sensemaking environment for large, high-resolution displays. In 2012 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE, 123--131.Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Gennady Andrienko, Natalia Andrienko, Urska Demsar, Doris Dransch, Jason Dykes, Sara Irina Fabrikant, Mikael Jern, Menno-Jan Kraak, Heidrun Schumann, and Christian Tominski. 2010. Space, time and visual analytics. International Journal of Geographical Information Science , Vol. 24, 10 (2010), 1577--1600.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Christopher R Austin, Barrett Ens, Kadek Ananta Satriadi, and Bernhard Jenny. 2020. Elicitation study investigating hand and foot gesture interaction for immersive maps in augmented reality. Cartography and Geographic Information Science , Vol. 47, 3 (2020), 214--228.Google ScholarGoogle ScholarCross RefCross Ref
  6. Robert Ball and Chris North. 2005. Effects of tiled high-resolution display on basic visualization and navigation tasks. In CHI'05 Extended Abstracts on Human Factors in Computing Systems. ACM, 1196--1199.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Robert Ball, Chris North, and Doug A Bowman. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 191--200.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Robert Ball, Michael Varghese, Andrew Sabri, E Dana Cox, Chris Fierer, Matthew Peterson, Bill Carstensen, and Chris North. 2005. Evaluating the benefits of tiled displays for navigating maps. In IASTED International Conference on Human-Computer Interaction. 66--71.Google ScholarGoogle Scholar
  9. A. Batch, A. Cunningham, M. Cordeil, N. Elmqvist, T. Dwyer, B. H. Thomas , and K. Marriott. 2020. There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2020), 536--546.Google ScholarGoogle ScholarCross RefCross Ref
  10. Benjamin B Bederson and James D Hollan. 1994. PadGoogle ScholarGoogle Scholar
  11. : a zooming graphical interface for exploring alternate interface physics. In Proceedings of the 7th Annual ACM Symposium on User Interface Software and Technology. ACM, 17--26.Google ScholarGoogle Scholar
  12. Christophe Bortolaso, Matthew Oskamp, Greg Phillips, Carl Gutwin, and TC Graham. 2014. The effect of view techniques on collaboration and awareness in tabletop map-based tasks. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces. ACM, 79--88.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning Naturalism in 3D User Interfaces. Commun. ACM , Vol. 55, 9 (Sept. 2012), 78--88.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Felix Brodkorb, Arjan Kuijper, Gennady Andrienko, Natalia Andrienko, and Tatiana Von Landesberger. 2016. Overview with details for exploring geo-located graphs on maps. Information Visualization , Vol. 15, 3 (2016), 214--237.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Simon Butscher, Kasper Hornbæk, and Harald Reiterer. 2014. SpaceFold and PhysicLenses: simultaneous multifocus navigation on touch surfaces. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces . ACM, 209--216.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Tom Chandler, Maxime Cordeil, Tobias Czauderna, Tim Dwyer, Jaroslaw Glowacki, Cagatay Goncu, Matthias Klapperstueck, Karsten Klein, Kim Marriott, Falk Schreiber, et almbox. 2015. Immersive analytics. In 2015 Big Data Visual Analytics (BDVA). IEEE, 1--8.Google ScholarGoogle Scholar
  17. Andy Cockburn, Amy Karlson, and Benjamin B Bederson. 2009. A review of overviewGoogle ScholarGoogle Scholar
  18. detail, zooming, and focusGoogle ScholarGoogle Scholar
  19. context interfaces. ACM Computing Surveys (CSUR) , Vol. 41, 1, Article 2 (2009), bibinfonumpages31 pages.Google ScholarGoogle Scholar
  20. Andy Cockburn and Bruce McKenzie. 2001. 3D or not 3D? Evaluating the effect of the third dimension in a document management system. In Proceedings of the SIGCHI conference on Human factors in computing systems. 434--441.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Andy Cockburn and Bruce McKenzie. 2002. Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments. In Proceedings of the SIGCHI conference on Human factors in computing systems. 203--210.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Christopher Collins and Sheelagh Carpendale. 2007. VisLink: Revealing relationships amongst visualizations. IEEE Transactions on Visualization and Computer Graphics , Vol. 13, 6 (2007), 1192--1199.Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Maxime Cordeil, Andrew Cunningham, Tim Dwyer, Bruce H Thomas, and Kim Marriott. 2017. ImAxes: Immersive axes as embodied affordances for interactive multivariate data visualisation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 71--83.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Mary Czerwinski, Desney S Tan, and George G Robertson. 2002. Women take a wider view. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 195--202.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Niklas Elmqvist, Nathalie Henry, Yann Riche, and Jean-Daniel Fekete. 2008. Melange: space folding for multi-focus interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1333--1342.Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Niklas Elmqvist, Andrew Vande Moere, Hans-Christian Jetter, Daniel Cernea, Harald Reiterer, and TJ Jankun-Kelly. 2011. Fluid interaction for information visualization. Information Visualization , Vol. 10, 4 (2011), 327--340.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014b. Ethereal planes: a design framework for 2D information space in 3D mixed reality environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction. ACM, 2--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts Across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (Los Angeles, California, USA) (SUI '15). ACM, New York, NY, USA, 65--68.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Barrett M Ens, Rory Finnegan, and Pourang P Irani. 2014a. The personal cockpit: a spatial interface for effective task switching on head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3171--3180.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Andreas Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST '17). ACM, New York, NY, USA, 611--621.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. George W Furnas. 1986. Generalized fisheye views. SIGCHI Bulletin , Vol. 17, 4 (1986), 16--23.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. George W Furnas and Benjamin B Bederson. 1995. Space-scale diagrams: Understanding multiscale interfaces. In CHI, Vol. 95. 234--241.Google ScholarGoogle Scholar
  33. Sohaib Ghani, N Henry Riche, and Niklas Elmqvist. 2011. Dynamic Insets for Context-Aware Graph Navigation. In Computer Graphics Forum , Vol. 30. Wiley Online Library, 861--870.Google ScholarGoogle Scholar
  34. Yves Guiard and Michel Beaudouin-Lafon. 2004. Target acquisition in multiscale electronic worlds. International Journal of Human-Computer Studies , Vol. 61, 6 (2004), 875--905.Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Edward Twitchell Hall. 1966. The Hidden Dimension .Garden City, NY: Doubleday.Google ScholarGoogle Scholar
  36. Kasper Hornbæk and Erik Frøkjær. 2003. Reading patterns and usability in visualizations of electronic documents. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 10, 2 (2003), 119--149.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Alexandra Ion, Y-L Betty Chang, Michael Haller, Mark Hancock, and Stacey D Scott. 2013. Canyon: providing location awareness of multiple moving objects in a detail view on large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3149--3158.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Yvonne Jansen, Jonas Schjerlund, and Kasper Hornbæk. 2019. Effects of Locomotion and Visual Overview on Spatial Memory when Interacting with Wall Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Waqas Javed and Niklas Elmqvist. 2012. Exploring the design space of composite visualization. In 2012 IEEE Pacific Visualization Symposium. IEEE, 1--8.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Waqas Javed, Sohaib Ghani, and Niklas Elmqvist. 2012. Polyzoom: multiscale and multifocus exploration in 2d visual spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 287--296.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Charles Jekel. 2016. Obtaining Non-linear Orthotropic Material Models for PVC-Coated Polyester via Inverse Bubble Inflation. Thesis, Stellenbosch University. https://hdl.handle.net/10019.1/98627Google ScholarGoogle Scholar
  42. Susanne Jul and George W Furnas. 1998. Critical zones in desert fog: aids to multiscale navigation. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, 97--106.Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Pushpak Karnick, David Cline, Stefan Jeschke, Anshuman Razdan, and Peter Wonka. 2009. Route visualization using detail lenses. IEEE Transactions on Visualization and Computer Graphics , Vol. 16, 2 (2009), 235--247.Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Matthias Klapperstueck, Tobias Czauderna, Cagatay Goncu, Jaroslaw Glowacki, Tim Dwyer, Falk Schreiber, and Kim Marriott. 2018. ContextuWall: Multi-site collaboration using display walls. Journal of Visual Languages & Computing , Vol. 46 (2018), 35--42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Heidi Lam and Tamara Munzner. 2010. A guide to visual multi-level interface design from synthesis of empirical study evidence. Synthesis Lectures on Visualization , Vol. 1, 1 (2010), 1--117.Google ScholarGoogle ScholarCross RefCross Ref
  46. Nina Siu-Ngan Lam and Dale A Quattrochi. 1992. On the issues of scale, resolution, and fractal analysis in the mapping sciences. The Professional Geographer , Vol. 44, 1 (1992), 88--98.Google ScholarGoogle ScholarCross RefCross Ref
  47. Fritz Lekschas, Michael Behrisch, Benjamin Bach, Peter Kerpedjiev, Nils Gehlenborg, and Hanspeter Pfister. 2019. Pattern-Driven Navigation in 2D Multiscale Visualizations with Scalable Insets. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2019), 611--621.Google ScholarGoogle Scholar
  48. Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Paweł Wo'zniak. 2017. Interaction techniques for window management on large high-resolution displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia . 241--247.Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Lee Lisle, Xiaoyu Chen, JK Edward Gitre, Chris North, and Doug A Bowman. 2020. Evaluating the Benefits of the Immersive Space to Think. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 331--337.Google ScholarGoogle ScholarCross RefCross Ref
  50. Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2020. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 588--597.Google ScholarGoogle Scholar
  51. Zhicheng Liu and Jeffrey Heer. 2014. The effects of interactive latency on exploratory visual analysis. IEEE Transactions on Visualization and Computer Graphics , Vol. 20, 12 (2014), 2122--2131.Google ScholarGoogle ScholarCross RefCross Ref
  52. Zhicheng Liu and John Stasko. 2010. Mental models, visual reasoning and interaction in information visualization: A top-down perspective. IEEE Transactions on Visualization and Computer Graphics , Vol. 16, 6 (2010), 999--1008.Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Paul Lubos, Gerd Bruder, Oscar Ariza, and Frank Steinicke. 2016. Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI '16). ACM, New York, NY, USA, 13--22.Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. National Aeronautics and Space Administration (NASA). 1995. NASA-STD-3000: Man-Systems Integration Standards, Revision B, July 1995, Volume I. https://msis.jsc.nasa.gov/Google ScholarGoogle Scholar
  55. Tao Ni, Doug A Bowman, and Jian Chen. 2006. Increased display size and resolution improve task performance in information-rich virtual environments. In Proceedings of Graphics Interface 2006. Canadian Information Processing Society, 139--146.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Matthew Plumlee and Colin Ware. 2002. Zooming, multiple windows, and visual working memory. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM, 59--68.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Matthew D Plumlee and Colin Ware. 2006. Zooming versus multiple window interfaces: Cognitive costs of visual comparisons. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 13, 2 (2006), 179--209.Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Quang Quach and Bernhard Jenny. 2020. Immersive visualization with bar graphics. Cartography and Geographic Information Science (2020).Google ScholarGoogle Scholar
  59. Khairi Reda, Andrew E Johnson, Michael E Papka, and Jason Leigh. 2015. Effects of display size and resolution on user behavior and insight acquisition in visual exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2759--2768.Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. George Robertson, Mary Czerwinski, Kevin Larson, Daniel C Robbins, David Thiel, and Maarten Van Dantzich. 1998. Data mountain: using spatial memory for document management. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology . 153--162.Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. George Robertson, Maarten Van Dantzich, Daniel Robbins, Mary Czerwinski, Ken Hinckley, Kirsten Risden, David Thiel, and Vadim Gorokhovsky. 2000. The Task Gallery: a 3D window manager. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 494--501.Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. George G Robertson, Jock D Mackinlay, and SK Card. 1991. The perspective wall: Detail and context smoothly integrated. In Proceedings of ACM CHI , Vol. 91. 173--179.Google ScholarGoogle Scholar
  63. Chris Rooney, Alex Endert, Jean-Daniel Fekete, Kasper Hornbæk, and Chris North. 2013. Powerwall: int. workshop on interactive, ultra-high-resolution displays. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 3227--3230.Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Chris Rooney and Roy A Ruddle. 2015. HiReD: a high-resolution multi-window visualisation environment for cluster-driven displays. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 2--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Robert E Roth. 2013. An empirically-derived taxonomy of interaction primitives for interactive cartography and geovisualization. IEEE Transactions on Visualization and Computer Graphics , Vol. 19, 12 (2013), 2356--2365.Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Roy A Ruddle, Rhys G Thomas, Rebecca S Randell, Phil Quirke, and Darren Treanor. 2015. Performance and interaction behaviour during visual search on large, high-resolution displays. Information Visualization , Vol. 14, 2 (2015), 137--147.Google ScholarGoogle ScholarCross RefCross Ref
  67. V'it Rusnák, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing coherent gesture sets for multi-scale navigation on tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 1--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. K. A. Satriadi, B. Ens, M. Cordeil, B. Jenny , T. Czauderna, and W. Willett. 2019. Augmented Reality Map Navigation with Freehand Gestures. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 593--603.Google ScholarGoogle Scholar
  69. Lauren Shupp, Robert Ball, Beth Yost, John Booker, and Chris North. 2006. Evaluation of viewport size and curvature of large, high-resolution displays. In Proceedings of Graphics Interface 2006. Canadian Information Processing Society, 123--130.Google ScholarGoogle Scholar
  70. Monica Tavanti and Mats Lind. 2001. 2D vs 3D, implications on spatial memory. In IEEE Symposium on Information Visualization, 2001. INFOVIS 2001. IEEE, 139--145.Google ScholarGoogle ScholarCross RefCross Ref
  71. Lucia Terrenghi, Aaron Quigley, and Alan Dix. 2009. A taxonomy for and analysis of multi-person-display ecosystems. Personal and Ubiquitous Computing , Vol. 13, 8 (2009), 583--598.Google ScholarGoogle ScholarDigital LibraryDigital Library
  72. Sabine Timpf. 1998. Hierarchical structures in map series. Thesis, Department of Geoinformation, Technical University Vienna.Google ScholarGoogle Scholar
  73. Jorge A Wagner Filho, Wolfgang Stuerzlinger, and Luciana Nedel. 2019. Evaluating an immersive space-time cube geovisualization for intuitive trajectory data exploration. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2019), 514--524.Google ScholarGoogle ScholarCross RefCross Ref
  74. Fangzhou Wang, Yang Li, Daisuke Sakamoto, and Takeo Igarashi. 2014. Hierarchical route maps for efficient navigation. In Proceedings of the 19th International Conference on Intelligent User Interfaces. ACM, 169--178.Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Michelle Q Wang Baldonado, Allison Woodruff, and Allan Kuchinsky. 2000. Guidelines for using multiple views in information visualization. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM, 110--119.Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Daniel Wigdor and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture .Morgan Kaufmann.Google ScholarGoogle Scholar
  77. Yalong Yang, Maxime Cordeil, Johanna Beyer, Tim Dwyer, Kim Marriott, and Hanspeter Pfister. 2020 a. Embodied Navigation in Immersive Abstract Data Visualization: Is OverviewGoogle ScholarGoogle Scholar

Index Terms

  1. Maps Around Me: 3D Multiview Layouts in Immersive Spaces

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!