Abstract

Visual exploration of maps often requires a contextual understanding at multiple scales and locations. Multiview map layouts, which present a hierarchy of multiple views to reveal detail at various scales and locations, have been shown to support better performance than traditional single-view exploration on desktop displays. This paper investigates the extension of such layouts of 2D maps into 3D immersive spaces, which are not limited by the real-estate barrier of physical screens and support sensemaking through spatial interaction. Based on our initial implementation of immersive multiview maps, we conduct an exploratory study with 16 participants aimed at understanding how people place and view such maps in immersive space. We observe the layouts produced by users performing map exploration search, comparison and route-planning tasks. Our qualitative analysis identifies patterns in layoutgeometry (spherical, spherical cap, planar),overview-detail relationship (central window, occluding, coordinated) andinteraction strategy. Based on these observations, along with qualitative feedback from a user walkthrough session, we identify implications and recommend features for immersive multiview map systems. Our main findings are that participants tend to prefer and arrange multiview maps in a spherical cap layout around them and that they often rearrange the views during tasks.
Supplemental Material
Available for Download
The supplementary materials contain 1 pdf file and 2 folders. 1. MapsAroundMe_Supplementary_Materials.pdf, contains: - SP1. Observation Study Tasks - SP2. User Generated Layouts, describes how to run the viewer. Alternatively, the live version can be accessed on https://kadeksatriadi.github.io/Maps-Around-Me-Viewer/ - SP3. Clips of Interactions, shows short clips of interaction techniques. 2. interaction_clips folder contains the SP3 3. viewer folder contains the SP2
- R. Alghofaili, M. S. Solah, H. Huang, Y. Sawahata , M. Pomplun, and L. Yu. 2019. Optimizing Visual Element Placement via Visual Attention Analysis. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 464--473.Google Scholar
- Christopher Andrews, Alex Endert, and Chris North. 2010. Space to think: large high-resolution displays for sensemaking. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 55--64.Google Scholar
Digital Library
- Christopher Andrews and Chris North. 2012. Analyst's Workspace: An embodied sensemaking environment for large, high-resolution displays. In 2012 IEEE Conference on Visual Analytics Science and Technology (VAST). IEEE, 123--131.Google Scholar
Digital Library
- Gennady Andrienko, Natalia Andrienko, Urska Demsar, Doris Dransch, Jason Dykes, Sara Irina Fabrikant, Mikael Jern, Menno-Jan Kraak, Heidrun Schumann, and Christian Tominski. 2010. Space, time and visual analytics. International Journal of Geographical Information Science , Vol. 24, 10 (2010), 1577--1600.Google Scholar
Digital Library
- Christopher R Austin, Barrett Ens, Kadek Ananta Satriadi, and Bernhard Jenny. 2020. Elicitation study investigating hand and foot gesture interaction for immersive maps in augmented reality. Cartography and Geographic Information Science , Vol. 47, 3 (2020), 214--228.Google Scholar
Cross Ref
- Robert Ball and Chris North. 2005. Effects of tiled high-resolution display on basic visualization and navigation tasks. In CHI'05 Extended Abstracts on Human Factors in Computing Systems. ACM, 1196--1199.Google Scholar
Digital Library
- Robert Ball, Chris North, and Doug A Bowman. 2007. Move to improve: promoting physical navigation to increase user performance with large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 191--200.Google Scholar
Digital Library
- Robert Ball, Michael Varghese, Andrew Sabri, E Dana Cox, Chris Fierer, Matthew Peterson, Bill Carstensen, and Chris North. 2005. Evaluating the benefits of tiled displays for navigating maps. In IASTED International Conference on Human-Computer Interaction. 66--71.Google Scholar
- A. Batch, A. Cunningham, M. Cordeil, N. Elmqvist, T. Dwyer, B. H. Thomas , and K. Marriott. 2020. There Is No Spoon: Evaluating Performance, Space Use, and Presence with Expert Domain Users in Immersive Analytics. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2020), 536--546.Google Scholar
Cross Ref
- Benjamin B Bederson and James D Hollan. 1994. PadGoogle Scholar
- : a zooming graphical interface for exploring alternate interface physics. In Proceedings of the 7th Annual ACM Symposium on User Interface Software and Technology. ACM, 17--26.Google Scholar
- Christophe Bortolaso, Matthew Oskamp, Greg Phillips, Carl Gutwin, and TC Graham. 2014. The effect of view techniques on collaboration and awareness in tabletop map-based tasks. In Proceedings of the Ninth ACM International Conference on Interactive Tabletops and Surfaces. ACM, 79--88.Google Scholar
Digital Library
- Doug A. Bowman, Ryan P. McMahan, and Eric D. Ragan. 2012. Questioning Naturalism in 3D User Interfaces. Commun. ACM , Vol. 55, 9 (Sept. 2012), 78--88.Google Scholar
Digital Library
- Felix Brodkorb, Arjan Kuijper, Gennady Andrienko, Natalia Andrienko, and Tatiana Von Landesberger. 2016. Overview with details for exploring geo-located graphs on maps. Information Visualization , Vol. 15, 3 (2016), 214--237.Google Scholar
Digital Library
- Simon Butscher, Kasper Hornbæk, and Harald Reiterer. 2014. SpaceFold and PhysicLenses: simultaneous multifocus navigation on touch surfaces. In Proceedings of the 2014 International Working Conference on Advanced Visual Interfaces . ACM, 209--216.Google Scholar
Digital Library
- Tom Chandler, Maxime Cordeil, Tobias Czauderna, Tim Dwyer, Jaroslaw Glowacki, Cagatay Goncu, Matthias Klapperstueck, Karsten Klein, Kim Marriott, Falk Schreiber, et almbox. 2015. Immersive analytics. In 2015 Big Data Visual Analytics (BDVA). IEEE, 1--8.Google Scholar
- Andy Cockburn, Amy Karlson, and Benjamin B Bederson. 2009. A review of overviewGoogle Scholar
- detail, zooming, and focusGoogle Scholar
- context interfaces. ACM Computing Surveys (CSUR) , Vol. 41, 1, Article 2 (2009), bibinfonumpages31 pages.Google Scholar
- Andy Cockburn and Bruce McKenzie. 2001. 3D or not 3D? Evaluating the effect of the third dimension in a document management system. In Proceedings of the SIGCHI conference on Human factors in computing systems. 434--441.Google Scholar
Digital Library
- Andy Cockburn and Bruce McKenzie. 2002. Evaluating the effectiveness of spatial memory in 2D and 3D physical and virtual environments. In Proceedings of the SIGCHI conference on Human factors in computing systems. 203--210.Google Scholar
Digital Library
- Christopher Collins and Sheelagh Carpendale. 2007. VisLink: Revealing relationships amongst visualizations. IEEE Transactions on Visualization and Computer Graphics , Vol. 13, 6 (2007), 1192--1199.Google Scholar
Digital Library
- Maxime Cordeil, Andrew Cunningham, Tim Dwyer, Bruce H Thomas, and Kim Marriott. 2017. ImAxes: Immersive axes as embodied affordances for interactive multivariate data visualisation. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology. ACM, 71--83.Google Scholar
Digital Library
- Mary Czerwinski, Desney S Tan, and George G Robertson. 2002. Women take a wider view. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 195--202.Google Scholar
Digital Library
- Niklas Elmqvist, Nathalie Henry, Yann Riche, and Jean-Daniel Fekete. 2008. Melange: space folding for multi-focus interaction. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1333--1342.Google Scholar
Digital Library
- Niklas Elmqvist, Andrew Vande Moere, Hans-Christian Jetter, Daniel Cernea, Harald Reiterer, and TJ Jankun-Kelly. 2011. Fluid interaction for information visualization. Information Visualization , Vol. 10, 4 (2011), 327--340.Google Scholar
Digital Library
- Barrett Ens, Juan David Hincapié-Ramos, and Pourang Irani. 2014b. Ethereal planes: a design framework for 2D information space in 3D mixed reality environments. In Proceedings of the 2nd ACM Symposium on Spatial User Interaction. ACM, 2--12.Google Scholar
Digital Library
- Barrett Ens, Eyal Ofek, Neil Bruce, and Pourang Irani. 2015. Spatial Constancy of Surface-Embedded Layouts Across Multiple Environments. In Proceedings of the 3rd ACM Symposium on Spatial User Interaction (Los Angeles, California, USA) (SUI '15). ACM, New York, NY, USA, 65--68.Google Scholar
Digital Library
- Barrett M Ens, Rory Finnegan, and Pourang P Irani. 2014a. The personal cockpit: a spatial interface for effective task switching on head-worn displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3171--3180.Google Scholar
Digital Library
- Andreas Fender, David Lindlbauer, Philipp Herholz, Marc Alexa, and Jörg Müller. 2017. HeatSpace: Automatic Placement of Displays by Empirical Analysis of User Behavior. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (Québec City, QC, Canada) (UIST '17). ACM, New York, NY, USA, 611--621.Google Scholar
Digital Library
- George W Furnas. 1986. Generalized fisheye views. SIGCHI Bulletin , Vol. 17, 4 (1986), 16--23.Google Scholar
Digital Library
- George W Furnas and Benjamin B Bederson. 1995. Space-scale diagrams: Understanding multiscale interfaces. In CHI, Vol. 95. 234--241.Google Scholar
- Sohaib Ghani, N Henry Riche, and Niklas Elmqvist. 2011. Dynamic Insets for Context-Aware Graph Navigation. In Computer Graphics Forum , Vol. 30. Wiley Online Library, 861--870.Google Scholar
- Yves Guiard and Michel Beaudouin-Lafon. 2004. Target acquisition in multiscale electronic worlds. International Journal of Human-Computer Studies , Vol. 61, 6 (2004), 875--905.Google Scholar
Digital Library
- Edward Twitchell Hall. 1966. The Hidden Dimension .Garden City, NY: Doubleday.Google Scholar
- Kasper Hornbæk and Erik Frøkjær. 2003. Reading patterns and usability in visualizations of electronic documents. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 10, 2 (2003), 119--149.Google Scholar
Digital Library
- Alexandra Ion, Y-L Betty Chang, Michael Haller, Mark Hancock, and Stacey D Scott. 2013. Canyon: providing location awareness of multiple moving objects in a detail view on large displays. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 3149--3158.Google Scholar
Digital Library
- Yvonne Jansen, Jonas Schjerlund, and Kasper Hornbæk. 2019. Effects of Locomotion and Visual Overview on Spatial Memory when Interacting with Wall Displays. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--12.Google Scholar
Digital Library
- Waqas Javed and Niklas Elmqvist. 2012. Exploring the design space of composite visualization. In 2012 IEEE Pacific Visualization Symposium. IEEE, 1--8.Google Scholar
Digital Library
- Waqas Javed, Sohaib Ghani, and Niklas Elmqvist. 2012. Polyzoom: multiscale and multifocus exploration in 2d visual spaces. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 287--296.Google Scholar
Digital Library
- Charles Jekel. 2016. Obtaining Non-linear Orthotropic Material Models for PVC-Coated Polyester via Inverse Bubble Inflation. Thesis, Stellenbosch University. https://hdl.handle.net/10019.1/98627Google Scholar
- Susanne Jul and George W Furnas. 1998. Critical zones in desert fog: aids to multiscale navigation. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology. ACM, 97--106.Google Scholar
Digital Library
- Pushpak Karnick, David Cline, Stefan Jeschke, Anshuman Razdan, and Peter Wonka. 2009. Route visualization using detail lenses. IEEE Transactions on Visualization and Computer Graphics , Vol. 16, 2 (2009), 235--247.Google Scholar
Digital Library
- Matthias Klapperstueck, Tobias Czauderna, Cagatay Goncu, Jaroslaw Glowacki, Tim Dwyer, Falk Schreiber, and Kim Marriott. 2018. ContextuWall: Multi-site collaboration using display walls. Journal of Visual Languages & Computing , Vol. 46 (2018), 35--42.Google Scholar
Digital Library
- Heidi Lam and Tamara Munzner. 2010. A guide to visual multi-level interface design from synthesis of empirical study evidence. Synthesis Lectures on Visualization , Vol. 1, 1 (2010), 1--117.Google Scholar
Cross Ref
- Nina Siu-Ngan Lam and Dale A Quattrochi. 1992. On the issues of scale, resolution, and fractal analysis in the mapping sciences. The Professional Geographer , Vol. 44, 1 (1992), 88--98.Google Scholar
Cross Ref
- Fritz Lekschas, Michael Behrisch, Benjamin Bach, Peter Kerpedjiev, Nils Gehlenborg, and Hanspeter Pfister. 2019. Pattern-Driven Navigation in 2D Multiscale Visualizations with Scalable Insets. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2019), 611--621.Google Scholar
- Lars Lischke, Sven Mayer, Jan Hoffmann, Philipp Kratzer, Stephan Roth, Katrin Wolf, and Paweł Wo'zniak. 2017. Interaction techniques for window management on large high-resolution displays. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia . 241--247.Google Scholar
Digital Library
- Lee Lisle, Xiaoyu Chen, JK Edward Gitre, Chris North, and Doug A Bowman. 2020. Evaluating the Benefits of the Immersive Space to Think. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW). IEEE, 331--337.Google Scholar
Cross Ref
- Jiazhou Liu, Arnaud Prouzeau, Barrett Ens, and Tim Dwyer. 2020. Design and Evaluation of Interactive Small Multiples Data Visualisation in Immersive Spaces. In 2020 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). IEEE, 588--597.Google Scholar
- Zhicheng Liu and Jeffrey Heer. 2014. The effects of interactive latency on exploratory visual analysis. IEEE Transactions on Visualization and Computer Graphics , Vol. 20, 12 (2014), 2122--2131.Google Scholar
Cross Ref
- Zhicheng Liu and John Stasko. 2010. Mental models, visual reasoning and interaction in information visualization: A top-down perspective. IEEE Transactions on Visualization and Computer Graphics , Vol. 16, 6 (2010), 999--1008.Google Scholar
Digital Library
- Paul Lubos, Gerd Bruder, Oscar Ariza, and Frank Steinicke. 2016. Touching the Sphere: Leveraging Joint-Centered Kinespheres for Spatial User Interaction. In Proceedings of the 2016 Symposium on Spatial User Interaction (Tokyo, Japan) (SUI '16). ACM, New York, NY, USA, 13--22.Google Scholar
Digital Library
- National Aeronautics and Space Administration (NASA). 1995. NASA-STD-3000: Man-Systems Integration Standards, Revision B, July 1995, Volume I. https://msis.jsc.nasa.gov/Google Scholar
- Tao Ni, Doug A Bowman, and Jian Chen. 2006. Increased display size and resolution improve task performance in information-rich virtual environments. In Proceedings of Graphics Interface 2006. Canadian Information Processing Society, 139--146.Google Scholar
Digital Library
- Matthew Plumlee and Colin Ware. 2002. Zooming, multiple windows, and visual working memory. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM, 59--68.Google Scholar
Digital Library
- Matthew D Plumlee and Colin Ware. 2006. Zooming versus multiple window interfaces: Cognitive costs of visual comparisons. ACM Transactions on Computer-Human Interaction (TOCHI) , Vol. 13, 2 (2006), 179--209.Google Scholar
Digital Library
- Quang Quach and Bernhard Jenny. 2020. Immersive visualization with bar graphics. Cartography and Geographic Information Science (2020).Google Scholar
- Khairi Reda, Andrew E Johnson, Michael E Papka, and Jason Leigh. 2015. Effects of display size and resolution on user behavior and insight acquisition in visual exploration. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems. ACM, 2759--2768.Google Scholar
Digital Library
- George Robertson, Mary Czerwinski, Kevin Larson, Daniel C Robbins, David Thiel, and Maarten Van Dantzich. 1998. Data mountain: using spatial memory for document management. In Proceedings of the 11th Annual ACM Symposium on User Interface Software and Technology . 153--162.Google Scholar
Digital Library
- George Robertson, Maarten Van Dantzich, Daniel Robbins, Mary Czerwinski, Ken Hinckley, Kirsten Risden, David Thiel, and Vadim Gorokhovsky. 2000. The Task Gallery: a 3D window manager. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 494--501.Google Scholar
Digital Library
- George G Robertson, Jock D Mackinlay, and SK Card. 1991. The perspective wall: Detail and context smoothly integrated. In Proceedings of ACM CHI , Vol. 91. 173--179.Google Scholar
- Chris Rooney, Alex Endert, Jean-Daniel Fekete, Kasper Hornbæk, and Chris North. 2013. Powerwall: int. workshop on interactive, ultra-high-resolution displays. In CHI'13 Extended Abstracts on Human Factors in Computing Systems. 3227--3230.Google Scholar
Digital Library
- Chris Rooney and Roy A Ruddle. 2015. HiReD: a high-resolution multi-window visualisation environment for cluster-driven displays. In Proceedings of the 7th ACM SIGCHI Symposium on Engineering Interactive Computing Systems. 2--11.Google Scholar
Digital Library
- Robert E Roth. 2013. An empirically-derived taxonomy of interaction primitives for interactive cartography and geovisualization. IEEE Transactions on Visualization and Computer Graphics , Vol. 19, 12 (2013), 2356--2365.Google Scholar
Digital Library
- Roy A Ruddle, Rhys G Thomas, Rebecca S Randell, Phil Quirke, and Darren Treanor. 2015. Performance and interaction behaviour during visual search on large, high-resolution displays. Information Visualization , Vol. 14, 2 (2015), 137--147.Google Scholar
Cross Ref
- V'it Rusnák, Caroline Appert, Olivier Chapuis, and Emmanuel Pietriga. 2018. Designing coherent gesture sets for multi-scale navigation on tabletops. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems. ACM, 1--12.Google Scholar
Digital Library
- K. A. Satriadi, B. Ens, M. Cordeil, B. Jenny , T. Czauderna, and W. Willett. 2019. Augmented Reality Map Navigation with Freehand Gestures. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 593--603.Google Scholar
- Lauren Shupp, Robert Ball, Beth Yost, John Booker, and Chris North. 2006. Evaluation of viewport size and curvature of large, high-resolution displays. In Proceedings of Graphics Interface 2006. Canadian Information Processing Society, 123--130.Google Scholar
- Monica Tavanti and Mats Lind. 2001. 2D vs 3D, implications on spatial memory. In IEEE Symposium on Information Visualization, 2001. INFOVIS 2001. IEEE, 139--145.Google Scholar
Cross Ref
- Lucia Terrenghi, Aaron Quigley, and Alan Dix. 2009. A taxonomy for and analysis of multi-person-display ecosystems. Personal and Ubiquitous Computing , Vol. 13, 8 (2009), 583--598.Google Scholar
Digital Library
- Sabine Timpf. 1998. Hierarchical structures in map series. Thesis, Department of Geoinformation, Technical University Vienna.Google Scholar
- Jorge A Wagner Filho, Wolfgang Stuerzlinger, and Luciana Nedel. 2019. Evaluating an immersive space-time cube geovisualization for intuitive trajectory data exploration. IEEE Transactions on Visualization and Computer Graphics , Vol. 26, 1 (2019), 514--524.Google Scholar
Cross Ref
- Fangzhou Wang, Yang Li, Daisuke Sakamoto, and Takeo Igarashi. 2014. Hierarchical route maps for efficient navigation. In Proceedings of the 19th International Conference on Intelligent User Interfaces. ACM, 169--178.Google Scholar
Digital Library
- Michelle Q Wang Baldonado, Allison Woodruff, and Allan Kuchinsky. 2000. Guidelines for using multiple views in information visualization. In Proceedings of the Working Conference on Advanced Visual Interfaces. ACM, 110--119.Google Scholar
Digital Library
- Daniel Wigdor and Dennis Wixon. 2011. Brave NUI World: Designing Natural User Interfaces for Touch and Gesture .Morgan Kaufmann.Google Scholar
- Yalong Yang, Maxime Cordeil, Johanna Beyer, Tim Dwyer, Kim Marriott, and Hanspeter Pfister. 2020 a. Embodied Navigation in Immersive Abstract Data Visualization: Is OverviewGoogle Scholar
Index Terms
Maps Around Me: 3D Multiview Layouts in Immersive Spaces
Recommendations
Haptic around: multiple tactile sensations for immersive environment and interaction in virtual reality
VRST '18: Proceedings of the 24th ACM Symposium on Virtual Reality Software and TechnologyIn this paper, we present Haptic Around, a hybrid-haptic feedback system, which utilizes fan, hot air blower, mist creator and heat light to recreate multiple tactile sensations in virtual reality for enhancing the immersive environment and interaction. ...
Increasing Presence in Virtual Reality with a Vibrotactile Grid Around the Head
16th IFIP TC 13 International Conference on Human-Computer Interaction --- INTERACT 2017 - Volume 10516A high level of presence is an important aspect of immersive virtual reality applications. However, presence is difficult to achieve as it depends on the individual user, immersion capabilities of the system visual, auditory, and tactile and the ...
Interacting with large maps using HMDs in VR settings
MobileHCI '17: Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and ServicesLocation based services are a common application scenario in mobile and ubiquitous computing use. A typical issue with cartographic applications in this domain is the limited size of the displayed map, which makes interaction and visualization a ...






Comments