Abstract
Head-mounted displays (HMDs) increase immersion into virtual worlds. The problem is that this limits headset users' awareness of bystanders: headset users cannot attend to bystanders' presence and activities. We call this the HMD boundary. We explore how to make the HMD boundary permeable by comparing different ways of providing informal awareness cues to the headset user about bystanders. We adapted and implemented three visualization techniques (Avatar View, Radar and Presence++) that share bystanders' location and orientation with headset users. We conducted a hybrid user and simulation study with three different types of VR content (high, medium, low interactivity) with twenty participants to compare how these visualization techniques allow people to maintain an awareness of bystanders, and how they affect immersion (compared to a baseline condition). Our study reveals that a see-through avatar representation of bystanders was effective, but led to slightly reduced immersion in the VR content. Based on our findings, we discuss how future awareness visualization techniques can be designed to mitigate the reduction of immersion for the headset user.
Supplemental Material
Available for Download
Video figure captions
- Jérôme Ardouin, Anatole Lécuyer, Maud Marchal, Clément Riant, and Eric Marchand. 2012. FlyVIZ?: A Novel Display Device to Provide Humans with 360 ° Vision by Coupling Catadioptric Camera with HMD Categories and Subject Descriptors. In Proceedings of the 18th ACM symposium on Virtual reality software and technology (VRST '12): 41--44. https://doi.org/10.1145/2407336.2407344Google Scholar
Digital Library
- Pulkit Budhiraja, Rajinder Sodhi, Brett Jones, Kevin Karsch, Brian Bailey, and David Forsyth. 2015. Where's My Drink? Enabling Peripheral Real World Interactions While Using HMDs. arXiv:1502.04744Google Scholar
- Liwei Chan and Kouta Minamizawa. 2017. FrontFace: Facilitating Communication Between HMD Users and Outsiders Using Front-Facing-Screen HMDs. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17): 1--5. https://doi.org/10.1145/3098279.3098548Google Scholar
Digital Library
- T. Matthew Ciolek and Adam Kendon. 1980. Environment and the Spatial Arrangement of Conversational Encounters. Sociological Inquiry 50, 3--4: 237--271. https://doi.org/10.1111/j.1475--682X.1980.tb00022.xGoogle Scholar
- Herbert H. Clark. Using Language. 1996. Cambridge: Cambridge University Press. https://doi.org/10.1017/CBO9780511620539Google Scholar
Cross Ref
- Kody R. Dillman, Terrance Tin Hoi Mok, Anthony Tang, Lora Oehlberg, and Alex Mitchell. 2018. A Visual Interaction Cue Framework from Video Game Environments for Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--12. https://doi.org/10.1145/3173574.3173714Google Scholar
Digital Library
- Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM Conference on Computer Supported Cooperative Work (CSCW '92): 107--114. https://doi.org/10.1145/143457.143468Google Scholar
Digital Library
- Paul Dourish and Sara Bly. 1992. Portholes: supporting awareness in a distributed work group. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92): 541--547. https://doi.org/10.1145/142750.142982Google Scholar
Digital Library
- E.T.Hall. 1966. Hidden dimension. Garden city, N.Y., Doubleday.Google Scholar
- Robert S. Fish, Robert E. Kraut, and Barbara L. Chalfonte. 1990. The VideoWindow system in informal communication. In Proceedings of the 1990 ACM Conference on Computer Supported Cooperative Work (CSCW '90): 1--11. https://doi.org/10.1145/99332.99335Google Scholar
Digital Library
- Ceenu George, Philipp Janssen, David Heuss, and Florian Alt. 2019. Should I interrupt or not? Understanding interruptions in head-mounted display settings. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19): 497--510. https://doi.org/10.1145/3322276.3322363Google Scholar
Digital Library
- Sarthak Ghosh, Lauren Winston, Nishant Panchal, Philippe Kimura-Thollander, Jeff Hotnog, Douglas Cheong, Gabriel Reyes, and Gregory. D. Abowd. 2018. NotifiVR: Exploring Interruptions and Notifications in Virtual Reality. IEEE Transactions on Visualization and Computer Graphics 24, 4: 1447--1456. https://doi.org/10.1109/TVCG.2018.2793698Google Scholar
Digital Library
- Saul Greenberg. 1996. Peepholes: Low Cost Awareness of One's Community. In Conference Companion on Human Factors in Computing systems (CHI '96): 206--207. https://doi.org/10.1145/257089.257283Google Scholar
Digital Library
- Jan Gugenheimer, Evgeny Stemasov, Julian Frommel, and Enrico Rukzio. 2017. ShareVR: Enabling Co-Located Experiences for Virtual Reality between HMD and Non-HMD Users. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17): 4021--4033. https://doi.org/10.1145/3025453.3025683Google Scholar
Digital Library
- Jan Gugenheimer, Evgeny Stemasov, Harpreet Sareen, and Enrico Rukzio. 2018. FaceDisplay: Towards Asymmetric Multi-User Interaction for Nomadic Virtual Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--13. https://doi.org/10.1145/3173574.3173628Google Scholar
Digital Library
- Carl Gutwin and Saul Greenberg. 2002. A descriptive framework of workspace awareness for real-time groupware. Comput. Supported Coop. Work 11, 3: 411--446. https://doi.org/10.1023/A:1021271517844Google Scholar
Digital Library
- Jeremy Hartmann, Christian Holz, Eyal Ofek, and Andrew D. Wilson. 2019. RealityCheck: Blending virtual environments with situated physical reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19): 1--12. https://doi.org/10.1145/3290605.3300577Google Scholar
Digital Library
- Zhenyi He, Fengyuan Zhu, Ken Perlin, and Xiaojuan Ma. 2018. Manifest the invisible: Design for Situational Awareness of Physical Environments in Virtual Reality. arXiv:1809.05837Google Scholar
- Akira Ishii, Masaya Tsuruta, Ippei Suzuki, Shuta Nakamae, Junichi Suzuki, and Yoichi Ochiai. 2019. Let Your World Open: CAVE-based Visualization Methods of Public Virtual Reality towards a Shareable VR Experience. In Proceedings of the 10th Augmented Human International Conference 2019 (AH '19): 1--8. https://doi.org/10.1145/3311823.3311860Google Scholar
Digital Library
- Ikuo Kamei, Changyo Han, Takefumi Hiraki, Shogo Fukushima, and Takeshi Naemura. 2020. CoVR: Co-located Virtual Reality Experience Sharing for Facilitating Joint Attention via Projected View of HMD Users. In SIGGRAPH Asia 2020 Emerging Technologies (SA '20): 1--2. https://doi.org/10.1145/3415255.3422883Google Scholar
Digital Library
- HyeongYeop Kang and JungHyun Han. 2020. SafeXR: alerting walking persons to obstacles in mobile XR environments. Vis Comput 36: 2065--2077. https://doi.org/10.1007/s00371-020-01907--4Google Scholar
Cross Ref
- Adam Kendon. 2010. Spacing and orientation in co-present interaction. In Proceedings of the Second international conference on Development of Multimodal Interfaces: active Listening and Synchrony (COST'09). Springer-Verlag, Berlin, Heidelberg: 1--15. https://doi.org/10.1007/978--3--642--12397--9_1Google Scholar
Cross Ref
- Jarrod Knibbe, Jonas Schjerlund, Mathias Petræus, and Kasper Hornbæk. 2018. The Dream is Collapsing: The Experience of Exiting VR. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--13. https://doi.org/10.1145/3173574.3174057Google Scholar
Digital Library
- Robert E. Kraut, Robert S Fish, Robert W Root, and Barbara L Chalfonte. 1990. Informal Communication in Organizations - Form, Function, and Technology. I S. Oskamp & S. Spacapan (Eds.). Human Reactions to Technology: The Claremont Symposium on Applies Social Psychology, Beverly Hills, CA: Sage Publications.Google Scholar
- Karthik Mahadevan, Elaheh Sanoubari, Sowmya Somanath, James E. Young, and Ehud Sharlin. 2019. AV-pedestrian interaction design using a pedestrian mixed traffic simulator. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19): 475--486. https://doi.org/10.1145/3322276.3322328Google Scholar
Digital Library
- Christian Mai, Mariam Hassib, and Ceenu George. 2017. Like Elephants Do: Sensing Bystanders During HMD Usage. In Proceedings of the CHI 2017 Workshop on Amplification and Augmentation of Human Perception.Google Scholar
- Ville Mäkelä, Rivu Radiah, Saleh Alsherif, Mohamed Khamis, Chong Xiao, Lisa Borchert, Albrecht Schmidt, and Florian Alt. 2020. Virtual Field Studies: Conducting Studies on Public Displays in Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20): 1--15. https://doi.org/10.1145/3313831.3376796Google Scholar
Digital Library
- Nicolai Marquardt, Robert Diaz-Marino, Sebastian Boring, and Saul Greenberg. 2011. The Proximity Toolkit: Prototyping Proxemic Interactions in Ubiquitous Computing Ecologies. In Proceedings of the 24th annual ACM symposium on User interface software and technology (UIST'11): 315--326. https://doi.org/10.1145/2047196.2047238Google Scholar
Digital Library
- Mark McGill, Daniel Boland, Roderick Murray-Smith, and Stephen. Brewster. 2015. A Dose of Reality: Overcoming Usability Challenges in VR Head-Mounted Displays. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15): 2143--2152. https://doi.org/10.1145/2702123.2702382Google Scholar
Digital Library
- Daniel Medeiros, Rafael dos Anjos, Nadia Pantidi, Kun Huang, Maur´cio Sousa, Craig Anslow, and Joaquim Jorge. 2021. Promoting Reality Awareness in Virtual Reality through Proxemics. 2021 IEEE VR Virtual Reality and 3D User Interfaces (VR): 21--30. https://doi.org/10.1109/VR50410.2021.00022Google Scholar
- Germán Martín Mendoza-Silva, Joaquín Torres-Sospedra, and Joaquín Huerta. 2019. A Meta-Review of Indoor Positioning Systems. Sensors 19, 20: 1--45. https://doi.org/10.3390/s19204507Google Scholar
Cross Ref
- Raul Montoliu, Emilio Sansano, Arturo Gascó, Oscar Belmonte, and Antonio Caballer. 2020. Indoor Positioning for Monitoring Older Adults at Home: Wi-fi and BLE Technologies in Real Scenarios. Electronics 9, 5: 1--20. https://doi.org/10.3390/electronics9050728Google Scholar
- Joseph O'Hagan and Julie R. Williamson. 2020. Reality aware VR headsets. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (PerDis '20): 9--17. https://doi.org/10.1145/3393712.3395334Google Scholar
Digital Library
- Joseph O'Hagan, Julie R. Williamson, and Mohamed Khamis. 2020. Bystander interruption of VR users. In Proceedings of the 9TH ACM International Symposium on Pervasive Displays (PerDis '20): 19--27. https://doi.org/10.1145/3393712.3395339Google Scholar
Digital Library
- Daniel Pohl and Carlos Fernandez De Tejada Quemada. 2016. See what I see: Concepts to improve the social acceptance of HMDs. 2016 IEEE Virtual Reality (VR): 267--268. https://doi.org/10.1109/VR.2016.7504756Google Scholar
- Anastasia Ruvimova, Junhyeok Kim, Thomas Fritz, Mark Hancock, and David C. Shepherd. 2020. "Transport Me Away": Fostering Flow in Open Offices through Virtual Reality. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20): 1--14. https://doi.org/10.1145/3313831.3376724Google Scholar
Digital Library
- Rufat Rzayev, Sven Mayer, Christian Krauter, and Niels Henze. 2019. Notification in VR: The Effect of Notification Placement, Task, and Environment. In Proceedings of the Annual Symposium on Computer-Human Interaction in Play (CHI PLAY '19): 199--211. https://doi.org/10.1145/3311350.3347190Google Scholar
Digital Library
- Thomas Schubert, Frank Friedmann, and Holger Regenbrecht. 2001. The Experience of Presence: Factor Analytic Insights. Presence: Teleoperators and virtual environ. 10, 3: 266--281. https://doi.org/10.1162/105474601300343603.Google Scholar
Digital Library
- Valentin Schwind, Pascal Knierim, Nico Haas, and Niels Henze. 2019. Using Presence Questionnaires in Virtual Reality. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems - CHI '19: 1--12. https://doi.org/10.1145/3290605.3300590Google Scholar
Digital Library
- Balasaravanan Thoravi Kumaravel, Cuong Nguyen, Stephen DiVerdi, and Bjoern Hartmann. 2020. TransceiVR: Bridging Asymmetrical Communication Between VR Users and External Collaborators. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20): 182--195. https://doi.org/10.1145/3379337.3415827Google Scholar
Digital Library
- Chiu-Hsuan Wang, Seraphina Yong, Hsin-Yu Chen, Yuan-Syun Ye, and Liwei Chan. 2020. HMD Light: Sharing In-VR Experience via Head-Mounted Projector for Asymmetric Interaction. In Proceedings of the 33rd Annual ACM Symposium on User Interface Software and Technology (UIST '20): 472--486. https://doi.org/10.1145/3379337.3415847Google Scholar
Digital Library
- Steve. Whittaker, David. Frohlich, and Owen. Daly-Jones. 1994. Informal workplace communication: What is it like and how might we support it? In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94): 131--137. https://doi.org/10.1145/191666.191726Google Scholar
Digital Library
- Julius Von Willich, Markus Funk, Florian Müller, Karola Marky, Jan Riemann, and Max Mühlhäuser. 2019. You Invaded my Tracking Space?! Using Augmented Virtuality for Spotting Passersby in Room-Scale Virtual Reality. In Proceedings of the 2019 on Designing Interactive Systems Conference (DIS '19): 487--496. https://doi.org/10.1145/3322276.3322334Google Scholar
Digital Library
- Jason Wuertz, Sultan A. Alharthi, William A. Hamilton, Scott Bateman, Carl Gutwin, Anthony Tang, Zachary Toups, and Jessica Hammer. 2018. A Design Framework for Awareness Cues in Distributed Multiplayer Games. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18): 1--14. https://doi.org/10.1145/3173574.3173817Google Scholar
Digital Library
- Robert Xiao and Hrvoje Benko. 2016. Augmenting the Field-of-View of Head-Mounted Displays with Sparse Peripheral Displays. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16): 1221--1232. https://doi.org/10.1145/2858036.2858212Google Scholar
Digital Library
- Soojeong Yoo, Phillip Gough, and Judy Kay. 2020. Embedding a VR Game Studio in a Sedentary Workplace: Use, Experience and Exercise Benefits. In Proceedings of the 2020 CHI Conference on Human Factors in Computing Systems (CHI '20): 1--14. https://doi.org/10.1145/3313831.3376371Google Scholar
Digital Library
- André Zenner, Marco Speicher, Sören Klingner, Donald Degraen, Florian Daiber, and Antonio Krüger. 2018. Immersive Notification Framework: Adaptive & Plausible Notifications in Virtual Reality. In Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18): 1--6. https://doi.org/10.1145/3170427.3188505Google Scholar
Digital Library
- WhatsApp. https://www.whatsapp.com/Google Scholar
- Messenger. https://www.messenger.com/Google Scholar
Index Terms
(auto-classified)Towards Balancing VR Immersion and Bystander Awareness
Recommendations
Re-Evaluating VR User Awareness Needs During Bystander Interactions
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsVirtual reality (VR) users are often around bystanders, i.e. people in the real world the VR user may want to interact with. To facilitate bystander-VR user interactions, technology-mediated awareness systems have been introduced to increase a user’s ...
VR Grabbers: Ungrounded Haptic Retargeting for Precision Grabbing Tools
UIST '18: Proceedings of the 31st Annual ACM Symposium on User Interface Software and TechnologyHaptic feedback in VR is important for realistic simulation in virtual reality. However, recreating the haptic experience for hand tools in VR traditionally requires hardware with precise actuators, adding complexity to the system. We propose Ungrounded ...
Effect of VR technology matureness on VR sickness
AbstractIn this paper relationship of perceived virtual reality (VR) sickness phenomenon with different generations of virtual reality head mounted displays (VR HMD) is presented. Action content type omnidirectional video clip was watched by means of four ...






Comments