Abstract
360-degree video is increasingly used to create immersive user experiences; however, it is typically limited to a single user and not interactive. Recent studies have explored the potential of 360 video to support multi-user collaboration in remote settings. These studies identified several challenges with respect to 360 live streams, such as the lack of gaze awareness, out-of-sync views, and missed gestures. To address these challenges, we created 360Anywhere, a framework for 360 video-based multi-user collaboration that, in addition to allowing collaborators to view and annotate a 360 live stream, also supports projection of annotations in the 360 stream back into the real-world environment in real-time. This enables a range of collaborative augmented reality applications not supported with existing tools. We present the 360Anywhere framework and tools that allow users to generate applications tailored to specific collaboration and augmentation needs with support for remote collaboration. In a series of exploratory design sessions with users, we assess 360Anywhere's power and flexibility for three mobile ad-hoc scenarios. Using 360Anywhere, participants were able to set up and use fairly complex remote collaboration systems involving projective augmented reality in less than 10 minutes.
- Tomoaki Adachi, Takefumi Ogawa, Kiyoshi Kiyokawa, and Haruo Takemura. 2005. A telepresence system by using live video projection of wearable camera onto a 3d scene model. In Proc. HCII.Google Scholar
- Carolina Cruz-Neira, Daniel J. Sandin, and Thomas A. DeFanti. 1993. Surround-screen Projection-based Virtual Reality: The Design and Implementation of the CAVE. In Proc. SIGGRAPH. 135--142. Google Scholar
Digital Library
- Omid Fakourfar, Kevin Ta, Richard Tang, Scott Bateman, and Anthony Tang. 2016. Stabilized Annotations for Mobile Remote Assistance. In Proc. CHI. 1548--1560. Google Scholar
Digital Library
- Andreas Rene Fender, Hrvoje Benko, and Andy Wilson. 2017. MeetAlive: Room-Scale Omni-Directional Display System for Multi-User Content and Control Sharing. In Proc. ISS. 106--115. Google Scholar
Digital Library
- Steffen Gauglitz, Benjamin Nuernberger, Matthew Turk, and Tobias Höllerer. 2014. World-stabilized Annotations and Virtual Scene Navigation for Remote Collaboration. In Proc. UIST. 449--459. Google Scholar
Digital Library
- Michael Haller, Jakob Leitner, Thomas Seifried, James R. Wallace, Stacey D. Scott, Christoph Richter, Peter Brandl, Adam Gokcezade, and Seth E. Hunter. 2010. The NICE discussion room: integrating paper and digital media to support co-located group meetings. In Proc. CHI. 609--618. Google Scholar
Digital Library
- Thuong Hoang, Martin Reinoso, Zaher Joukhadar, Frank Vetere, and David Kelly. 2017. Augmented Studio: Projection Mapping on Moving Body for Physiotherapy Education. In Proc. CHI. 1419--1430. Google Scholar
Digital Library
- Brad Johanson, Armando Fox, and Terry Winograd. 2002. The Interactive Workspaces Project: Experiences with Ubiquitous Computing Rooms. IEEE Pervasive Computing 1, 2 (2002), 67--74. Google Scholar
Digital Library
- Brett R. Jones, Hrvoje Benko, Eyal Ofek, and Andrew D. Wilson. 2013. IllumiRoom: Peripheral Projected Illusions for Interactive Experiences. In Proc. CHI. 869--878. Google Scholar
Digital Library
- Brett R. Jones, Rajinder Sodhi, Michael Murdock, Ravish Mehra, Hrvoje Benko, Andrew Wilson, Eyal Ofek, Blair MacIntyre, Nikunj Raghuvanshi, and Lior Shapira. 2014. RoomAlive: magical experiences enabled by scalable, adaptive projector-camera units. In Proc. UIST. 637--644. Google Scholar
Digital Library
- Hannes Kaufmann and Dieter Schmalstieg. 2003. Mathematics and geometry education with collaborative augmented reality. Computers & Graphics 27, 3 (2003), 339--345.Google Scholar
Cross Ref
- Seungwon Kim, Gun A. Lee, Sangtae Ha, Nobuchika Sakata, and Mark Billinghurst. 2015. Automatically Freezing Live Video for Annotation During Remote Collaboration. In CHI Extended Abstracts. 1669--1674. Google Scholar
Digital Library
- Jerry Li, Mia Manavalan, Sarah D'Angelo, and Darren Gergle. 2016. Designing Shared Gaze Awareness for Remote Collaboration. In Proc. CSCW Companion. 325--328. Google Scholar
Digital Library
- Yen-Chen Lin, Yung-Ju Chang, Hou-Ning Hu, Hsien-Tzu Cheng, Chi-Wen Huang, and Min Sun. 2017. Tell Me Where to Look: Investigating Ways for Assisting Focus in 360º Video. In Proc. CHI. 2535--2545. Google Scholar
Digital Library
- Microsoft. 2018. Skype on HoloLens. (2018). https://www.microsoft.com/en-us/hololens/apps/skype.Google Scholar
- Brad Myers, Scott E. Hudson, and Randy Pausch. 2000. Past, Present, and Future of User Interface Software Tools. ACM Trans. Comput.-Hum. Interact. 7, 1 (March 2000), 3--28. Google Scholar
Digital Library
- Dan R Olsen Jr. 2007. Evaluating User Interface Systems Research. In Proc. UIST. 251--258. Google Scholar
Digital Library
- Jun Rekimoto and Masanori Saitoh. 1999. Augmented Surfaces: A Spatially Continuous Work Space for Hybrid Computing Environments. In Proc. CHI. 378--385. Google Scholar
Digital Library
- Rajinder S. Sodhi, Brett R. Jones, David Forsyth, Brian P. Bailey, and Giuliano Maciocci. 2013. BeThere: 3D Mobile Collaboration with Spatial Input. In Proc. CHI. 179--188. Google Scholar
Digital Library
- Norbert A. Streitz, Jörg Geißler, Torsten Holmer, Shin'ichi Konomi, Christian Müller-Tomfelde, Wolfgang Reischl, Petra Rexroth, Peter Seitz, and Ralf Steinmetz. 1999. i-LAND: An Interactive Landscape for Creativity and Innovation. In Proc. CHI. 120--127. Google Scholar
Digital Library
- Mengu Sukan, Carmine Elvezio, Ohan Oda, Steven Feiner, and Barbara Tversky. 2014. ParaFrustum: Visualization Techniques for Guiding a User to a Constrained Set of Viewing Positions and Orientations. In Proc. UIST. 331--340. Google Scholar
Digital Library
- Anthony Tang and Omid Fakourfar. 2017. Watching 360º Videos Together. In Proc. CHI. 4501--4506. Google Scholar
Digital Library
- Anthony Tang, Omid Fakourfar, Carman Neustaedter, and Scott Bateman. 2017. Collaboration in 360º Videochat: Challenges and Opportunities. In Proc. DIS. 1327--1339. Google Scholar
Digital Library
- Vuforia. 2018. Project Chalk. (2018). https://chalk.vuforia.com/.Google Scholar
- Andrew D. Wilson and Hrvoje Benko. 2010. Combining Multiple Depth Cameras and Projectors for Interactions on, Above and Between Surfaces. In Proc. UIST. 273--282. Google Scholar
Digital Library
Index Terms
360Anywhere: Mobile Ad-hoc Collaboration in Any Environment using 360 Video and Augmented Reality
Recommendations
Mini-Me: An Adaptive Avatar for Mixed Reality Remote Collaboration
CHI '18: Proceedings of the 2018 CHI Conference on Human Factors in Computing SystemsWe present Mini-Me, an adaptive avatar for enhancing Mixed Reality (MR) remote collaboration between a local Augmented Reality (AR) user and a remote Virtual Reality (VR) user. The Mini-Me avatar represents the VR user's gaze direction and body gestures ...
CoVAR: a collaborative virtual and augmented reality system for remote collaboration
SA '17: SIGGRAPH Asia 2017 Emerging TechnologiesWe present CoVAR, a novel remote collaborative system combining Augmented Reality (AR), Virtual Reality (VR) and natural communication cues to create new types of collaboration. AR user can capture and share their local environment with a remote user in ...
Design and Implementation of TeleAdvisor: a Projection-Based Augmented Reality System for Remote Collaboration
TeleAdvisor is a versatile projection-based augmented reality system designed for remote collaboration. It allows a remote expert to naturally guide a local user in need of assistance in carrying out physical tasks around real-world objects. The system ...






Comments