skip to main content
research-article
Open Access

Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR

Authors Info & Claims
Published:07 November 2019Publication History
Skip Abstract Section

Abstract

Studies on collaborative virtual environments (CVEs) have suggested capture and later replay of multimodal interactions (e.g., speech, body language, and scene manipulations), which we refer to as multimodal recordings, as an effective medium for time-distributed collaborators to discuss and review 3D content in an immersive, expressive, and asynchronous way. However, there exist gaps of empirical knowledge in understanding how this multimodal asynchronous VR collaboration (MAVRC) context impacts social behaviors in mediated-communication, workspace awareness in cooperative work, and user requirements for authoring and consuming multimedia recording. This study aims to address these gaps by conceptualizing MAVRC as a type of CSCW and by understanding the challenges and design considerations of MAVRC systems. To this end, we conducted an exploratory need-finding study where participants (N = 15) used an experimental MAVRC system to complete a representative spatial task in an asynchronously collaborative setting, involving both consumption and production of multimodal recordings. Qualitative analysis of interview and observation data from the study revealed unique, core design challenges of MAVRC in: (1) coordinating proxemic behaviors between asynchronous collaborators, (2) providing traceability and change awareness across different versions of 3D scenes, (3) accommodating viewpoint control to maintain workspace awareness, and (4) supporting navigation and editing of multimodal recordings. We discuss design implications, ideate on potential design solutions, and conclude the paper with a set of design recommendations for MAVRC systems.

Skip Supplemental Material Section

Supplemental Material

cscw040.mp4

Supplemental video

References

  1. Ian Arawjo, Dongwook Yoon, and Franccois Guimbretière. 2017. TypeTalker: A Speech Synthesis-Based Multi-Modal Commenting System. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing (CSCW '17). ACM, New York, NY, USA, 1970--1981. https://doi.org/10.1145/2998181.2998260Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. B. Avery, C. Sandor, and B. H. Thomas. 2009. Improving Spatial Perception for Augmented Reality X-Ray Vision. In 2009 IEEE Virtual Reality Conference. 79--82. https://doi.org/10.1109/VR.2009.4811002Google ScholarGoogle Scholar
  3. B. Bach, E. Pietriga, and J. Fekete. 2014. GraphDiaries: Animated Transitions and Temporal Navigation for Dynamic Networks. IEEE Transactions on Visualization and Computer Graphics, Vol. 20, 5 (May 2014), 740--754. https://doi.org/10.1109/TVCG.2013.254Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Jeremy N. Bailenson, Jim Blascovich, Andrew C. Beall, and Jack M. Loomis. 2003. Interpersonal Distance in Immersive Virtual Environments. Personality and Social Psychology Bulletin, Vol. 29, 7 (2003), 819--833. https://doi.org/10.1177/0146167203029007002 PMID: 15018671.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Till Ballendat, Nicolai Marquardt, and Saul Greenberg. 2010. Proxemic Interaction: Designing for a Proximity and Orientation-aware Environment. In ACM International Conference on Interactive Tabletops and Surfaces (ITS '10). ACM, New York, NY, USA, 121--130. https://doi.org/10.1145/1936652.1936676Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. William Bares, Scott McDermott, Christina Boudreaux, and Somying Thainimit. 2000. Virtual 3D Camera Composition from Frame Constraints. In Proceedings of the Eighth ACM International Conference on Multimedia (MULTIMEDIA '00). ACM, New York, NY, USA, 177--186. https://doi.org/10.1145/354384.354463Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Steve Benford, Chris Greenhalgh, Tom Rodden, and James Pycock. 2001. Collaborative Virtual Environments. Commun. ACM, Vol. 44, 7 (July 2001), 79--85. https://doi.org/10.1145/379300.379322Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Floraine Berthouzoz, Wilmot Li, and Maneesh Agrawala. 2012. Tools for Placing Cuts and Transitions in Interview Video. ACM Trans. Graph., Vol. 31, 4, Article 67 (July 2012), 8 pages. https://doi.org/10.1145/2185520.2185563Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Anastasia Bezerianos, Pierre Dragicevic, and Ravin Balakrishnan. 2006. Mnemonic rendering: an image-based approach for exposing hidden changes in dynamic displays. In Proceedings of the 19th annual ACM symposium on User interface software and technology. ACM, 159--168. https://doi.org/10.1145/1166253.1166279Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Anastasiia Bobeshko. 2017. The Future of Interior Design: Virtual Showrooms and Augmented Catalogs. (2017). http://www.masonrydesignmagazine.com/future-interior-design-virtual-showrooms-augmented-catalogs/Google ScholarGoogle Scholar
  11. Jered Borup, Richard E. West, and Charles R. Graham. 2012. Improving online social presence through asynchronous video. The Internet and Higher Education, Vol. 15, 3 (2012), 195 -- 203. https://doi.org/10.1016/j.iheduc.2011.11.001 Emotions in online learning environments.Google ScholarGoogle ScholarCross RefCross Ref
  12. John L. Campbell, Charles Quincy, Jordan Osserman, and Ove K. Pedersen. 2013. Coding In-depth Semistructured Interviews: Problems of Unitization and Intercoder Reliability and Agreement. Sociological Methods & Research, Vol. 42, 3 (2013), 294--320. https://doi.org/10.1177/0049124113500475Google ScholarGoogle ScholarCross RefCross Ref
  13. Barbara L. Chalfonte, Robert S. Fish, and Robert E. Kraut. 1991. Expressive Richness: A Comparison of Speech and Text As Media for Revision. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '91). ACM, New York, NY, USA, 21--26. https://doi.org/10.1145/108844.108848Google ScholarGoogle Scholar
  14. Henry Chen, Austin S. Lee, Mark Swift, and John C. Tang. 2015. 3D Collaboration Method over HoloLens#8482; and Skype#8482; End Points. In Proceedings of the 3rd International Workshop on Immersive Media Experiences (ImmersiveME '15). ACM, New York, NY, USA, 27--30. https://doi.org/10.1145/2814347.2814350Google ScholarGoogle Scholar
  15. Fanny Chevalier, Pierre Dragicevic, Anastasia Bezerianos, and Jean-Daniel Fekete. 2010. Using Text Animated Transitions to Support Navigation in Document Histories. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '10). ACM, New York, NY, USA, 683--692. https://doi.org/10.1145/1753326.1753427Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. T. Matthew Ciolek and Adam Kendon. 1980. Environment and the Spatial Arrangement of Conversational Encounters. Sociological Inquiry, Vol. 50, 3--4 (1980), 237--271. https://doi.org/10.1111/j.1475--682X.1980.tb00022.xGoogle ScholarGoogle Scholar
  17. Herbert H. Clark and Susan E. Brennan. 1991. Grounding in communication. Perspectives on socially shared cognition, Vol. 13, 1991 (1991), 127--149.Google ScholarGoogle Scholar
  18. Richard L Daft and Robert H Lengel. 1986. Organizational information requirements, media richness and structural design. Management science, Vol. 32, 5 (1986), 554--571.Google ScholarGoogle Scholar
  19. A. De Lucia, F. Fasano, and R. Oliveto. 2008. Traceability management for impact analysis. In 2008 Frontiers of Software Maintenance. 21--30. https://doi.org/10.1109/FOSM.2008.4659245Google ScholarGoogle Scholar
  20. Arindam Dey, Thammathip Piumsomboon, Youngho Lee, and Mark Billinghurst. 2017. Effects of Sharing Physiological States of Players in a Collaborative Virtual Reality Gameplay. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM, New York, NY, USA, 4045--4056. https://doi.org/10.1145/3025453.3026028Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Arindam Dey and Christian Sandor. 2014. Lessons learned: Evaluating visualizations for occluded objects in handheld augmented reality. International Journal of Human-Computer Studies, Vol. 72, 10 (2014), 704 -- 716. https://doi.org/10.1016/j.ijhcs.2014.04.001Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Jozef Dobovs and Anthony Steed. 2012a. 3D Diff: An Interactive Approach to Mesh Differencing and Conflict Resolution. In SIGGRAPH Asia 2012 Technical Briefs (SA '12). ACM, New York, NY, USA, Article 20, 4 pages. https://doi.org/10.1145/2407746.2407766Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jozef Dobovs and Anthony Steed. 2012b. 3D Revision Control Framework. In Proceedings of the 17th International Conference on 3D Web Technology (Web3D '12). ACM, New York, NY, USA, 121--129. https://doi.org/10.1145/2338714.2338736Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Ciro Donalek, S. G. Djorgovski, Alex Cioc, Anwell Wang, Jerry Zhang, Elizabeth Lawler, Stacy Yeh, Ashish Mahabal, Matthew Graham, Andrew Drake, Scott Davidoff, Jeffrey S. Norris, and Giuseppe Longo. 2014. Immersive and collaborative data visualization using virtual reality platforms. In 2014 IEEE International Conference on Big Data (Big Data). IEEE, 609--614. https://doi.org/10.1109/BigData.2014.7004282Google ScholarGoogle ScholarCross RefCross Ref
  25. Paul Dourish and Victoria Bellotti. 1992. Awareness and Coordination in Shared Workspaces. Proceedings of the 1992 ACM Conference on Computer-supported Cooperative Work (CSCW '92). ACM, New York, NY, USA, 107--114. https://doi.org/10.1145/143457.143468Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Jesse Fox, Dylan Arena, and Jeremy N Bailenson. 2009. Virtual reality: A survival guide for the social scientist. Journal of Media Psychology, Vol. 21, 3 (2009), 95--113.Google ScholarGoogle ScholarCross RefCross Ref
  27. Doron Friedman, Anthony Steed, and Mel Slater. 2007. Spatial Social Behavior in Second Life. In Intelligent Virtual Agents, Catherine Pelachaud, Jean-Claude Martin, Elisabeth André, Gérard Chollet, Kostas Karpouzis, and Danielle Pelé (Eds.). Springer Berlin Heidelberg, Berlin, Heidelberg, 252--263.Google ScholarGoogle Scholar
  28. P. Frost and P. Warren. 2000. Virtual reality used in a collaborative architectural design process. In 2000 IEEE Conference on Information Visualization. An International Conference on Computer Visualization and Graphics. 568--573. https://doi.org/10.1109/IV.2000.859814Google ScholarGoogle ScholarCross RefCross Ref
  29. Susan R. Fussell, Robert E. Kraut, and Jane Siegel. 2000. Coordination of Communication: Effects of Shared Visual Context on Collaborative Work. In Proceedings of the 2000 ACM Conference on Computer Supported Cooperative Work (CSCW '00). ACM, New York, NY, USA, 21--30. https://doi.org/10.1145/358916.358947Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Maia Garau, Mel Slater, Vinoba Vinayagamoorthy, Andrea Brogni, Anthony Steed, and M. Angela Sasse. 2003. The impact of avatar realism and eye gaze control on perceived quality of communication in a shared immersive virtual environment. In Proceedings of the conference on Human factors in computing systems - CHI '03. ACM Press, New York, New York, USA, 529. https://doi.org/10.1145/642700.642703Google ScholarGoogle Scholar
  31. Saul Greenberg, Nicolai Marquardt, Till Ballendat, Rob Diaz-Marino, and Miaosen Wang. 2011. Proxemic Interactions: The New Ubicomp? Interactions, Vol. 18, 1 (Jan. 2011), 42--50. https://doi.org/10.1145/1897239.1897250Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. C. Greenhalgh, M. Flintham, J. Purbrick, and S. Benford. 2002. Applications of temporal links: recording and replaying virtual environments. In Proceedings IEEE Virtual Reality 2002. 101--108. https://doi.org/10.1109/VR.2002.996512Google ScholarGoogle ScholarCross RefCross Ref
  33. Tovi Grossman, Justin Matejka, and George Fitzmaurice. 2010. Chronicle: capture, exploration, and playback of document workflow histories. In Proceedings of the 23nd annual ACM symposium on User interface software and technology. ACM, 143--152. http://doi.acm.org/10.1145/1866029.1866054Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Jonathan Grudin. 1988. Why CSCW Applications Fail: Problems in the Design and Evaluationof Organizational Interfaces. In Proceedings of the 1988 ACM Conference on Computer-supported Cooperative Work (CSCW '88). ACM, New York, NY, USA, 85--93. https://doi.org/10.1145/62266.62273Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Jo a o Guerreiro, Daniel Medeiros, Daniel Mendes, Maurí cio Sousa, Joaquim Jorge, Alberto Raposo, and Ismael Santos. 2014. Beyond Post-It: Structured Multimedia Annotations for Collaborative VEs. International Conference on Artificial Reality and Telexistence Eurographics Symposium on Virtual Environments (2014), 55--62. https://doi.org/10.2312/ve.20141365.055-062Google ScholarGoogle Scholar
  36. Carl Gutwin and Saul Greenberg. 2002. A Descriptive Framework of Workspace Awareness for Real-Time Groupware. Computer Supported Cooperative Work (CSCW), Vol. 11, 3 (01 Sep 2002), 411--446. https://doi.org/10.1023/A:1021271517844Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. E.T. Hall. 1992. The Hidden Dimension .Anchor Books. https://books.google.ca/books?id=p3g0ngEACAAJGoogle ScholarGoogle Scholar
  38. Steve Harrison, Scott Minneman, and Joshua Marinacci. 1999. The DrawStream Station or the AVCs of Video Cocktail Napkins. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems - Volume 2 (ICMCS '99). IEEE Computer Society, Washington, DC, USA, 9543--. https://doi.org/10.1109/MMCS.1999.779259Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Jeffrey Heer, Fernanda B Vié gas, and Martin Wattenberg. 2007. Voyagers and Voyeurs: Supporting Asynchronous Collaborative Visualization. In Proceedings of the SIGCHI conference on Human factors in computing systems - CHI '07, Vol. 52. ACM Press, New York, New York, USA, 1029. https://doi.org/10.1145/1240624.1240781Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Jim Hollan and Scott Stornetta. 1992. Beyond Being There. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '92). ACM, New York, NY, USA, 119--125. https://doi.org/10.1145/142750.142769Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. HTC. 2019 a. Vive Pro. (2019). https://enterprise.vive.com/us/product/vive-pro-eye/Google ScholarGoogle Scholar
  42. HTC. 2019 b. Vive Virtual Reality System. (2019). https://vive.com/Google ScholarGoogle Scholar
  43. Hikaru Ibayashi, Yuta Sugiura, Daisuke Sakamoto, Natsuki Miyata, Mitsunori Tada, Takashi Okuma, Takeshi Kurata, Masaaki Mochimaru, and Takeo Igarashi. 2015. Dollhouse VR: A Multi-view, Multi-user Collaborative Design Workspace with VR Technology. In SIGGRAPH Asia 2015 Emerging Technologies (SA '15). ACM, New York, NY, USA, Article 8, 2 pages. https://doi.org/10.1145/2818466.2818480Google ScholarGoogle Scholar
  44. T. Imai, A. E. Johnson, J. Leigh, D. E. Pape, and T. A. DeFanti. 1999. Supporting transoceanic collaborations in virtual environment. In Fifth Asia-Pacific Conference on ... and Fourth Optoelectronics and Communications Conference on Communications, Vol. 2. 1059--1062 vol.2. https://doi.org/10.1109/APCC.1999.820446Google ScholarGoogle ScholarCross RefCross Ref
  45. Kegetys. [n. d.]. OpenVR input plugin | Open Broadcaster Software. https://obsproject.com/forum/resources/openvr-input-plugin.534/. ([n. d.]). Accessed: 2019-03--27.Google ScholarGoogle Scholar
  46. Robert Kennedy, Norman Lane, Kevin Berbaum, and Michael Lilienthal. 1993. Simulator sickness questionnaire: An enhanced method for quantifying simulator sickness. (1993), 203--220 pages. https://doi.org/10.1207/s15327108ijap0303_3Google ScholarGoogle Scholar
  47. Juho Kim, Philip J. Guo, Carrie J. Cai, Shang-Wen (Daniel) Li, Krzysztof Z. Gajos, and Robert C. Miller. 2014. Data-driven Interaction Techniques for Improving Navigation of Educational Videos. In Proceedings of the 27th Annual ACM Symposium on User Interface Software and Technology (UIST '14). ACM, New York, NY, USA, 563--572. https://doi.org/10.1145/2642918.2647389Google ScholarGoogle Scholar
  48. Ryohei Komiyama, Takashi Miyaki, and Jun Rekimoto. 2017. JackIn Space: Designing a Seamless Transition Between First and Third Person View for Effective Telepresence Collaborations. In Proceedings of the 8th Augmented Human International Conference (AH '17). ACM, New York, NY, USA, Article 14, 9 pages. https://doi.org/10.1145/3041164.3041183Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Guang Li, Xiang Cao, Sergio Paolantonio, and Feng Tian. 2012. SketchComm: A Tool to Support Rich and Flexible Asynchronous Communication of Early Design Ideas. In Proceedings of the ACM 2012 Conference on Computer Supported Cooperative Work (CSCW '12). ACM, New York, NY, USA, 359--368. https://doi.org/10.1145/2145204.2145261Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. David Lindlbauer and Andy D Wilson. 2018. Remixed Reality: Manipulating Space and Time in Augmented Reality. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems - CHI '18. ACM Press, New York, New York, USA, 1--13. https://doi.org/10.1145/3173574.3173703Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. John Lofland and Lyn H Lofland. 1971. Analyzing social settings. (1971).Google ScholarGoogle Scholar
  52. Philip Marriott. 2002. Voice vs text-based discussion forums: An implementation of Wimba Voice Boards. In E-Learn: World Conference on E-Learning in Corporate, Government, Healthcare, and Higher Education. Association for the Advancement of Computing in Education (AACE), 640--646.Google ScholarGoogle Scholar
  53. Kasra Rahimi Moghadam, Colin Banigan, and Eric D Ragan. 2018. Scene Transitions and Teleportation in Virtual Reality and the Implications for Spatial Awareness and Sickness. IEEE transactions on visualization and computer graphics (2018). https://doi.org/10.1109/TVCG.2018.2884468Google ScholarGoogle Scholar
  54. Meredith Ringel Morris and Eric Horvitz. 2007. SearchTogether: an interface for collaborative web search. In Proceedings of the 20th annual ACM symposium on User interface software and technology - UIST '07. ACM Press, New York, New York, USA, 3. https://doi.org/10.1145/1294211.1294215Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Christine M. Neuwirth, Ravinder Chandhok, David Charney, Patricia Wojahn, and Loel Kim. 1994. Distributed Collaborative Writing: A Comparison of Spoken and Written Modalities for Reviewing and Revising Documents. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '94). ACM, New York, NY, USA, 51--57. https://doi.org/10.1145/191666.191693Google ScholarGoogle Scholar
  56. Cuong Nguyen, Stephen DiVerdi, Aaron Hertzmann, and Feng Liu. 2017. CollaVR: Collaborative in-headset review for VR video. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology - UIST '17. ACM Press, New York, New York, USA, 267--277. https://doi.org/10.1145/3126594.3126659Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Cuong Nguyen, Yuzhen Niu, and Feng Liu. 2013. Direct Manipulation Video Navigation in 3D. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '13). ACM, New York, NY, USA, 1169--1172. https://doi.org/10.1145/2470654.2466150Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Gary M. Olson and Judith S. Olson. 2000. Distance Matters. Human-Computer Interaction, Vol. 15, 2--3 (sep 2000), 139--178. https://doi.org/10.1207/S15327051HCI1523_4Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Sergio Orts-Escolano, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Christoph Rhemann, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, Shahram Izadi, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, and Sameh Khamis. 2016a. Holoportation : Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. ACM Press, New York, New York, USA, 741--754. https://doi.org/10.1145/2984511.2984517Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Sergio Orts-Escolano, Christoph Rhemann, Sean Fanello, Wayne Chang, Adarsh Kowdle, Yury Degtyarev, David Kim, Philip L. Davidson, Sameh Khamis, Mingsong Dou, Vladimir Tankovich, Charles Loop, Qin Cai, Philip A. Chou, Sarah Mennicken, Julien Valentin, Vivek Pradeep, Shenlong Wang, Sing Bing Kang, Pushmeet Kohli, Yuliya Lutchyn, Cem Keskin, and Shahram Izadi. 2016b. Holoportation: Virtual 3D Teleportation in Real-time. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 741--754. https://doi.org/10.1145/2984511.2984517Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Yun Suen Pai, Benjamin I. Outram, Benjamin Tag, Megumi Isogai, Daisuke Ochi, Hideaki Kimata, and Kai Kunze. 2017. CleaVR: Collaborative Layout Evaluation and Assessment in Virtual Reality. In ACM SIGGRAPH 2017 Posters (SIGGRAPH '17). ACM, New York, NY, USA, Article 20, 2 pages. https://doi.org/10.1145/3102163.3102186Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Amy Pavel, Dan B. Goldman, Björn Hartmann, and Maneesh Agrawala. 2016a. VidCrit: Video-based Asynchronous Video Review. In Proceedings of the 29th Annual Symposium on User Interface Software and Technology (UIST '16). ACM, New York, NY, USA, 517--528. https://doi.org/10.1145/2984511.2984552Google ScholarGoogle ScholarDigital LibraryDigital Library
  63. Amy Pavel, Dan B Goldman, Bjö rn Hartmann, and Maneesh Agrawala. 2016b. VidCrit: Video-Based Asynchronous Video Review. Proceedings of the 29th Annual Symposium on User Interface Software and Technology - UIST '16. ACM Press, New York, New York, USA, 517--528. https://doi.org/10.1145/2984511.2984552Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Julien Phalip, Ernest a. Edmonds, and David Jean. 2009. Supporting remote creative collaboration in film scoring. In Proceeding of the seventh ACM conference on Creativity and cognition - C&C '09. ACM Press, New York, New York, USA, 211. https://doi.org/10.1145/1640233.1640266Google ScholarGoogle Scholar
  65. Lauriane Pouliquen-Lardy, Isabelle Milleville-Pennel, Francc ois Guillaume, and Franck Mars. 2016. Remote collaboration in virtual reality: asymmetrical effects of task distribution on spatial processing and mental workload. Virtual Reality, Vol. 20, 4 (nov 2016), 213--220. https://doi.org/10.1007/s10055-016-0294--8Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Gonzalo Ramos and Ravin Balakrishnan. 2003. Fluid Interaction Techniques for the Control and Annotation of Digital Video. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST '03). ACM, New York, NY, USA, 105--114. https://doi.org/10.1145/964696.964708Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. H. Regenbrecht, K. Meng, A. Reepen, S. Beck, and T. Langlotz. 2017. Mixed Voxel Reality: Presence and Embodiment in Low Fidelity, Visually Coherent, Mixed Reality Environments. In 2017 IEEE International Symposium on Mixed and Augmented Reality (ISMAR). 90--99. https://doi.org/10.1109/ISMAR.2017.26Google ScholarGoogle Scholar
  68. Steve Rubin, Floraine Berthouzoz, Gautham J. Mysore, Wilmot Li, and Maneesh Agrawala. 2013. Content-based Tools for Editing Audio Stories. In Proceedings of the 26th Annual ACM Symposium on User Interface Software and Technology (UIST '13). ACM, New York, NY, USA, 113--122. https://doi.org/10.1145/2501988.2501993Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Gabriele Salvati, Christian Santoni, Valentina Tibaldo, and Fabio Pellacini. 2015. MeshHisto: Collaborative Modeling by Sharing and Retargeting Editing Histories. ACM Trans. Graph., Vol. 34, 6, Article 205 (Oct. 2015), 10 pages. https://doi.org/10.1145/2816795.2818110Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Ralph Schroeder. 2012. The social life of avatars: Presence and interaction in shared virtual environments .Springer Science & Business Media. https://doi.org/10.1007/978--1--4471-0277--9Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Abhishek Seth, Judy M. Vance, and James H. Oliver. 2011. Virtual reality for assembly methods prototyping: a review. Virtual Reality, Vol. 15, 1 (01 Mar 2011), 5--20. https://doi.org/10.1007/s10055-009-0153-yGoogle ScholarGoogle Scholar
  72. Venkatesh Sivaraman, Dongwook Yoon, and Piotr Mitros. 2016. Simplified Audio Production in Asynchronous Voice-Based Discussions. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, New York, NY, USA, 1045--1054. https://doi.org/10.1145/2858036.2858416Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. M. Slater, D.. Pertaub, and A. Steed. 1999. Public speaking in virtual reality: facing an audience of avatars. IEEE Computer Graphics and Applications, Vol. 19, 2 (March 1999), 6--9. https://doi.org/10.1109/38.749116Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Dave Snowdon, Elizabeth F Churchill, and Alan J Munro. 2000. Collaborative Virtual Environments: Digital Spaces and Places for CSCW. Collaborative Virtual Environments (2000), 1--34. https://doi.org/10.1.1.114.9226Google ScholarGoogle Scholar
  75. Lisa Stifelman, Barry Arons, and Chris Schmandt. 2001. The Audio Notebook: Paper and Pen Interaction with Structured Speech. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '01). ACM, New York, NY, USA, 182--189. https://doi.org/10.1145/365024.365096Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. James Tam and Saul Greenberg. 2006. A framework for asynchronous change awareness in collaborative documents and workspaces. International Journal of Human-Computer Studies, Vol. 64, 7 (2006), 583 -- 598. https://doi.org/10.1016/j.ijhcs.2006.02.004 Theoretical and empirical advances in groupware research.Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. John Tang, Jennifer Marlow, Aaron Hoff, Asta Roseway, Kori Inkpen, Chen Zhao, and Xiang Cao. 2012. Time Travel Proxy: Using Lightweight Video Recordings to Create Asynchronous, Interactive Meetings. In Proceedings of the 2012 ACM annual conference on Human Factors in Computing Systems - CHI '12. ACM Press, New York, New York, USA, 3111. https://doi.org/10.1145/2207676.2208725Google ScholarGoogle Scholar
  78. Franco Tecchia, Leila Alem, and Weidong Huang. 2012. 3D helping hands: a gesture based MR system for remote collaboration. Proceedings of the 11th ACM SIGGRAPH International Conference on Virtual-Reality Continuum and its Applications in Industry - VRCAI '12, Vol. 1, 212 (2012), 323. https://doi.org/10.1145/2407516.2407590Google ScholarGoogle ScholarDigital LibraryDigital Library
  79. V'ictor Theoktisto and Marta Fairén. 2005. Enhancing collaboration in virtual reality applications. Computers & Graphics, Vol. 29, 5 (2005), 704--718. https://doi.org/10.1016/j.cag.2005.08.023Google ScholarGoogle ScholarDigital LibraryDigital Library
  80. Michael Tsang, George W. Fitzmaurice, Gordon Kurtenbach, Azam Khan, and Bill Buxton. 2002. Boom Chameleon: Simultaneous Capture of 3D Viewpoint, Voice and Gesture Annotations on a Spatially-aware Display. In Proceedings of the 15th Annual ACM Symposium on User Interface Software and Technology (UIST '02). ACM, New York, NY, USA, 111--120. https://doi.org/10.1145/571985.572001Google ScholarGoogle ScholarDigital LibraryDigital Library
  81. L. Wang, J. Wu, X. Yang, and V. Popescu. 2019. VR Exploration Assistance through Automatic Occlusion Removal. IEEE Transactions on Visualization and Computer Graphics (2019), 1--1. https://doi.org/10.1109/TVCG.2019.2898782Google ScholarGoogle Scholar
  82. Steve Whittaker, Julia Hirschberg, Brian Amento, Litza Stark, Michiel Bacchiani, Philip Isenhour, Larry Stead, Gary Zamchick, and Aaron Rosenberg. 2002. SCANMail: A Voicemail Interface That Makes Speech Browsable, Readable and Searchable. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI '02). ACM, New York, NY, USA, 275--282. https://doi.org/10.1145/503376.503426Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. L. Wilcox. 1998. Dynomite: a dynamically organized ink and audio notebook. IET Conference Proceedings (January 1998), 1--1(1). http://digital-library.theiet.org/content/conferences/10.1049/ic_19980381Google ScholarGoogle ScholarCross RefCross Ref
  84. Jacob O. Wobbrock and Julie A. Kientz. 2016. Research Contributions in Human-computer Interaction. Interactions, Vol. 23, 3 (April 2016), 38--44. https://doi.org/10.1145/2907069Google ScholarGoogle ScholarDigital LibraryDigital Library
  85. Ungyeon Yang and Gerard Jounghyun Kim. 2002. Implementation and Evaluation of "Just Follow Me": An Immersive, VR-Based, Motion-Training System. Presence: Teleoperators and Virtual Environments, Vol. 11, 3 (2002), 304--323. https://doi.org/10.1162/105474602317473240Google ScholarGoogle ScholarDigital LibraryDigital Library
  86. Dongwook Yoon, Nicholas Chen, Francc ois Guimbretiè re, and Abigail Sellen. 2014. RichReview: blending ink, speech, and gesture to support collaborative document review. In Proceedings of the 27th annual ACM symposium on User interface software and technology - UIST '14. ACM Press, New York, New York, USA, 481--490. https://doi.org/10.1145/2642918.2647390Google ScholarGoogle ScholarDigital LibraryDigital Library
  87. Dongwook Yoon, Nicholas Chen, Bernie Randles, Amy Cheatle, Corinna E. Löckenhoff, Steven J. Jackson, Abigail Sellen, and Franccois Guimbretière. 2016. RichReviewGoogle ScholarGoogle Scholar
  88. : Deployment of a Collaborative Multi-modal Annotation System for Instructor Feedback and Peer Discussion. Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing (CSCW '16). ACM, New York, NY, USA, 195--205. https://doi.org/10.1145/2818048.2819951Google ScholarGoogle Scholar
  89. Ya-Ting Yue, Yong-Liang Yang, Gang Ren, and Wenping Wang. 2017. SceneCtrl: Mixed Reality Enhancement via Efficient Scene Editing. In Proceedings of the 30th Annual ACM Symposium on User Interface Software and Technology (UIST '17). ACM, New York, NY, USA, 427--436. https://doi.org/10.1145/3126594.3126601Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Challenges and Design Considerations for Multimodal Asynchronous Collaboration in VR

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!