skip to main content
research-article

Korero: Facilitating Complex Referencing of Visual Materials in Asynchronous Discussion Interface

Published:06 December 2017Publication History
Skip Abstract Section

Abstract

In asynchronous online discussions, users actively reference visual materials (e.g., video, document) to provide supporting evidence and additional context. However, creating and comprehending complex references can be challenging, especially when there are multiple referents to refer, or when a referent is highly specific (e.g., specific sentences in a paper rather than the paper as a whole). To identify users' challenges in making references with multiple and specific referents while using existing discussion tools, we conducted an observational study and a preliminary interview. Based on the design lessons, we built Korero, a discussion interface that aims to facilitate complex referencing actions. For evaluation, we compared Korero against conventional interfaces in two user studies with referencing tasks of different referential difficulty. We found that Korero not only significantly reduces the time and effort in making references with multiple and specific referents, but also shows potential in increasing users' engagement with the discussion and referent materials.

References

  1. Michael Baker, Tia Hansen, Richard Joiner, and David Traum. 1999. The role of grounding in collaborative learning tasks. Collaborative learning: Cognitive and computational approaches: 31--63.Google ScholarGoogle Scholar
  2. Aaron Bangor, Philip T Kortum, and James T Miller. 2008. An empirical evaluation of the system usability scale. Intl. Journal of Human-Computer Interaction 24, 6: 574--594.Google ScholarGoogle ScholarCross RefCross Ref
  3. H Russell Bernard and Gery W Ryan. 2009. Analyzing qualitative data: Systematic approaches. SAGE publications.Google ScholarGoogle Scholar
  4. A J Brush, David Bargeron, Jonathan Grudin, Alan Borning, and Anoop Gupta. 2002. Supporting interaction outside of class: anchored discussions vs. discussion boards. In Proceedings of the Conference on Computer Support for Collaborative Learning: Foundations for a CSCL Community, 425--434. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Herbert H Clark and Susan E Brennan. 199 Grounding in communication. Perspectives on socially shared cognition 13, 1991: 127--149.Google ScholarGoogle Scholar
  6. Herbert H Clark and Deanna Wilkes-Gibbs. 1986. Referring as a collaborative process. Cognition 22, 1: 1--39.Google ScholarGoogle Scholar
  7. Derrick Coetzee, Armando Fox, Marti A Hearst, and Bjoern Hartmann. 2014. Chatrooms in MOOCs: all talk and no action. In In Proc. of ACM [email protected] '14, 127--136. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Brian Dorn, Larissa B Schroeder, and Adam Stankiewicz. 2015. Piloting TrACE: Exploring spatiotemporal anchored collaboration in asynchronous learning. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing, 393--403. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Paul Dourish and Victoria Bellotti. 1992. Awareness and coordination in shared workspaces. In Proceedings of the 1992 ACM conference on Computer-supported cooperative work, 107--114. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Eisenberg and Gerhard Fischer. 2014. MOOCs: A perspective from the learning sciences. Proceedings of ICLS 2014.Google ScholarGoogle Scholar
  11. Susan R Fussell, Robert E Kraut, and Jane Siegel. 2000. Coordination of communication: Effects of shared visual context on collaborative work. In Proceedings of the 2000 ACM conference on Computer supported cooperative work, 21--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Susan R Fussell, Leslie D Setlock, Jie Yang, Jiazhi Ou, Elizabeth Mauer, and Adam D I Kramer. 2004. Gestures over video streams to support remote collaboration on physical tasks. Human-Computer Interaction 19, 3: 273--309. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Fei Gao, Tianyi Zhang, and Teresa Franklin. 2013. Designing asynchronous online discussion environments: Recent progress and possible future directions. British Journal of Educational Technology 44, 3: 469--483.Google ScholarGoogle ScholarCross RefCross Ref
  14. Darren Gergle, Robert E Kraut, and Susan R Fussell. 2013. Using visual information for grounding and awareness in collaborative tasks. Human-Computer Interaction 28, 1: 1--39.Google ScholarGoogle Scholar
  15. Carl Gutwin and Saul Greenberg. 2002. A descriptive framework of workspace awareness for real-time groupware. Computer Supported Cooperative Work (CSCW)11, 3--4: 411--446. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Carl Gutwin, Mark Roseman, and Saul Greenberg. 1996. A usability study of awareness widgets in a shared workspace groupware system. In Proceedings of the 1996 ACM conference on Computer supported cooperative work, 258--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Carl Gutwin, Gwen Stark, and Saul Greenberg. 1995. Support for workspace awareness in educational groupware. In The first international conference on Computer support for collaborative learning, 147--156. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Mark Guzdial and Jennifer Turns. 2000. Effective discussion through a computer-mediated anchored forum. The journal of the learning sciences 9, 4: 437--469.Google ScholarGoogle Scholar
  19. Michel Hupet, Xavier Seron, and Yves Chantraine. 1991. The effects of the codability and discriminability of the referents on the collaborative referring procedure. British Journal of Psychology 82, 4: 449--462.Google ScholarGoogle ScholarCross RefCross Ref
  20. David S Kirk and Danaë Stanton Fraser. 2005. The effects of remote gesturing on distance instruction. In Proceedings of th 2005 conference on Computer support for collaborative learning: learning 2005: the next 10 years!, 301--310. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. David Kirk and Danae Stanton Fraser. 2006. Comparing remote gesture technologies for supporting collaborative physical tasks. In Proceedings of the SIGCHI conference on Human Factors in computing systems, 1191--1200. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Robert E Kraut, Susan R Fussell, and Jane Siegel. 2003. Visual information as a conversational resource in collaborative physical tasks. Human-computer interaction 18, 1: 13--49. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Benjamin Lafreniere, Tovi Grossman, and George Fitzmaurice. 2013. Community enhanced tutorials: improving tutorials with multiple demonstrations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1779--1788. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. David W McDonald, Chunhua Weng, and John H Gennari. 2004. The multiple views of inter-organizational authoring. In Proceedings of the 2004 ACM conference on Computer supported cooperative work, 564--573. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Jakko van der Pol, Wilfried Admiraal, and P Robert-Jan Simons. 2006. The affordance of anchored discussion for the collaborative processing of academic texts. International Journal of Computer-Supported Collaborative Learning 1, 3: 339--357.Google ScholarGoogle ScholarCross RefCross Ref
  26. J Van Der Pol, W Admiraal, and R-J Simons. 2003. Grounding in electronic discussions: Standard (threaded) versus anchored discussion. In Designing for change in networked learning environments. Springer, 77--81.Google ScholarGoogle Scholar
  27. Carolyn Penstein Rosé and Oliver Ferschke. 2016. Technology Support for Discussion Based Learning: From Computer Supported Collaborative Learning to the Future of Massive Open Online Courses. International Journal of Artificial Intelligence in Education: 1--19.Google ScholarGoogle Scholar
  28. Susana Rubio, Eva Diaz, Jesús Martin, and José M Puente. 2004. Evaluation of subjective mental workload: A comparison of SWAT, NASA-TLX, and workload profile methods. Applied Psychology 53, 1: 61--86.Google ScholarGoogle ScholarCross RefCross Ref
  29. Patrick E Shrout and Joseph L Fleiss. 1979. Intraclass correlations: uses in assessing rater reliability. Psychological bulletin 86, 2: 420.Google ScholarGoogle Scholar
  30. George Siemens. 2014. Connectivism: A learning theory for the digital age.Google ScholarGoogle Scholar
  31. Michael Tsang, George W Fitzmaurice, Gordon Kurtenbach, Azam Khan, and Bill Buxton. 2002. Boom chameleon: simultaneous capture of 3D viewpoint, voice and gesture annotations on a spatially-aware display. In Proceedings of the 15th annual ACM symposium on User interface software and technology, 111--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Patricia G Wojahn, Christine M Neuwirth, and Barbara Bullock. 1998. Effects of interfaces for annotation on communication in a collaborative task. In Proceedings of the SIGCHI conference on Human factors in computing systems, 456--46 Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Dongwook Yoon, Nicholas Chen, François Guimbretière, and Abigail Sellen. 2014. RichReview: blending ink, speech, and gesture to support collaborative document review. In Proceedings of the 27th annual ACM symposium on User interface software and technology, 481--490. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Dongwook Yoon, Nicholas Chen, Bernie Randles, Amy Cheatle, Corinna E Löckenhoff, Steven J Jackson, Abigail Sellen, and François Guimbretière. 2016. RichReview++: Deployment of a Collaborative Multi-modal Annotation System for Instructor Feedback and Peer Discussion. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing, 195--205. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Joyce Zhu, Jeremy Warner, Mitchell Gordon, Jeffery White, Renan Zanelatto, and Philip J Guo. 2015. Toward a Domain-Specific Visual Discussion Forum for Learning Computer Programming: An Empirical Study of a Popular MOOC Forum.Google ScholarGoogle Scholar
  36. Sacha Zyto, David Karger, Mark Ackerman, and Sanjoy Mahajan. 2012. Successful classroom deployment of a social document annotation system. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems, 1883--1892. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Korero: Facilitating Complex Referencing of Visual Materials in Asynchronous Discussion Interface

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!