skip to main content
research-article
Public Access

Collaborative Problem Solving in an Open-Ended Scientific Discovery Game

Published:06 December 2017Publication History
Skip Abstract Section

Abstract

Countless human pursuits depend upon collaborative problem solving, especially in complex, open-ended domains. As part of the growing technological support for such collaboration, an opportunity exists to design systems that actively guide and facilitate collaborative problem solving toward the most productive outcomes. A better understanding of the dynamics of open-ended collaboration on complex problems is needed to realize this opportunity. Motivated by this need for better understanding, we investigate the collaborative problem solving ecosystem of the scientific-discovery game Foldit. Our investigation is guided by two primary questions: how do the social aspects of Foldit impact an individual's behavior? and what factors have significant impact on group success? We find that collaboration and competition are associated with increased participation and that collaboration increases individual performance. We also find that measures of group skill, individual skill, and participation correlate with better group performance.

References

  1. Brigid Barron. 2000. Achieving coordination in collaborative problem-solving groups. The journal of the learning sciences 9, 4 (2000), 403--436.Google ScholarGoogle Scholar
  2. Joel Chan, Steven Dang, and Steven P Dow. 2016. Improving crowd innovation with expert facilitation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1223--1235. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Seth Cooper, Firas Khatib, Ilya Makedon, Hao Lu, Janos Barbero, David Baker, James Fogarty, Zoran Popović, and others. 2011. Analysis of social gameplay macros in the Foldit cookbook. In Proceedings of the 6th International Conference on Foundations of Digital Games. ACM, 9--14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popović, and others. 2010. Predicting protein structures with a multiplayer online game. Nature 466, 7307 (2010), 756--760.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dan Cosley, Dan Frankowski, Loren Terveen, and John Riedl. 2007. SuggestBot: using intelligent task routing to help people find work in wikipedia. In Proceedings of the 12th international conference on Intelligent user interfaces. ACM, 32--41. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. National Research Council and others. 2000. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press.Google ScholarGoogle Scholar
  7. Justin Cranshaw and Aniket Kittur. 2011. The polymath project: lessons from a successful online collaboration in mathematics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1865--1874. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Steven Dow, Anand Kulkarni, Scott Klemmer, and Björn Hartmann. 2012. Shepherding the crowd yields better work. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 1013--1022. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Christopher B Eiben, Justin B Siegel, Jacob B Bale, Seth Cooper, Firas Khatib, Betty W Shen, Barry L Stoddard, Zoran Popovic, and David Baker. 2012. Increased Diels-Alderase activity through backbone remodeling guided by Foldit players. Nature biotechnology 30, 2 (2012), 190--192.Google ScholarGoogle Scholar
  10. Sandra B Fan, Tyler Robison, and Steven L Tanimoto. 2012. CoSolve: A system for engaging users in computer-supported collaborative problem solving. In 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 205--212.Google ScholarGoogle ScholarCross RefCross Ref
  11. J Richard Hackman. 2002. Leading teams: Setting the stage for great performances. Harvard Business Press.Google ScholarGoogle Scholar
  12. Joshua Introne, Robert Laubacher, Gary Olson, and Thomas Malone. 2011. The Climate CoLab: Large scale model-based collaborative planning. In Collaboration Technologies and Systems (CTS), 2011 International Conference on. IEEE, 40--47.Google ScholarGoogle ScholarCross RefCross Ref
  13. Alan Irwin. 1995. Citizen science: A study of people, expertise and sustainable development. Psychology Press.Google ScholarGoogle Scholar
  14. Nicholas R Jennings. 1995. Controlling cooperative problem solving in industrial multi-agent systems using joint intentions. Artificial intelligence 75, 2 (1995), 195--240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. David H. Jonassen. 2000. Toward a design theory of problem solving. Educational Technology Research and Development 48, 4 (2000), 63--85.Google ScholarGoogle ScholarCross RefCross Ref
  16. Norbert L Kerr and R Scott Tindale. 2004. Group performance and decision making. Annu. Rev. Psychol. 55 (2004), 623--655.Google ScholarGoogle ScholarCross RefCross Ref
  17. Firas Khatib, Frank DiMaio, Seth Cooper, Maciej Kazmierczyk, Miroslaw Gilski, Szymon Krzywda, Helena Zabranska, Iva Pichova, James Thompson, Zoran Popović, and others. 2011. Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nature structural & molecular biology 18, 10 (2011), 1175--1177.Google ScholarGoogle Scholar
  18. Sunyoung Kim, Christine Robson, Thomas Zimmerman, Jeffrey Pierce, and Eben M Haber. 2011. Creek watch: pairing usefulness and usability for successful citizen science. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2125--2134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Young Ji Kim, David Engel, Anita Williams Woolley, Jeffrey Yu-Ting Lin, Naomi McArthur, and Thomas W Malone. 2017. What Makes a Strong Team?: Using Collective Intelligence to Predict Team Performance in League of Legends. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2316--2329. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Aniket Kittur and Robert E Kraut. 2008. Harnessing the wisdom of crowds in wikipedia: quality through coordination. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. ACM, 37--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E Kraut. 2011. Crowdforge: Crowdsourcing complex work. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 43--52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Raddick M Jordan, Bracey Georgia, and Gay Pamela. 2010. Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. Astronomy Education Review (2010).Google ScholarGoogle Scholar
  23. Sanna Malinen. 2015. Understanding user participation in online communities: A systematic literature review of empirical studies. Computers in human behavior 46 (2015), 228--238. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jeremy Roschelle and Stephanie D Teasley. 1995. The construction of shared knowledge in collaborative problem solving. In Computer supported collaborative learning. Springer, 69--97.Google ScholarGoogle Scholar
  25. Dana Rotman, Jenny Preece, Jen Hammock, Kezee Procita, Derek Hansen, Cynthia Parr, Darcy Lewis, and David Jacobs. 2012. Dynamic changes in motivation in collaborative citizen-science projects. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 217--226. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Nikol Rummel and Hans Spada. 2005. Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. The Journal of the Learning Sciences 14, 2 (2005), 201--241.Google ScholarGoogle ScholarCross RefCross Ref
  27. Burr Settles and Steven Dow. 2013. Let's get together: the formation and success of online creative collaborations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2009--2018. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Garold Stasser and William Titus. 2003. Hidden profiles: A brief history. Psychological Inquiry 14, 3--4 (2003), 304--313.Google ScholarGoogle ScholarCross RefCross Ref
  29. Brian L Sullivan, Christopher L Wood, Marshall J Iliff, Rick E Bonney, Daniel Fink, and Steve Kelling. 2009. eBird: A citizen-based bird observation network in the biological sciences. Biological Conservation 142, 10 (2009), 2282--2292.Google ScholarGoogle ScholarCross RefCross Ref
  30. Yla R Tausczik, Aniket Kittur, and Robert E Kraut. 2014. Collaborative problem solving: A study of mathoverflow. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 355--367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jonathan Tudge and Barbara Rogoff. 1999. Peer influences on cognitive development: Piagetian and Vygotskian perspectives. Lev Vygotsky: critical assessments 3 (1999), 32--56.Google ScholarGoogle Scholar
  32. Andrea Wiggins and Kevin Crowston. 2011. From conservation to crowdsourcing: A typology of citizen science. In System Sciences (HICSS), 2011 44th Hawaii international conference on. IEEE, 1--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Anita Williams Woolley, Christopher F Chabris, Alex Pentland, Nada Hashmi, and Thomas W Malone. 2010. Evidence for a collective intelligence factor in the performance of human groups. science 330, 6004 (2010), 686--688.Google ScholarGoogle Scholar
  34. Stefan Wuchty, Benjamin F Jones, and Brian Uzzi. 2007. The increasing dominance of teams in production of knowledge. Science 316, 5827 (2007), 1036--1039.Google ScholarGoogle Scholar

Index Terms

  1. Collaborative Problem Solving in an Open-Ended Scientific Discovery Game

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!