Abstract
Countless human pursuits depend upon collaborative problem solving, especially in complex, open-ended domains. As part of the growing technological support for such collaboration, an opportunity exists to design systems that actively guide and facilitate collaborative problem solving toward the most productive outcomes. A better understanding of the dynamics of open-ended collaboration on complex problems is needed to realize this opportunity. Motivated by this need for better understanding, we investigate the collaborative problem solving ecosystem of the scientific-discovery game Foldit. Our investigation is guided by two primary questions: how do the social aspects of Foldit impact an individual's behavior? and what factors have significant impact on group success? We find that collaboration and competition are associated with increased participation and that collaboration increases individual performance. We also find that measures of group skill, individual skill, and participation correlate with better group performance.
- Brigid Barron. 2000. Achieving coordination in collaborative problem-solving groups. The journal of the learning sciences 9, 4 (2000), 403--436.Google Scholar
- Joel Chan, Steven Dang, and Steven P Dow. 2016. Improving crowd innovation with expert facilitation. In Proceedings of the 19th ACM Conference on Computer-Supported Cooperative Work & Social Computing. ACM, 1223--1235. Google Scholar
Digital Library
- Seth Cooper, Firas Khatib, Ilya Makedon, Hao Lu, Janos Barbero, David Baker, James Fogarty, Zoran Popović, and others. 2011. Analysis of social gameplay macros in the Foldit cookbook. In Proceedings of the 6th International Conference on Foundations of Digital Games. ACM, 9--14. Google Scholar
Digital Library
- Seth Cooper, Firas Khatib, Adrien Treuille, Janos Barbero, Jeehyung Lee, Michael Beenen, Andrew Leaver-Fay, David Baker, Zoran Popović, and others. 2010. Predicting protein structures with a multiplayer online game. Nature 466, 7307 (2010), 756--760.Google Scholar
Cross Ref
- Dan Cosley, Dan Frankowski, Loren Terveen, and John Riedl. 2007. SuggestBot: using intelligent task routing to help people find work in wikipedia. In Proceedings of the 12th international conference on Intelligent user interfaces. ACM, 32--41. Google Scholar
Digital Library
- National Research Council and others. 2000. How people learn: Brain, mind, experience, and school: Expanded edition. National Academies Press.Google Scholar
- Justin Cranshaw and Aniket Kittur. 2011. The polymath project: lessons from a successful online collaboration in mathematics. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 1865--1874. Google Scholar
Digital Library
- Steven Dow, Anand Kulkarni, Scott Klemmer, and Björn Hartmann. 2012. Shepherding the crowd yields better work. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 1013--1022. Google Scholar
Digital Library
- Christopher B Eiben, Justin B Siegel, Jacob B Bale, Seth Cooper, Firas Khatib, Betty W Shen, Barry L Stoddard, Zoran Popovic, and David Baker. 2012. Increased Diels-Alderase activity through backbone remodeling guided by Foldit players. Nature biotechnology 30, 2 (2012), 190--192.Google Scholar
- Sandra B Fan, Tyler Robison, and Steven L Tanimoto. 2012. CoSolve: A system for engaging users in computer-supported collaborative problem solving. In 2012 IEEE Symposium on Visual Languages and Human-Centric Computing (VL/HCC). IEEE, 205--212.Google Scholar
Cross Ref
- J Richard Hackman. 2002. Leading teams: Setting the stage for great performances. Harvard Business Press.Google Scholar
- Joshua Introne, Robert Laubacher, Gary Olson, and Thomas Malone. 2011. The Climate CoLab: Large scale model-based collaborative planning. In Collaboration Technologies and Systems (CTS), 2011 International Conference on. IEEE, 40--47.Google Scholar
Cross Ref
- Alan Irwin. 1995. Citizen science: A study of people, expertise and sustainable development. Psychology Press.Google Scholar
- Nicholas R Jennings. 1995. Controlling cooperative problem solving in industrial multi-agent systems using joint intentions. Artificial intelligence 75, 2 (1995), 195--240. Google Scholar
Digital Library
- David H. Jonassen. 2000. Toward a design theory of problem solving. Educational Technology Research and Development 48, 4 (2000), 63--85.Google Scholar
Cross Ref
- Norbert L Kerr and R Scott Tindale. 2004. Group performance and decision making. Annu. Rev. Psychol. 55 (2004), 623--655.Google Scholar
Cross Ref
- Firas Khatib, Frank DiMaio, Seth Cooper, Maciej Kazmierczyk, Miroslaw Gilski, Szymon Krzywda, Helena Zabranska, Iva Pichova, James Thompson, Zoran Popović, and others. 2011. Crystal structure of a monomeric retroviral protease solved by protein folding game players. Nature structural & molecular biology 18, 10 (2011), 1175--1177.Google Scholar
- Sunyoung Kim, Christine Robson, Thomas Zimmerman, Jeffrey Pierce, and Eben M Haber. 2011. Creek watch: pairing usefulness and usability for successful citizen science. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2125--2134. Google Scholar
Digital Library
- Young Ji Kim, David Engel, Anita Williams Woolley, Jeffrey Yu-Ting Lin, Naomi McArthur, and Thomas W Malone. 2017. What Makes a Strong Team?: Using Collective Intelligence to Predict Team Performance in League of Legends. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 2316--2329. Google Scholar
Digital Library
- Aniket Kittur and Robert E Kraut. 2008. Harnessing the wisdom of crowds in wikipedia: quality through coordination. In Proceedings of the 2008 ACM conference on Computer supported cooperative work. ACM, 37--46. Google Scholar
Digital Library
- Aniket Kittur, Boris Smus, Susheel Khamkar, and Robert E Kraut. 2011. Crowdforge: Crowdsourcing complex work. In Proceedings of the 24th annual ACM symposium on User interface software and technology. ACM, 43--52. Google Scholar
Digital Library
- Raddick M Jordan, Bracey Georgia, and Gay Pamela. 2010. Galaxy Zoo: Exploring the Motivations of Citizen Science Volunteers. Astronomy Education Review (2010).Google Scholar
- Sanna Malinen. 2015. Understanding user participation in online communities: A systematic literature review of empirical studies. Computers in human behavior 46 (2015), 228--238. Google Scholar
Digital Library
- Jeremy Roschelle and Stephanie D Teasley. 1995. The construction of shared knowledge in collaborative problem solving. In Computer supported collaborative learning. Springer, 69--97.Google Scholar
- Dana Rotman, Jenny Preece, Jen Hammock, Kezee Procita, Derek Hansen, Cynthia Parr, Darcy Lewis, and David Jacobs. 2012. Dynamic changes in motivation in collaborative citizen-science projects. In Proceedings of the ACM 2012 conference on Computer Supported Cooperative Work. ACM, 217--226. Google Scholar
Digital Library
- Nikol Rummel and Hans Spada. 2005. Learning to collaborate: An instructional approach to promoting collaborative problem solving in computer-mediated settings. The Journal of the Learning Sciences 14, 2 (2005), 201--241.Google Scholar
Cross Ref
- Burr Settles and Steven Dow. 2013. Let's get together: the formation and success of online creative collaborations. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. ACM, 2009--2018. Google Scholar
Digital Library
- Garold Stasser and William Titus. 2003. Hidden profiles: A brief history. Psychological Inquiry 14, 3--4 (2003), 304--313.Google Scholar
Cross Ref
- Brian L Sullivan, Christopher L Wood, Marshall J Iliff, Rick E Bonney, Daniel Fink, and Steve Kelling. 2009. eBird: A citizen-based bird observation network in the biological sciences. Biological Conservation 142, 10 (2009), 2282--2292.Google Scholar
Cross Ref
- Yla R Tausczik, Aniket Kittur, and Robert E Kraut. 2014. Collaborative problem solving: A study of mathoverflow. In Proceedings of the 17th ACM conference on Computer supported cooperative work & social computing. ACM, 355--367. Google Scholar
Digital Library
- Jonathan Tudge and Barbara Rogoff. 1999. Peer influences on cognitive development: Piagetian and Vygotskian perspectives. Lev Vygotsky: critical assessments 3 (1999), 32--56.Google Scholar
- Andrea Wiggins and Kevin Crowston. 2011. From conservation to crowdsourcing: A typology of citizen science. In System Sciences (HICSS), 2011 44th Hawaii international conference on. IEEE, 1--10. Google Scholar
Digital Library
- Anita Williams Woolley, Christopher F Chabris, Alex Pentland, Nada Hashmi, and Thomas W Malone. 2010. Evidence for a collective intelligence factor in the performance of human groups. science 330, 6004 (2010), 686--688.Google Scholar
- Stefan Wuchty, Benjamin F Jones, and Brian Uzzi. 2007. The increasing dominance of teams in production of knowledge. Science 316, 5827 (2007), 1036--1039.Google Scholar
Index Terms
Collaborative Problem Solving in an Open-Ended Scientific Discovery Game
Recommendations
Collaborative problem solving: a study of MathOverflow
CSCW '14: Proceedings of the 17th ACM conference on Computer supported cooperative work & social computingThe Internet has the potential to accelerate scientific problem solving by engaging a global pool of contributors. Existing approaches focus on broadcasting problems to many independent solvers. We investigate other approaches that may be advantageous ...
Computer-supported collaborative problem solving and anchored instruction in a mathematics classroom: an exploratory study
This is an exploratory study in the use of computer-supported collaborative problem solving and anchored instruction in a mathematics classroom in Singapore. The study was conducted with 45 grade six pupils. The pupils accessed the problem scenario ...
Roles in Online Collaborative Problem Solving
VLHCC '10: Proceedings of the 2010 IEEE Symposium on Visual Languages and Human-Centric ComputingThe growth of online social networking has created new opportunities for collaboration in problem solving. How can we ensure that everyone is able to make use of it? In my work, I will explore the use of user role assignments as a way to encourage ...






Comments