Abstract
Understanding team viability --- a team's capacity for sustained and future success --- is essential for building effective teams. In this study, we aggregate features drawn from the organizational behavior literature to train a viability classification model over a dataset of 669 10-minute text conversations of online teams. We train classifiers to identify teams at the top decile (most viable teams), 50th percentile (above a median split), and bottom decile (least viable teams), then characterize the attributes of teams at each of these viability levels. We find that a lasso regression model achieves an accuracy of .74--.92 AUC ROC under different thresholds of classifying viability scores. From these models, we identify the use of exclusive language such as 'but' and 'except', and the use of second person pronouns, as the most predictive features for detecting the most viable teams, suggesting that active engagement with others' ideas is a crucial signal of a viable team. Only a small fraction of the 10-minute discussion, as little as 70 seconds, is required for predicting the viability of team interaction. This work suggests opportunities for teams to assess, track, and visualize their own viability in real time as they collaborate.
- Rob Abbott, Marilyn Walker, Pranav Anand, Jean E Fox Tree, Robeson Bowmani, and Joseph King. 2011. How can you say such things?!?: Recognizing disagreement in informal political argument. In Proceedings of the Workshop on Languages in Social Media. Association for Computational Linguistics, 2--11.Google Scholar
- Kelsey Allen, Giuseppe Carenini, and Raymond Ng. 2014. Detecting disagreement in conversations using pseudomonologic rhetorical structure. In Proceedings of the 2014 Conference on Empirical Methods in Natural Language Processing (EMNLP). 1169--1180.Google Scholar
Cross Ref
- Pranav Anand, Marilyn Walker, Rob Abbott, Jean E. Fox Tree, Robeson Bowmani, and Michael Minor. 2011. Cats Rule and Dogs Drool!: Classifying Stance in Online Debate. In Proceedings of the 2Nd Workshop on Computational Approaches to Subjectivity and Sentiment Analysis (Portland, Oregon) (WASSA '11). Association for Computational Linguistics, Stroudsburg, PA, USA, 1--9. http://dl.acm.org/citation.cfm?id=2107653.2107654Google Scholar
- Caroline Aube and Vincent Rousseau. 2005. Team goal commitment and team effectiveness: the role of task interdependence and supportive behaviors. Group Dynamics: Theory, Research, and Practice 9, 3 (2005), 189.Google Scholar
Cross Ref
- Murray R Barrick, Greg L Stewart, Mitchell J Neubert, and Michael K Mount. 1998. Relating member ability and personality to work-team processes and team effectiveness. Journal of applied psychology 83, 3 (1998), 377.Google Scholar
Cross Ref
- Murray R Barrick, Greg L Stewart, Mitchell J Neubert, and Michael K Mount. 1998. Relating member ability and personality to work-team processes and team effectiveness. Journal of applied psychology 83, 3 (1998), 377.Google Scholar
Cross Ref
- Sigal G. Barsade. 2002. The Ripple Effect: Emotional Contagion and Its Influence on Group Behavior. Administrative Science Quarterly (2002), 644--675. https://doi.org/10.2307/3094912Google Scholar
- Daniel J Beal, Robin R Cohen, Michael J Burke, and Christy L McLendon. 2003. Cohesion and performance in groups: A meta-analytic clarification of construct relations. Journal of applied psychology 88, 6 (2003), 989.Google Scholar
- Kristin J Behfar, Randall S Peterson, Elizabeth A Mannix, and William MK Trochim. 2008. The critical role of conflict resolution in teams: A close look at the links between conflict type, conflict management strategies, and team outcomes. Journal of applied psychology 93, 1 (2008), 170.Google Scholar
Cross Ref
- Suzanne Bell and Brian Marentette. 2011. Team viability for long-term and ongoing organizational teams. Organizational Psychology Review 1 (11 2011), 275--292. https://doi.org/10.1177/2041386611405876Google Scholar
- Suzanne T Bell. 2007. Deep-level composition variables as predictors of team performance: a meta-analysis. Journal of applied psychology 92, 3 (2007), 595.Google Scholar
Cross Ref
- Suzanne T Bell and Brian J Marentette. 2011. Team viability for long-term and ongoing organizational teams. Organizational Psychology Review 1, 4 (2011), 275--292.Google Scholar
Cross Ref
- Bret H Bradley, Bennett E Postlethwaite, Anthony C Klotz, Maria R Hamdani, and Kenneth G Brown. 2012. Reaping the benefits of task conflict in teams: The critical role of team psychological safety climate. Journal of Applied Psychology 97, 1 (2012), 151.Google Scholar
Cross Ref
- Hancheng Cao, Zhilong Chen, Fengli Xu, Tao Wang, Yujian Xu, Lianglun Zhang, and Yong Li. 2020. When Your Friends Become Sellers: An Empirical Study of Social Commerce Site Beidian. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 14. 83--94.Google Scholar
- Sybil Carrère and John Mordechai Gottman. 1999. Predicting divorce among newlyweds from the first three minutes of a marital conflict discussion. Family process 38, 3 (1999), 293--301.Google Scholar
- Wayne Cascio and Ramiro Montealegre. 2016. How Technology Is Changing Work and Organizations. Annual Review of Organizational Psychology and Organizational Behavior 3 (03 2016), 349--375. https://doi.org/10.1146/annurevorgpsych- 041015-062352Google Scholar
- Zhilong Chen, Hancheng Cao, Fengli Xu, Mengjie Cheng, Tao Wang, and Yong Li. 2020. Understanding the Role of Intermediaries in Online Social E-commerce: An Exploratory Study of Beidian. Proceedings of the ACM on Human- Computer Interaction 4, CSCW2 (2020), 1--24.Google Scholar
Digital Library
- Jessica Nicole Cooperstein. 2017. Initial Development of a Team Viability Measure. (2017).Google Scholar
- Glen Coppersmith, Mark Dredze, and Craig Harman. 2014. Quantifying mental health signals in Twitter. In Proceedings of the workshop on computational linguistics and clinical psychology: From linguistic signal to clinical reality. 51--60.Google Scholar
Cross Ref
- Tugrul U Daim, Anita Ha, Shawn Reutiman, Brennan Hughes, Ujjal Pathak, Wayne Bynum, and Ashok Bhatla. 2012. Exploring the communication breakdown in global virtual teams. International Journal of Project Management 30, 2 (2012), 199--212.Google Scholar
Cross Ref
- Shelley D. Dionne, Hiroki Sayama, Chanyu Hao, and Benjamin J. Benjamin. 2010. The role of leadership in shared mental model convergence and team performance improvement: An agent-based computational model. (2010), 1035--1049. https://doi.org/10.1016/j.leaqua.2010.10.007Google Scholar
- Discourse. [n.d.]. This is a Civilized Place for Public Discussion. ([n. d.]). http://bit.ly/1TM8K5xGoogle Scholar
- Maeve Duggan. 2017. Online Harassment 2017. Pew Research Center (2017).Google Scholar
- Amy Edmondson. 1999. Psychological safety and learning behavior in work teams. Administrative science quarterly 44, 2 (1999), 350--383.Google Scholar
- R. M. Krauss. Fussell, S. R. 1992. Coordination of knowledge in communication: Effects of speakers? assumptions about what others know. Journal of Personality and Social Psychology 62 (1992).Google Scholar
- John Mordechai Gottman and Robert Wayne Levenson. 2000. The timing of divorce: Predicting when a couple will divorce over a 14-year period. Journal of Marriage and Family 62, 3 (2000), 737--745.Google Scholar
Cross Ref
- Penelope S. Greenberg, Ralph H. Greenberg, and Yvonne L. Antonucci. 2007. Creating and sustaining trust in virtual teams. (2007), 325--333. https://doi.org/10.1016/j.bushor.2007.02.005Google Scholar
- J Richard Hackman. 1980. Work redesign and motivation. Professional Psychology 11, 3 (1980), 445.Google Scholar
Cross Ref
- J Richard Hackman. 2011. Collaborative intelligence: Using teams to solve hard problems. Berrett-Koehler Publishers.Google Scholar
- Pamela Hinds. 2003. Out of Sight, Out of Sync: Understanding Conflict in Distributed Teams. Organization Science 14 (11 2003), 615--632. https://doi.org/10.1287/orsc.14.6.615.24872Google Scholar
- Pamela J Hinds and Diane E Bailey. 2003. Out of sight, out of sync: Understanding conflict in distributed teams. Organization science 14, 6 (2003), 615--632.Google Scholar
- Helene V Hjalmarson and Margaretha Strandmark. 2012. Forming a learning culture to promote fracture prevention activities. Health Education (2012).Google Scholar
- Malte F Jung. 2016. Coupling interactions and performance: Predicting team performance from thin slices of conflict. ACM Transactions on Computer-Human Interaction (TOCHI) 23, 3 (2016), 1--32.Google Scholar
Digital Library
- Ben Kirman, Conor Lineham, and Shaun Lawson. 2012. Exploring mischief and mayhem in social computing or: how we learned to stop worrying and love the trolls. In Extended Abstracts on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 121--130. https://doi.org/10.1145/2212776.2212790Google Scholar
- Aniket Kittur, Bongwon Suh, and Ed H. Chi. 2009. What? in Wikipedia? Mapping Topics and Conflict Using Socially Annotated Category Structure. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Boston, Massachusetts, USA) (CHI '09). ACM, New York, NY, USA, 1509--1512. https://doi.org/10.1145/1518701.1518930Google Scholar
- Steve WJ Kozlowski. 1998. Training and developing adaptive teams: Theory, principles, and research. (1998).Google Scholar
- Steve WJ Kozlowski and Bradford S Bell. 2007. Team learning, development, and adaptation. In Work group learning. Psychology Press, 39--68.Google Scholar
- Steve WJ Kozlowski, Stanley M Gully, Earl R Nason, and Eleanor M Smith. 1999. Developing adaptive teams: A theory of compilation and performance across levels and time. Pulakos (Eds.), The changing nature of work performance: Implications for staffing, personnel actions, and development 240 (1999), 292.Google Scholar
- Travis Kriplean, Michael Toomim, Jonathan Morgan, Alan Borning, and Andrew Ko. 2012. Is This What You Meant? Promoting Listening on the Web with Reflect. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (Austin, Texas, USA) (CHI '12). ACM, New York, NY, USA, 1559--1568. https://doi.org/10.1145/2207676.2208621Google Scholar
Digital Library
- Christina N Lacerenza, Shannon L Marlow, Scott I Tannenbaum, and Eduardo Salas. 2018. Team development interventions: Evidence-based approaches for improving teamwork. American Psychologist 73, 4 (2018), 517.Google Scholar
Cross Ref
- Claus W Langfred. 2007. The downside of self-management: A longitudinal study of the effects of conflict on trust, autonomy, and task interdependence in self-managing teams. Academy of management journal 50, 4 (2007), 885--900.Google Scholar
- Lindsay Larson, Harrison Wojcik, Ilya Gokhman, Leslie DeChurch, Suzanne Bell, and Noshir Contractor. 2019. Team performance in space crews: Houston, we have a teamwork problem. Acta Astronautica 161 (2019), 108--114.Google Scholar
Cross Ref
- Kristi M Lewis. 2000. When leaders display emotion: How followers respond to negative emotional expression of male and female leaders. Journal of Organizational Behavior: The International Journal of Industrial, Occupational and Organizational Psychology and Behavior 21, 2 (2000), 221--234.Google Scholar
Cross Ref
- M. Lewis. 2017. The Undoing Project: A Friendship that Changed the World. Penguin Books, Limited. https://books. google.ca/books?id=-ltNvgAACAAJGoogle Scholar
- Merce Mach, Simon Dolan, and Shay Tzafrir. 2010. The differential effect of team members? trust on team performance: The mediation role of team cohesion. Journal of Occupational and Organizational Psychology 83, 3 (2010), 771--794.Google Scholar
Cross Ref
- Christina Maslach, Michael P Leiter, and Susan E Jackson. 2012. Making a significant difference with burnout interventions: Researcher and practitioner collaboration. Journal of Organizational Behavior 33, 2 (2012), 296--300.Google Scholar
Cross Ref
- John Mathieu, M Travis Maynard, Tammy Rapp, and Lucy Gilson. 2008. Team effectiveness 1997--2007: A review of recent advancements and a glimpse into the future. Journal of management 34, 3 (2008), 410--476.Google Scholar
Cross Ref
- Jessica R Mesmer-Magnus and Leslie A DeChurch. 2009. Information sharing and team performance: A meta-analysis. Journal of applied psychology 94, 2 (2009), 535.Google Scholar
Cross Ref
- Frank Mueller. 1994. Societal effect, organizational effect and globalization. Organization Studies 15, 3 (1994), 407--428.Google Scholar
Cross Ref
- Smaranda Muresan, Roberto Gonzalez-Ibanez, Debanjan Ghosh, and Nina Wacholder. 2016. Identification of nonliteral language in social media: A case study on sarcasm. Journal of the Association for Information Science and Technology (2016), 2725--2737. https://doi.org/10.1002/asi.23624Google Scholar
- Thien Hai Nguyen, Kiyoaki Shirai, and Julien Velcin. 2015. Sentiment analysis on social media for stock movement prediction. Expert Systems with Applications 42, 24 (2015), 9603--9611.Google Scholar
Digital Library
- Vlad Niculae and Cristian Danescu-Niculescu-Mizil. 2016. Conversational markers of constructive discussions. arXiv preprint arXiv:1604.07407 (2016).Google Scholar
- Vlad Niculae and Cristian Danescu-Niculescu-Mizil. 2016. Conversational Markers of Constructive Discussions. CoRR abs/1604.07407 (2016). arXiv:1604.07407 http://arxiv.org/abs/1604.07407Google Scholar
- Gary M Olson and Judith S Olson. 2000. Distance matters. Human--computer interaction 15, 2--3 (2000), 139--178.Google Scholar
Digital Library
- Michelle O'Daniel and Alan H Rosenstein. 2008. Professional communication and team collaboration. In Patient safety and quality: An evidence-based handbook for nurses. Agency for Healthcare Research and Quality (US).Google Scholar
- F. Pedregosa, G. Varoquaux, A. Gramfort, V. Michel, B. Thirion, O. Grisel, M. Blondel, P. Prettenhofer, R. Weiss, V. Dubourg, J. Vanderplas, A. Passos, D. Cournapeau, M. Brucher, M. Perrot, and E. Duchesnay. 2011. Scikit-learn: Machine Learning in Python. Journal of Machine Learning Research 12 (2011), 2825--2830.Google Scholar
Digital Library
- P. Nye P. V. Balakrishnan Purdy, J. M. 2000. The impact of communication media on negotiation outcomes. International Journal of Conflict Management 11 (2000).Google Scholar
- Rebecca L Robinson, Reanelle Navea, and William Ickes. 2013. Predicting final course performance from students? written self-introductions: A LIWC analysis. Journal of Language and Social Psychology 32, 4 (2013), 469--479.Google Scholar
Cross Ref
- Antonette Shibani, Elizabeth Koh, Vivian Lai, and Kyong Jin Shim. 2017. Assessing the language of chat for teamwork dialogue. Journal of Educational Technology & Society 20, 2 (2017), 224--237.Google Scholar
- Swapna Somasundaran and Janyce Wiebe. 2010. Recognizing stances in ideological on-line debates. In Proceedings of the NAACL HLT 2010 workshop on computational approaches to analysis and generation of emotion in text. Association for Computational Linguistics, 116--124.Google Scholar
Digital Library
- Christine A Sprigg, Paul R Jackson, and Sharon K Parker. 2000. Production teamworking: The importance of interdependence and autonomy for employee strain and satisfaction. Human Relations 53, 11 (2000), 1519--1543.Google Scholar
Cross Ref
- Greg L Stewart. 2006. A meta-analytic review of relationships between team design features and team performance. Journal of management 32, 1 (2006), 29--55.Google Scholar
Cross Ref
- J. E. McGrath Straus, S. 1994. Does the medium matter? The interaction of task type and technology on group performance and member reactions. Journal of Applied Psychology 79 (1994).Google Scholar
- Susan G Straus. 1999. Testing a typology of tasks: An empirical validation of McGrath?s (1984) group task circumplex. Small Group Research 30, 2 (1999), 166--187.Google Scholar
Cross Ref
- Jim Suchan and Greg Hayzak. 2001. The communication characteristics of virtual teams: a case study. IEEE Transactions on Professional Communication (2001), 174--186. https://doi.org/10.1109/47.946463Google Scholar
- Yla R Tausczik and James W Pennebaker. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology 29, 1 (2010), 24--54.Google Scholar
- Steven Vallas. 2003. Why Teamwork Fails: Obstacles to Workplace Change in Four Manufacturing Plants. American Sociological Review 68 (04 2003). https://doi.org/10.2307/1519767Google Scholar
- Ben Weidmann and David J Deming. 2020. Team Players: How Social Skills Improve Group Performance. Technical Report. National Bureau of Economic Research.Google Scholar
Cross Ref
- Mark E. Whiting, Allie Blaising, Chloe Barreau, Laura Fiuza, Nik Marda, Melissa Valentine, and Michael S. Bernstein. 2019. Did It Have To End This Way? Understanding The Consistency of Team Fracture. Proc. ACM Hum.-Comput. Interact. 3, CSCW, Article 209 (Nov. 2019), 23 pages. https://doi.org/10.1145/3359311Google Scholar
- Mark E Whiting, Irena Gao, Michelle Xing, Junior Diarrassouba N'Godjigui, Tonya Nguyen, and Michael S Bernstein. 2020. Parallel Worlds: Repeated Initializations of the Same Team To Improve Team Viability. Proc. ACM Hum.-Comput. Interact. 4, CSCW1, Article 67 (May 2020), 23 pages. https://doi.org/10.1145/3392877Google Scholar
Digital Library
- Mark E Whiting, Grant Hugh, and Michael S Bernstein. 2019. Fair Work: Crowd Work Minimum Wage with One Line of Code. In Proceedings of the AAAI Conference on Human Computation and Crowdsourcing, Vol. 7. 197--206.Google Scholar
Cross Ref
- Justine Zhang, Jonathan P Chang, Cristian Danescu-Niculescu-Mizil, Lucas Dixon, Yiqing Hua, Nithum Thain, and Dario Taraborelli. 2018. Conversations gone awry: Detecting early signs of conversational failure. arXiv preprint arXiv:1805.05345 (2018).Google Scholar
Index Terms
My Team Will Go On: Differentiating High and Low Viability Teams through Team Interaction
Recommendations
Parallel Worlds: Repeated Initializations of the Same Team to Improve Team Viability
CSCWA team's early interactions are influential: small behaviors cascade, driving the team either toward successful collaboration or toward fracture. Would a team be more viable if it could undo initial interactional missteps and try again? We introduce a ...
The Effects of Communication Media & Conflict on Team Identification in Diverse Teams
HICSS '05: Proceedings of the Proceedings of the 38th Annual Hawaii International Conference on System Sciences (HICSS'05) - Track 1 - Volume 01This paper explores the effects of communication media and conflict on team identification in diverse teams. Communicating either face-to-face (FTF) or via computer-mediated communication (CMC), participants performed a simulated foundation activity in ...
Challenging but Connective: Large-Scale Characteristics of Synchronous Collaboration Across Time Zones
CHI '23: Proceedings of the 2023 CHI Conference on Human Factors in Computing SystemsOrganizations are becoming increasingly distributed and many need to collaborate synchronously over great geographical distances. Despite a rich body of literature on spatially-distanced meetings, gaps remain in our understanding of temporally-...






Comments