Abstract
Interpersonal communication is essential to group creativity tasks, such as group brainstorming. However, what's easily overlooked in supporting group creativity is the potential use of nonverbal behavior in communication. When people communicate verbally (e.g., discussing a topic through conversation), they may also co-produce hand movements along with verbal contents as part of the communication process. Going beyond using external interventions for creativity gain, we examine the potential to facilitate worker's in-conversation gesture use as an intrinsic mechanism for bolstering group creativity. In this paper, we aim to gain a deeper understanding of the usage and function of hand gestures in computer-mediated group brainstorming. Through a laboratory study, we verified that metaphoric gestures, or producing spatial cues with hands to convey intended concepts, can best influence self's and partner's idea generation. Also, the positive effect of metaphoric gesture is independent of media richness of communication medium (e.g., whether there's visibility or not). The results help to fill in the knowledge gap regarding how gesture use may relate to group creativity, and reveal the potential viability of shaping metaphoric gesture use as an intrinsic creativity support.
- Teresa M Amabile. 1996. Creativity in context: Update to the social psychology of creativity. Hachette UK.Google Scholar
- Jounghoon Beh, David K Han, Ramani Durasiwami, and Hanseok Ko. 2014. Hidden Markov model on a unit hypersphere space for gesture trajectory recognition. Pattern Recognition Letters 36 (2014), 144--153.Google Scholar
Digital Library
- Prashant Bordia. 1997. Face-to-face versus computer-mediated communication: A synthesis of the experimental literature. The Journal of Business Communication (1973) 34, 1 (1997), 99--118.Google Scholar
- Stéphanie Buisine, Guillaume Besacier, Améziane Aoussat, and Frédéric Vernier. 2012. How do interactive tabletop systems influence collaboration? Computers in human behavior 28, 1 (2012), 49--59.Google Scholar
- Mingyuan Chu and Sotaro Kita. 2008. Spontaneous gestures during mental rotation tasks: Insights into the microdevelopment of the motor strategy. Journal of Experimental Psychology: General 137, 4 (2008), 706.Google Scholar
- Mingyuan Chu and Sotaro Kita. 2016. Co-thought and co-speech gestures are generated by the same action generation process. Journal of Experimental Psychology: Learning, Memory, and Cognition 42, 2 (2016), 257.Google Scholar
Cross Ref
- Herbert H Clark, Susan E Brennan, et al. 1991. Grounding in communication. Perspectives on socially shared cognition 13, 1991 (1991), 127--149.Google Scholar
- Fariborz Damanpour and Deepa Aravind. 2012. Organizational structure and innovation revisited: From organic to ambidextrous structure. In Handbook of organizational creativity. Elsevier, 483--513.Google Scholar
- Alan R Dennis, Randall K Minas, and Akshay P Bhagwatwar. 2013. Sparking creativity: Improving electronic brainstorming with individual cognitive priming. Journal of Management Information Systems 29, 4 (2013), 195--216.Google Scholar
Cross Ref
- Alan R Dennis and Barbara H Wixom. 2002. Investigating the moderators of the group support systems use with meta-analysis. Journal of Management Information Systems 18, 3 (2002), 235--257.Google Scholar
Digital Library
- Michael Diehl and Wolfgang Stroebe. 1991. Productivity loss in idea-generating groups: Tracking down the blocking effect. Journal of personality and social psychology 61, 3 (1991), 392.Google Scholar
Cross Ref
- Paul Ekman and Wallace V Friesen. 1971. Constants across cultures in the face and emotion. Journal of personality and social psychology 17, 2 (1971), 124.Google Scholar
Cross Ref
- R. Brent Gallupe, Alan R Dennis, William H Cooper, Joseph S Valacich, Lana M Bastianutti, and Jay F Nunamaker Jr. 1992. Electronic brainstorming and group size. Academy of Management Journal 35, 2 (1992), 350--369.Google Scholar
Cross Ref
- Florian Geyer, Jochen Budzinski, and Harald Reiterer. 2012. IdeaVis: a hybrid workspace and interactive visualization for paper-based collaborative sketching sessions. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, 331--340.Google Scholar
Digital Library
- Susan Goldin-Meadow. 2005. Hearing gesture: How our hands help us think. Harvard University Press.Google Scholar
- Joy Pual Guilford. 1950. Creativity. American Psychologist 5, 9 (1950), 444--454.Google Scholar
- François Guimbretière, Maureen Stone, and Terry Winograd. 2001. Fluid interaction with high-resolution wall-size displays. In Proceedings of the 14th annual ACM symposium on User interface software and technology. ACM, 21--30.Google Scholar
Digital Library
- Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104. https://doi.org/10.1145/2702123.2702561Google Scholar
Digital Library
- Kevin Hogan. 2003. Can't get through: eight barriers to communication. Pelican Publishing.Google Scholar
- Sotaro Kita, Martha W Alibali, and Mingyuan Chu. 2017. How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological review 124, 3 (2017), 245.Google Scholar
- Lassi A. Liikkanen, Kai Kuikkaniemi, Petri Lievonen, and Pauli Ojala. 2011. Next Step in Electronic Brainstorming: Collaborative Creativity with the Web. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 2029--2034. https://doi.org/10.1145/1979742.1979929Google Scholar
Digital Library
- Kuan-Yu Lin. 2017. A Multidimensionally Codified Dataset of Speech-Accompanying Gesture in Cross-Lingual Communication. Master's thesis. Department of Computer Science, National Tsing Hua University.Google Scholar
- Kuan-Yu Lin, Seraphina Yong, Shuo-Ping Wang, Chien-Tung Lai, and Hao-Chuan Wang. 2016. HandVis: Visualized Gesture Support for Remote Cross-Lingual Communication. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1236--1242. https: //doi.org/10.1145/2851581.2892431Google Scholar
Digital Library
- Zhe Lin, Zhuolin Jiang, and Larry S Davis. 2009. Recognizing actions by shape-motion prototype trees. In Computer Vision, 2009 IEEE 12th International Conference on. IEEE, 444--451.Google Scholar
Cross Ref
- David McNeill. 1992. Hand and mind: What gestures reveal about thought. University of Chicago press.Google Scholar
- John Neter, Michael H Kutner, Christopher J Nachtsheim, and William Wasserman. 1996. Applied linear statistical models. Vol. 4. Irwin Chicago.Google Scholar
- Jay F. Nunamaker, Alan R Dennis, Joseph S Valacich, Douglas Vogel, and Joey F George. 1991. Electronic meeting systems. Commun. ACM 34, 7 (1991), 40--61.Google Scholar
Digital Library
- Paul B Paulus and Vincent R Brown. 2007. Toward more creative and innovative group idea generation: A cognitivesocial- motivational perspective of brainstorming. Social and Personality Psychology Compass 1, 1 (2007), 248--265.Google Scholar
Cross Ref
- Pramod Kumar Pisharady and Martin Saerbeck. 2015. Recent methods and databases in vision-based hand gesture recognition: A review. Computer Vision and Image Understanding 141 (2015), 152--165.Google Scholar
Digital Library
- Deepa K. Ray and Nicholas C. Romano. 2013. Creative Problem Solving in GSS Groups: Do Creative Styles Matter? Group Decision and Negotiation 22, 6 (01 Nov 2013), 1129--1157. https://doi.org/10.1007/s10726-012--9309--3Google Scholar
- Ronald E Rice. 1992. Task analyzability, use of new media, and effectiveness: A multi-site exploration of media richness. Organization science 3, 4 (1992), 475--500.Google Scholar
- Yang Shi, YangWang, Ye Qi, John Chen, Xiaoyao Xu, and Kwan-Liu Ma. 2017. IdeaWall: Improving creative collaboration through combinatorial visual stimuli. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 594--603.Google Scholar
Digital Library
- Ben Shneiderman. 2009. Creativity support tools: A grand challenge for HCI researchers. In Engineering the User Interface. Springer, 1--9.Google Scholar
- Yale Song, David Demirdjian, and Randall Davis. 2011. Tracking body and hands for gesture recognition: Natops aircraft handling signals database. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on. IEEE, 500--506.Google Scholar
Cross Ref
- Mikel Sorli and Dragan Stokic. 2009. Innovating in product/process development: Gaining pace in new product development. Springer Science & Business Media.Google Scholar
- JH Steiger. 1980. Tests for comparing elements of a correlation matrix. Psychological Bulletin 87 (01 1980), 245--251. https://doi.org/10.1037//0033--2909.87.2.245Google Scholar
- Robert J Sternberg and Robert Jeffrey Sternberg. 1999. Handbook of creativity. Cambridge University Press.Google Scholar
- Jonathan Tompson, Murphy Stein, Yann Lecun, and Ken Perlin. 2014. Real-time continuous pose recovery of human hands using convolutional networks. ACM Transactions on Graphics (ToG) 33, 5 (2014), 169.Google Scholar
Digital Library
- Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 103--106. https://doi.org/10.1145/1718918.1718938Google Scholar
Digital Library
- Hao-Chuan Wang and Chien-Tung Lai. 2014. Kinect-taped communication: using motion sensing to study gesture use and similarity in face-to-face and computer-mediated brainstorming. In Proceedings of the SIGCHI Conference onHuman Factors in Computing Systems. ACM, 3205--3214.Google Scholar
Digital Library
- William Widjaja and Makoto Takahashi. 2016. Distributed interface for group affinity-diagram brainstorming. Concurrent Engineering 24, 4 (2016), 344--358.Google Scholar
Cross Ref
- Takeshi Yabe and Katsumi Tanaka. 1999. Similarity retrieval of human motion as multi-stream time series data. In Database Applications in Non-Traditional Environments, 1999.(DANTE'99) Proceedings. 1999 International Symposium on. IEEE, 279--286.Google Scholar
- Ho-Sub Yoon, Jung Soh, Younglae J Bae, and Hyun Seung Yang. 2001. Hand gesture recognition using combined features of location, angle and velocity. Pattern recognition 34, 7 (2001), 1491--1501.Google Scholar
Index Terms
Gestures as Intrinsic Creativity Support: Understanding the Usage and Function of Hand Gestures in Computer-Mediated Group Brainstorming
Recommendations
Kinect-taped communication: using motion sensing to study gesture use and similarity in face-to-face and computer-mediated brainstorming
CHI '14: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsOne key difference between face-to-face (F2F) communication and computer-mediated communication (CMC) is the availability of visual cues. It is often assumed that the reduction of visibility in audio and video conferencing may negatively impact the use ...
Using language-retrieved pictures to support intercultural brainstorming
CHI EA '11: CHI '11 Extended Abstracts on Human Factors in Computing SystemsGroup brainstorming is a commonly practiced technique to enhance creative outcomes. Cultural differences in knowledge and perspectives are valuable sources for diversity essential to creative outcomes, while cultural discrepancy in communication and ...
Collaborative creativity: a complex systems model with distributed affect
CHI '11: Proceedings of the SIGCHI Conference on Human Factors in Computing SystemsThe study of creativity has received significant attention over the past century, with a recent increase in interest in collaborative, distributed creativity. We posit that creativity in distributed groups is fostered by software interfaces that ...






Comments