skip to main content
research-article
Open Access

Gestures as Intrinsic Creativity Support: Understanding the Usage and Function of Hand Gestures in Computer-Mediated Group Brainstorming

Published:05 December 2019Publication History
Skip Abstract Section

Abstract

Interpersonal communication is essential to group creativity tasks, such as group brainstorming. However, what's easily overlooked in supporting group creativity is the potential use of nonverbal behavior in communication. When people communicate verbally (e.g., discussing a topic through conversation), they may also co-produce hand movements along with verbal contents as part of the communication process. Going beyond using external interventions for creativity gain, we examine the potential to facilitate worker's in-conversation gesture use as an intrinsic mechanism for bolstering group creativity. In this paper, we aim to gain a deeper understanding of the usage and function of hand gestures in computer-mediated group brainstorming. Through a laboratory study, we verified that metaphoric gestures, or producing spatial cues with hands to convey intended concepts, can best influence self's and partner's idea generation. Also, the positive effect of metaphoric gesture is independent of media richness of communication medium (e.g., whether there's visibility or not). The results help to fill in the knowledge gap regarding how gesture use may relate to group creativity, and reveal the potential viability of shaping metaphoric gesture use as an intrinsic creativity support.

References

  1. Teresa M Amabile. 1996. Creativity in context: Update to the social psychology of creativity. Hachette UK.Google ScholarGoogle Scholar
  2. Jounghoon Beh, David K Han, Ramani Durasiwami, and Hanseok Ko. 2014. Hidden Markov model on a unit hypersphere space for gesture trajectory recognition. Pattern Recognition Letters 36 (2014), 144--153.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Prashant Bordia. 1997. Face-to-face versus computer-mediated communication: A synthesis of the experimental literature. The Journal of Business Communication (1973) 34, 1 (1997), 99--118.Google ScholarGoogle Scholar
  4. Stéphanie Buisine, Guillaume Besacier, Améziane Aoussat, and Frédéric Vernier. 2012. How do interactive tabletop systems influence collaboration? Computers in human behavior 28, 1 (2012), 49--59.Google ScholarGoogle Scholar
  5. Mingyuan Chu and Sotaro Kita. 2008. Spontaneous gestures during mental rotation tasks: Insights into the microdevelopment of the motor strategy. Journal of Experimental Psychology: General 137, 4 (2008), 706.Google ScholarGoogle Scholar
  6. Mingyuan Chu and Sotaro Kita. 2016. Co-thought and co-speech gestures are generated by the same action generation process. Journal of Experimental Psychology: Learning, Memory, and Cognition 42, 2 (2016), 257.Google ScholarGoogle ScholarCross RefCross Ref
  7. Herbert H Clark, Susan E Brennan, et al. 1991. Grounding in communication. Perspectives on socially shared cognition 13, 1991 (1991), 127--149.Google ScholarGoogle Scholar
  8. Fariborz Damanpour and Deepa Aravind. 2012. Organizational structure and innovation revisited: From organic to ambidextrous structure. In Handbook of organizational creativity. Elsevier, 483--513.Google ScholarGoogle Scholar
  9. Alan R Dennis, Randall K Minas, and Akshay P Bhagwatwar. 2013. Sparking creativity: Improving electronic brainstorming with individual cognitive priming. Journal of Management Information Systems 29, 4 (2013), 195--216.Google ScholarGoogle ScholarCross RefCross Ref
  10. Alan R Dennis and Barbara H Wixom. 2002. Investigating the moderators of the group support systems use with meta-analysis. Journal of Management Information Systems 18, 3 (2002), 235--257.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Michael Diehl and Wolfgang Stroebe. 1991. Productivity loss in idea-generating groups: Tracking down the blocking effect. Journal of personality and social psychology 61, 3 (1991), 392.Google ScholarGoogle ScholarCross RefCross Ref
  12. Paul Ekman and Wallace V Friesen. 1971. Constants across cultures in the face and emotion. Journal of personality and social psychology 17, 2 (1971), 124.Google ScholarGoogle ScholarCross RefCross Ref
  13. R. Brent Gallupe, Alan R Dennis, William H Cooper, Joseph S Valacich, Lana M Bastianutti, and Jay F Nunamaker Jr. 1992. Electronic brainstorming and group size. Academy of Management Journal 35, 2 (1992), 350--369.Google ScholarGoogle ScholarCross RefCross Ref
  14. Florian Geyer, Jochen Budzinski, and Harald Reiterer. 2012. IdeaVis: a hybrid workspace and interactive visualization for paper-based collaborative sketching sessions. In Proceedings of the 7th Nordic Conference on Human-Computer Interaction: Making Sense Through Design. ACM, 331--340.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Susan Goldin-Meadow. 2005. Hearing gesture: How our hands help us think. Harvard University Press.Google ScholarGoogle Scholar
  16. Joy Pual Guilford. 1950. Creativity. American Psychologist 5, 9 (1950), 444--454.Google ScholarGoogle Scholar
  17. François Guimbretière, Maureen Stone, and Terry Winograd. 2001. Fluid interaction with high-resolution wall-size displays. In Proceedings of the 14th annual ACM symposium on User interface software and technology. ACM, 21--30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Gunnar Harboe and Elaine M. Huang. 2015. Real-World Affinity Diagramming Practices: Bridging the Paper-Digital Gap. In Proceedings of the 33rd Annual ACM Conference on Human Factors in Computing Systems (CHI '15). ACM, New York, NY, USA, 95--104. https://doi.org/10.1145/2702123.2702561Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Kevin Hogan. 2003. Can't get through: eight barriers to communication. Pelican Publishing.Google ScholarGoogle Scholar
  20. Sotaro Kita, Martha W Alibali, and Mingyuan Chu. 2017. How do gestures influence thinking and speaking? The gesture-for-conceptualization hypothesis. Psychological review 124, 3 (2017), 245.Google ScholarGoogle Scholar
  21. Lassi A. Liikkanen, Kai Kuikkaniemi, Petri Lievonen, and Pauli Ojala. 2011. Next Step in Electronic Brainstorming: Collaborative Creativity with the Web. In CHI '11 Extended Abstracts on Human Factors in Computing Systems (CHI EA '11). ACM, New York, NY, USA, 2029--2034. https://doi.org/10.1145/1979742.1979929Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Kuan-Yu Lin. 2017. A Multidimensionally Codified Dataset of Speech-Accompanying Gesture in Cross-Lingual Communication. Master's thesis. Department of Computer Science, National Tsing Hua University.Google ScholarGoogle Scholar
  23. Kuan-Yu Lin, Seraphina Yong, Shuo-Ping Wang, Chien-Tung Lai, and Hao-Chuan Wang. 2016. HandVis: Visualized Gesture Support for Remote Cross-Lingual Communication. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, New York, NY, USA, 1236--1242. https: //doi.org/10.1145/2851581.2892431Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Zhe Lin, Zhuolin Jiang, and Larry S Davis. 2009. Recognizing actions by shape-motion prototype trees. In Computer Vision, 2009 IEEE 12th International Conference on. IEEE, 444--451.Google ScholarGoogle ScholarCross RefCross Ref
  25. David McNeill. 1992. Hand and mind: What gestures reveal about thought. University of Chicago press.Google ScholarGoogle Scholar
  26. John Neter, Michael H Kutner, Christopher J Nachtsheim, and William Wasserman. 1996. Applied linear statistical models. Vol. 4. Irwin Chicago.Google ScholarGoogle Scholar
  27. Jay F. Nunamaker, Alan R Dennis, Joseph S Valacich, Douglas Vogel, and Joey F George. 1991. Electronic meeting systems. Commun. ACM 34, 7 (1991), 40--61.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Paul B Paulus and Vincent R Brown. 2007. Toward more creative and innovative group idea generation: A cognitivesocial- motivational perspective of brainstorming. Social and Personality Psychology Compass 1, 1 (2007), 248--265.Google ScholarGoogle ScholarCross RefCross Ref
  29. Pramod Kumar Pisharady and Martin Saerbeck. 2015. Recent methods and databases in vision-based hand gesture recognition: A review. Computer Vision and Image Understanding 141 (2015), 152--165.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Deepa K. Ray and Nicholas C. Romano. 2013. Creative Problem Solving in GSS Groups: Do Creative Styles Matter? Group Decision and Negotiation 22, 6 (01 Nov 2013), 1129--1157. https://doi.org/10.1007/s10726-012--9309--3Google ScholarGoogle Scholar
  31. Ronald E Rice. 1992. Task analyzability, use of new media, and effectiveness: A multi-site exploration of media richness. Organization science 3, 4 (1992), 475--500.Google ScholarGoogle Scholar
  32. Yang Shi, YangWang, Ye Qi, John Chen, Xiaoyao Xu, and Kwan-Liu Ma. 2017. IdeaWall: Improving creative collaboration through combinatorial visual stimuli. In Proceedings of the 2017 ACM Conference on Computer Supported Cooperative Work and Social Computing. ACM, 594--603.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Ben Shneiderman. 2009. Creativity support tools: A grand challenge for HCI researchers. In Engineering the User Interface. Springer, 1--9.Google ScholarGoogle Scholar
  34. Yale Song, David Demirdjian, and Randall Davis. 2011. Tracking body and hands for gesture recognition: Natops aircraft handling signals database. In Automatic Face & Gesture Recognition and Workshops (FG 2011), 2011 IEEE International Conference on. IEEE, 500--506.Google ScholarGoogle ScholarCross RefCross Ref
  35. Mikel Sorli and Dragan Stokic. 2009. Innovating in product/process development: Gaining pace in new product development. Springer Science & Business Media.Google ScholarGoogle Scholar
  36. JH Steiger. 1980. Tests for comparing elements of a correlation matrix. Psychological Bulletin 87 (01 1980), 245--251. https://doi.org/10.1037//0033--2909.87.2.245Google ScholarGoogle Scholar
  37. Robert J Sternberg and Robert Jeffrey Sternberg. 1999. Handbook of creativity. Cambridge University Press.Google ScholarGoogle Scholar
  38. Jonathan Tompson, Murphy Stein, Yann Lecun, and Ken Perlin. 2014. Real-time continuous pose recovery of human hands using convolutional networks. ACM Transactions on Graphics (ToG) 33, 5 (2014), 169.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Hao-Chuan Wang, Dan Cosley, and Susan R. Fussell. 2010. Idea Expander: Supporting Group Brainstorming with Conversationally Triggered Visual Thinking Stimuli. In Proceedings of the 2010 ACM Conference on Computer Supported Cooperative Work (CSCW '10). ACM, New York, NY, USA, 103--106. https://doi.org/10.1145/1718918.1718938Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Hao-Chuan Wang and Chien-Tung Lai. 2014. Kinect-taped communication: using motion sensing to study gesture use and similarity in face-to-face and computer-mediated brainstorming. In Proceedings of the SIGCHI Conference onHuman Factors in Computing Systems. ACM, 3205--3214.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. William Widjaja and Makoto Takahashi. 2016. Distributed interface for group affinity-diagram brainstorming. Concurrent Engineering 24, 4 (2016), 344--358.Google ScholarGoogle ScholarCross RefCross Ref
  42. Takeshi Yabe and Katsumi Tanaka. 1999. Similarity retrieval of human motion as multi-stream time series data. In Database Applications in Non-Traditional Environments, 1999.(DANTE'99) Proceedings. 1999 International Symposium on. IEEE, 279--286.Google ScholarGoogle Scholar
  43. Ho-Sub Yoon, Jung Soh, Younglae J Bae, and Hyun Seung Yang. 2001. Hand gesture recognition using combined features of location, angle and velocity. Pattern recognition 34, 7 (2001), 1491--1501.Google ScholarGoogle Scholar

Index Terms

  1. Gestures as Intrinsic Creativity Support: Understanding the Usage and Function of Hand Gestures in Computer-Mediated Group Brainstorming

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!