skip to main content
research-article

Complex and Ambiguous: Understanding Sticker Misinterpretations in Instant Messaging

Authors Info & Claims
Published:01 November 2018Publication History
Skip Abstract Section

Abstract

Stickers, though similar in appearance to emoji, have distinct characteristics because they often contain animation, diverse gestures, and multiple characters and objects. Stickers can convey richer meaning than emoji, but their complexity and placement constraint may result in miscommunication. In this paper, we aim to understand how people perceive emotion in stickers, as well as how miscommunication related to sticker occurs in actual chat contexts. Toward this goal, we conducted an online survey (n = 87) and in-depth interviews (n = 28) in South Korea. We found emotional and contextual aspects of sticker misinterpretation. In particular, emotion misinterpretation mostly happened due to stickers' ambiguous (multiple) facial/bodily expressions and different perception of dynamism in gestures. In real chat settings, there were also contextual misinterpretations where senders and receivers differently interpret stickers' visual representation/reference, or/and corresponding textual messages. Based on these findings, we provide several practical design implications such as context awareness support in sticker interaction.

References

  1. James A Russell. 2003. Core Affect and the Psychological Construction of Emotion. Psychological Review , Vol. 110, 1 (2003), 145--172.Google ScholarGoogle ScholarCross RefCross Ref
  2. Jr Artemio Ramirez and Kathy Broneck. 2009. `IM me': Instant messaging as relational maintenance and everyday communication. Journal of Social and Personal Relationships , Vol. 26, 2--3 (2009), 291--314.Google ScholarGoogle ScholarCross RefCross Ref
  3. Eric PS Baumer, Morgan G Ames, Jenna Burrell, Jed R Brubaker, and Paul Dourish. 2015. Why Study Technology Non-use? First Monday , Vol. 20, 11 (2015). http://firstmonday.org/ojs/index.php/fm/article/view/6310Google ScholarGoogle ScholarCross RefCross Ref
  4. Hugh Beyer and Karen Holtzblatt. 1998. Contextual Design: Defining Customer-Centered Systems .Academic Press. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dan Bouhnik and Mor Deshen. 2014. WhatsApp Goes to School: Mobile Instant Messaging between Teachers and Students. Journal of Information Technology Education: Research , Vol. 13 (1 2014), 217--231.Google ScholarGoogle ScholarCross RefCross Ref
  6. Judee K. Burgoon and Beth A. Le Poire. 1999. Nonverbal Cues and Interpersonal Judgments: Participant and Observer Perceptions of Intimacy, Dominance, Composure, and Formality. Communication Monographs , Vol. 66, 2 (1999), 105--124.Google ScholarGoogle ScholarCross RefCross Ref
  7. Karen Church and Rodrigo de Oliveira. 2013. What's Up with Whatsapp?: Comparing Mobile Instant Messaging Behaviors with Traditional SMS. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Herbert H. Clark. 1996. Using Language .Cambridge University Press.Google ScholarGoogle Scholar
  9. Kakao Corp. 2018. Investor Relations. (2018). https://t1.kakaocdn.net/kakaocorp/operating/ir/results-announcement/3246.pdfGoogle ScholarGoogle Scholar
  10. Henriette Cramer, Paloma de Juan, and Joel Tetreault. 2016. Sender-intended Functions of Emojis in US Messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Daantje Derks, Arjan E. R. Bos, and Jasper von Grumbkow. 2008. Emoticons and Online Message Interpretation. Social Science Computer Review , Vol. 26, 3 (2008), 379--388. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Alan Dix. 1994. Computer Supported Cooperative Work: A Framework .Springer London, 9--26.Google ScholarGoogle Scholar
  13. Alan Dix. 2007. Designing for Appropriation. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...But Not As We Know It - Volume 2 (BCS-HCI '07). BCS Learning & Development Ltd. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Paul Dourish. 2004. What We Talk About when We Talk About Context. Personal and Ubiquitous Computing , Vol. 8, 1 (Feb. 2004), 19--30.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Eli Dresner and Susan Herring. 2010. Functions of the Nonverbal in CMC: Emoticons and Illocutionary Force. , Vol. 20, 3 (2010), 249 -- 268.Google ScholarGoogle Scholar
  16. Sara H. Hsieh and Timmy H. Tseng. 2017. Playfulness in Mobile Instant Messaging. Comput. Hum. Behav. , Vol. 69, C (2017), 405--414. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Maximilian J. Johnston, Dominic King, Sonal Arora, Nebil Behar, Thanos Athanasiou, Nick Sevdalis, and Ara Darzi. 2015. Smartphones Let Surgeons Know WhatsApp: An Analysis of Communication in Emergency Surgical Teams. The American Journal of Surgery , Vol. 209, 1 (2015), 45 -- 51.Google ScholarGoogle ScholarCross RefCross Ref
  18. Shipra Kayan, Susan R. Fussell, and Leslie D. Setlock. 2006. Cultural Differences in the Use of Instant Messaging in Asia and North America. In Proceedings of the 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Linda K. Kaye, Helen J. Wall, and Stephanie A. Malone. 2016. "Turn that Frown Upside-down": A Contextual Account of Emoticon Usage on Different Virtual Platforms. Computers in Human Behavior , Vol. 60 (2016), 463 -- 467. Issue C. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Ryan Kelly and Leon Watts. 2015. Characterising the Inventive Appropriation of Emoji as Relationally Meaningful in Mediated Close Personal Relationships. In Experiences of Technology Appropriation: Unanticipated Users, Usage, Circumstances, and Design . http://opus.bath.ac.uk/46780/Google ScholarGoogle Scholar
  21. Da-jung Kim and Youn-kyung Lim. 2015. Dwelling Places in KakaoTalk: Understanding the Roles and Meanings of Chatrooms in Mobile Instant Messengers. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Joon Young Lee, Nahi Hong, Soomin Kim, Jonghwan Oh, and Joonhwan Lee. 2016. Smiley Face: Why We Use Emoticon Stickers in Mobile Messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Shao-Kang Lo. 2008. The Nonverbal Communication Functions of Emoticons in Computer-Mediated Communication. Cyberpsychology & Behavior , Vol. 11 (11 2008), 595--597.Google ScholarGoogle ScholarCross RefCross Ref
  24. Hannah Jean Miller, Daniel Kluver, Jacob Thebault-Spieker, Loren G. Terveen, and Brent J. Hecht. 2017. Understanding Emoji Ambiguity in Context: The Role of Text in Emoji-Related Miscommunication. In Proceedings of the 11th International Conference on Web and Social Media (ICWSM' 17). AAAI Press, 152--161.Google ScholarGoogle Scholar
  25. Hannah Jean Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac L. Johnson, Loren G. Terveen, and Brent J. Hecht. 2016. "Blissfully Happy" or "Ready to Fight": Varying Interpretations of Emoji. In Proceedings of the 10th International Conference on Web and Social Media (ICWSM' 16). AAAI Press, 259--268.Google ScholarGoogle Scholar
  26. Fred Morstatter, Kai Shu, Suhang Wang, and Huan Liu. 2017. Cross-Platform Emoji Interpretation: Analysis, a Solution, and Applications. CoRR , Vol. abs/1709.04969 (2017). arxiv: 1709.04969 http://arxiv.org/abs/1709.04969Google ScholarGoogle Scholar
  27. Midas Nouwens, Carla F. Griggio, and Wendy E. Mackay. 2017. "WhatsApp is for Family; Messenger is for Friends": Communication Places in App Ecosystems. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Kenton P. O'Hara, Michael Massimi, Richard Harper, Simon Rubens, and Jessica Morris. 2014. Everyday Dwelling with WhatsApp. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, 13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Catherine Shu. 2015. The Secret Language Of Line Stickers. (10 7 2015). https://techcrunch.com/2015/07/10/creepy-cute-line/Google ScholarGoogle Scholar
  30. Satomi Sugiyama. 2015. Kawaii Meiru and Maroyaka Neko: Mobile Emoji for Relationship Maintenance and Aesthetic Expressions among Japanese Teens. First Monday , Vol. 20 (10 2015).Google ScholarGoogle Scholar
  31. Channary Tauch and Eiman Kanjo. 2016. The Roles of Emojis in Mobile Phone Notifications. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Kakao Team. 2017. Kakao Celebrates 6-year Anniversary of Kakao Emoticons. (2017). https://blog.kakaocorp.com/?p=1860Google ScholarGoogle Scholar
  33. David R Thomas. 2006. A General Inductive Approach for Analyzing Qualitative Evaluation Data. American Journal of Evaluation , Vol. 27, 2 (2006), 237--246.Google ScholarGoogle ScholarCross RefCross Ref
  34. Garreth W. Tigwell and David R. Flatla. 2016. Oh That's What You Meant!: Reducing Emoji Misunderstanding. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Joseph B. Walther. 1992. Interpersonal Effects in Computer-Mediated Interaction: A Relational Perspective. Communication Research , Vol. 19, 1 (1992), 52--90.Google ScholarGoogle Scholar
  36. Joseph B. Walther and Kyle P. D'Addario. 2001. The Impacts of Emoticons on Message Interpretation in Computer-Mediated Communication. Social Science Computer Review , Vol. 19, 3 (2001), 324--347.Google ScholarGoogle ScholarCross RefCross Ref
  37. Sarah Wiseman and Sandy J. J. Gould. 2018. Repurposing Emoji for Personalised Communication: Why Slice of Pizza Emoji means “I Love You”. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Rui Zhou, Jasmine Hentschel, and Neha Kumar. 2017. Goodbye Text, Hello Emoji: Mobile Communication on WeChat in China. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Complex and Ambiguous: Understanding Sticker Misinterpretations in Instant Messaging

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!