Abstract

Stickers, though similar in appearance to emoji, have distinct characteristics because they often contain animation, diverse gestures, and multiple characters and objects. Stickers can convey richer meaning than emoji, but their complexity and placement constraint may result in miscommunication. In this paper, we aim to understand how people perceive emotion in stickers, as well as how miscommunication related to sticker occurs in actual chat contexts. Toward this goal, we conducted an online survey (n = 87) and in-depth interviews (n = 28) in South Korea. We found emotional and contextual aspects of sticker misinterpretation. In particular, emotion misinterpretation mostly happened due to stickers' ambiguous (multiple) facial/bodily expressions and different perception of dynamism in gestures. In real chat settings, there were also contextual misinterpretations where senders and receivers differently interpret stickers' visual representation/reference, or/and corresponding textual messages. Based on these findings, we provide several practical design implications such as context awareness support in sticker interaction.
- James A Russell. 2003. Core Affect and the Psychological Construction of Emotion. Psychological Review , Vol. 110, 1 (2003), 145--172.Google Scholar
Cross Ref
- Jr Artemio Ramirez and Kathy Broneck. 2009. `IM me': Instant messaging as relational maintenance and everyday communication. Journal of Social and Personal Relationships , Vol. 26, 2--3 (2009), 291--314.Google Scholar
Cross Ref
- Eric PS Baumer, Morgan G Ames, Jenna Burrell, Jed R Brubaker, and Paul Dourish. 2015. Why Study Technology Non-use? First Monday , Vol. 20, 11 (2015). http://firstmonday.org/ojs/index.php/fm/article/view/6310Google Scholar
Cross Ref
- Hugh Beyer and Karen Holtzblatt. 1998. Contextual Design: Defining Customer-Centered Systems .Academic Press. Google Scholar
Digital Library
- Dan Bouhnik and Mor Deshen. 2014. WhatsApp Goes to School: Mobile Instant Messaging between Teachers and Students. Journal of Information Technology Education: Research , Vol. 13 (1 2014), 217--231.Google Scholar
Cross Ref
- Judee K. Burgoon and Beth A. Le Poire. 1999. Nonverbal Cues and Interpersonal Judgments: Participant and Observer Perceptions of Intimacy, Dominance, Composure, and Formality. Communication Monographs , Vol. 66, 2 (1999), 105--124.Google Scholar
Cross Ref
- Karen Church and Rodrigo de Oliveira. 2013. What's Up with Whatsapp?: Comparing Mobile Instant Messaging Behaviors with Traditional SMS. In Proceedings of the 15th International Conference on Human-computer Interaction with Mobile Devices and Services (MobileHCI '13). ACM. Google Scholar
Digital Library
- Herbert H. Clark. 1996. Using Language .Cambridge University Press.Google Scholar
- Kakao Corp. 2018. Investor Relations. (2018). https://t1.kakaocdn.net/kakaocorp/operating/ir/results-announcement/3246.pdfGoogle Scholar
- Henriette Cramer, Paloma de Juan, and Joel Tetreault. 2016. Sender-intended Functions of Emojis in US Messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '16). ACM. Google Scholar
Digital Library
- Daantje Derks, Arjan E. R. Bos, and Jasper von Grumbkow. 2008. Emoticons and Online Message Interpretation. Social Science Computer Review , Vol. 26, 3 (2008), 379--388. Google Scholar
Digital Library
- Alan Dix. 1994. Computer Supported Cooperative Work: A Framework .Springer London, 9--26.Google Scholar
- Alan Dix. 2007. Designing for Appropriation. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers: HCI...But Not As We Know It - Volume 2 (BCS-HCI '07). BCS Learning & Development Ltd. Google Scholar
Digital Library
- Paul Dourish. 2004. What We Talk About when We Talk About Context. Personal and Ubiquitous Computing , Vol. 8, 1 (Feb. 2004), 19--30.Google Scholar
Digital Library
- Eli Dresner and Susan Herring. 2010. Functions of the Nonverbal in CMC: Emoticons and Illocutionary Force. , Vol. 20, 3 (2010), 249 -- 268.Google Scholar
- Sara H. Hsieh and Timmy H. Tseng. 2017. Playfulness in Mobile Instant Messaging. Comput. Hum. Behav. , Vol. 69, C (2017), 405--414. Google Scholar
Digital Library
- Maximilian J. Johnston, Dominic King, Sonal Arora, Nebil Behar, Thanos Athanasiou, Nick Sevdalis, and Ara Darzi. 2015. Smartphones Let Surgeons Know WhatsApp: An Analysis of Communication in Emergency Surgical Teams. The American Journal of Surgery , Vol. 209, 1 (2015), 45 -- 51.Google Scholar
Cross Ref
- Shipra Kayan, Susan R. Fussell, and Leslie D. Setlock. 2006. Cultural Differences in the Use of Instant Messaging in Asia and North America. In Proceedings of the 20th Anniversary Conference on Computer Supported Cooperative Work (CSCW '06). ACM. Google Scholar
Digital Library
- Linda K. Kaye, Helen J. Wall, and Stephanie A. Malone. 2016. "Turn that Frown Upside-down": A Contextual Account of Emoticon Usage on Different Virtual Platforms. Computers in Human Behavior , Vol. 60 (2016), 463 -- 467. Issue C. Google Scholar
Digital Library
- Ryan Kelly and Leon Watts. 2015. Characterising the Inventive Appropriation of Emoji as Relationally Meaningful in Mediated Close Personal Relationships. In Experiences of Technology Appropriation: Unanticipated Users, Usage, Circumstances, and Design . http://opus.bath.ac.uk/46780/Google Scholar
- Da-jung Kim and Youn-kyung Lim. 2015. Dwelling Places in KakaoTalk: Understanding the Roles and Meanings of Chatrooms in Mobile Instant Messengers. In Proceedings of the 18th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '15). ACM. Google Scholar
Digital Library
- Joon Young Lee, Nahi Hong, Soomin Kim, Jonghwan Oh, and Joonhwan Lee. 2016. Smiley Face: Why We Use Emoticon Stickers in Mobile Messaging. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM. Google Scholar
Digital Library
- Shao-Kang Lo. 2008. The Nonverbal Communication Functions of Emoticons in Computer-Mediated Communication. Cyberpsychology & Behavior , Vol. 11 (11 2008), 595--597.Google Scholar
Cross Ref
- Hannah Jean Miller, Daniel Kluver, Jacob Thebault-Spieker, Loren G. Terveen, and Brent J. Hecht. 2017. Understanding Emoji Ambiguity in Context: The Role of Text in Emoji-Related Miscommunication. In Proceedings of the 11th International Conference on Web and Social Media (ICWSM' 17). AAAI Press, 152--161.Google Scholar
- Hannah Jean Miller, Jacob Thebault-Spieker, Shuo Chang, Isaac L. Johnson, Loren G. Terveen, and Brent J. Hecht. 2016. "Blissfully Happy" or "Ready to Fight": Varying Interpretations of Emoji. In Proceedings of the 10th International Conference on Web and Social Media (ICWSM' 16). AAAI Press, 259--268.Google Scholar
- Fred Morstatter, Kai Shu, Suhang Wang, and Huan Liu. 2017. Cross-Platform Emoji Interpretation: Analysis, a Solution, and Applications. CoRR , Vol. abs/1709.04969 (2017). arxiv: 1709.04969 http://arxiv.org/abs/1709.04969Google Scholar
- Midas Nouwens, Carla F. Griggio, and Wendy E. Mackay. 2017. "WhatsApp is for Family; Messenger is for Friends": Communication Places in App Ecosystems. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM. Google Scholar
Digital Library
- Kenton P. O'Hara, Michael Massimi, Richard Harper, Simon Rubens, and Jessica Morris. 2014. Everyday Dwelling with WhatsApp. In Proceedings of the 17th ACM Conference on Computer Supported Cooperative Work & Social Computing (CSCW '14). ACM, 13. Google Scholar
Digital Library
- Catherine Shu. 2015. The Secret Language Of Line Stickers. (10 7 2015). https://techcrunch.com/2015/07/10/creepy-cute-line/Google Scholar
- Satomi Sugiyama. 2015. Kawaii Meiru and Maroyaka Neko: Mobile Emoji for Relationship Maintenance and Aesthetic Expressions among Japanese Teens. First Monday , Vol. 20 (10 2015).Google Scholar
- Channary Tauch and Eiman Kanjo. 2016. The Roles of Emojis in Mobile Phone Notifications. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp '16). ACM. Google Scholar
Digital Library
- Kakao Team. 2017. Kakao Celebrates 6-year Anniversary of Kakao Emoticons. (2017). https://blog.kakaocorp.com/?p=1860Google Scholar
- David R Thomas. 2006. A General Inductive Approach for Analyzing Qualitative Evaluation Data. American Journal of Evaluation , Vol. 27, 2 (2006), 237--246.Google Scholar
Cross Ref
- Garreth W. Tigwell and David R. Flatla. 2016. Oh That's What You Meant!: Reducing Emoji Misunderstanding. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM. Google Scholar
Digital Library
- Joseph B. Walther. 1992. Interpersonal Effects in Computer-Mediated Interaction: A Relational Perspective. Communication Research , Vol. 19, 1 (1992), 52--90.Google Scholar
- Joseph B. Walther and Kyle P. D'Addario. 2001. The Impacts of Emoticons on Message Interpretation in Computer-Mediated Communication. Social Science Computer Review , Vol. 19, 3 (2001), 324--347.Google Scholar
Cross Ref
- Sarah Wiseman and Sandy J. J. Gould. 2018. Repurposing Emoji for Personalised Communication: Why Slice of Pizza Emoji means “I Love You”. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM. Google Scholar
Digital Library
- Rui Zhou, Jasmine Hentschel, and Neha Kumar. 2017. Goodbye Text, Hello Emoji: Mobile Communication on WeChat in China. In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems (CHI '17). ACM. Google Scholar
Digital Library
Index Terms
Complex and Ambiguous: Understanding Sticker Misinterpretations in Instant Messaging
Recommendations
Culturally-Embedded Visual Literacy: A Study of Impression Management via Emoticon, Emoji, Sticker, and Meme on Social Media in China
Social media is often analyzed as a "front stage" where social media users perform their identities and manage impressions through various forms of user-generated content: text, picture, video, as well as visual expression such as emoticon, emoji, ...
Research on Sticker Cognition for Older Adult Using Instant Messaging
Human-Computer Interaction. Theories, Methods, and Human IssuesAbstractThe growing ubiquity of smartphones has changed how older people live and the advent of instant messaging apps has reshaped their communication methods. Stickers are arguably the most popular feature of LINE, an instant messaging app. In this ...
The communicative role of non-face emojis
Emojis have evolved from imitations of facial expressions meant to communicate affect into pictures of objects, food, and places that are not directly linked to affect. While emojis that resemble facial expressions are well-researched, emojis that ...






Comments