Abstract
Empathy is the tendency to understand and share others' thoughts and feelings. Literature in psychology has shown through surveys potential beneficial implications of empathy. Prior psychology literature showed that a particular type of empathy called "situational empathy" --- an immediate empathic response to a triggering situation (e.g., a distressing situation) --- is reflected in the language people use in response to the situation. However, this has not so far been properly measured at scale. In this work, we collected 4k textual reactions (and corresponding situational empathy labels) to different stories. Driven by theoretical concepts, we developed computational models to predict situational empathy from text and, in so doing, we built and made available a list of empathy-related words. When applied to Reddit posts and movie transcripts, our models produced results that matched prior theoretical findings, offering evidence of external validity and suggesting its applicability to unstructured data. The capability of measuring proxies for empathy at scale might benefit a variety of areas such as social media, digital healthcare, and workplace well-being.
- Muhammad M Abdul-Mageed, Anneke Buffone, Hao Peng, Johannes Eichstaedt, and Lyle Ungar. 2017. Recognizing pathogenic empathy in social media. In Eleventh International AAAI Conference on Web and Social Media.Google Scholar
- Ritu Agarwal, Guodong Gao, Catherine DesRoches, and Ashish K Jha. 2010. Research commentary-The digital transformation of healthcare: Current status and the road ahead. Information Systems Research 21, 4 (2010), 796--809.Google Scholar
Digital Library
- Charles Daniel Batson. 2011. Altruism in humans. Oxford University Press, USA.Google Scholar
- Jason Baumgartner. 2015. I have every publicly available Reddit comment for research. 1.7 billion comments 250 GB compressed. Any interest in this? https://redd.it/3bxlg7Google Scholar
- Natalya N Bazarova, Yoon Hyung Choi, Victoria Schwanda Sosik, Dan Cosley, and Janis Whitlock. 2015. Social sharing of emotions on Facebook: Channel differences, satisfaction, and replies. In Proceedings of the 18th ACM conference on computer supported cooperative work & social computing. 154--164.Google Scholar
Digital Library
- Giacomo Bono, Robert A Emmons, and Michael E McCullough. 2004. Gratitude in practice and the practice of gratitude. Positive psychology in practice (2004), 464--481.Google Scholar
- Sven Buechel, Anneke Buffone, Barry Slaff, Lyle Ungar, and Joao Sedoc. 2018. Modeling Empathy and Distress in Reaction to News Stories. In Proceedings of the 2018 Conference on Empirical Methods in Natural Language Processing. 4758--4765.Google Scholar
Cross Ref
- Michael Buhrmester, Tracy Kwang, and Samuel D Gosling. 2016. Amazon's Mechanical Turk: A new source of inexpensive, yet high-quality data? (2016).Google Scholar
- Ronan Cummins, Michael P Ewbank, Alan Martin, Valentin Tablan, Ana Catarino, and Andrew D Blackwell. 2019. TIM: A Tool for Gaining Insights into Psychotherapy. In The World Wide Web Conference. ACM, 3503--3506.Google Scholar
Digital Library
- Thomas Davidson, Dana Warmsley, Michael Macy, and Ingmar Weber. 2017. Automated hate speech detection and the problem of offensive language. In Eleventh international aaai conference on web and social media.Google Scholar
- Mark H Davis. 1983. Measuring individual differences in empathy: Evidence for a multidimensional approach. Journal of personality and social psychology 44, 1 (1983), 113.Google Scholar
Cross Ref
- Mark H Davis et al. 1980. A multidimensional approach to individual differences in empathy. (1980).Google Scholar
- Munmun De Choudhury and Sushovan De. 2014. Mental health discourse on reddit: Self-disclosure, social support, and anonymity. In Eighth international AAAI conference on weblogs and social media.Google Scholar
Cross Ref
- Minet De Wied, Susan JT Branje, and Wim HJ Meeus. 2007. Empathy and conflict resolution in friendship relations among adolescents. Aggressive Behavior: Official Journal of the International Society for Research on Aggression 33, 1 (2007), 48--55.Google Scholar
Cross Ref
- Jean Ed Decety and William Ed Ickes. 2009. The social neuroscience of empathy. MIT Press.Google Scholar
- Jacob Devlin, Ming-Wei Chang, Kenton Lee, and Kristina Toutanova. 2018. Bert: Pre-training of deep bidirectional transformers for language understanding. arXiv preprint arXiv:1810.04805 (2018).Google Scholar
- Jennifer Edgar, Joe Murphy, and Michael Keating. 2016. Comparing traditional and crowdsourcing methods for pretesting survey questions. Sage Open 6, 4 (2016), 2158244016671770.Google Scholar
Cross Ref
- Nancy Eisenberg and Randy Lennon. 1983. Sex differences in empathy and related capacities. Psychological bulletin 94, 1 (1983), 100.Google Scholar
- Robert Elliott, Arthur C Bohart, Jeanne C Watson, and Leslie S Greenberg. 2011. Empathy. Psychotherapy 48, 1 (2011), 43.Google Scholar
Cross Ref
- Ethan Fast, Binbin Chen, and Michael S Bernstein. 2016. Empath: Understanding topic signals in large-scale text. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems. ACM, 4647--4657.Google Scholar
Digital Library
- Emilio Ferrara and Zeyao Yang. 2015. Measuring emotional contagion in social media. PloS one 10, 11 (2015), e0142390.Google Scholar
Cross Ref
- Wendi L Gardner, Shira Gabriel, and Angela Y Lee. 1999. ?I" value freedom, but ?we" value relationships: Self-construal priming mirrors cultural differences in judgment. Psychological science 10, 4 (1999), 321--326.Google Scholar
- Justin Garten, Joe Hoover, Kate M Johnson, Reihane Boghrati, Carol Iskiwitch, and Morteza Dehghani. 2018. Dictionaries and distributions: Combining expert knowledge and large scale textual data content analysis. Behavior research methods 50, 1 (2018), 344--361.Google Scholar
- Andrew Gelman. 2008. Scaling regression inputs by dividing by two standard deviations. Statistics in medicine 27, 15 (2008), 2865--2873.Google Scholar
- James Gibson, Nikolaos Malandrakis, Francisco Romero, David C Atkins, and Shrikanth S Narayanan. 2015. Predicting therapist empathy in motivational interviews using language features inspired by psycholinguistic norms. In Sixteenth Annual Conference of the International Speech Communication Association.Google Scholar
Cross Ref
- Shihui Han and Glyn Humphreys. 2016. Self-construal: A cultural framework for brain function. Current Opinion in Psychology 8 (2016), 10--14.Google Scholar
Cross Ref
- Martin L Hoffman. 2001. Empathy and moral development: Implications for caring and justice. Cambridge University Press.Google Scholar
Cross Ref
- Pei-Yun Hsueh, Prem Melville, and Vikas Sindhwani. 2009. Data quality from crowdsourcing: a study of annotation selection criteria. In Proceedings of the NAACL HLT 2009 workshop on active learning for natural language processing. 27--35.Google Scholar
Cross Ref
- Isabell Hühnel, Mara Fölster, Katja Werheid, and Ursula Hess. 2014. Empathic reactions of younger and older adults: No age related decline in affective responding. Journal of Experimental Social Psychology 50 (2014), 136--143.Google Scholar
Cross Ref
- Clayton J Hutto and Eric Gilbert. 2014. Vader: A parsimonious rule-based model for sentiment analysis of social media text. In Eighth international AAAI conference on weblogs and social media.Google Scholar
Cross Ref
- William Ickes, Paul R Gesn, and Tiffany Graham. 2000. Gender differences in empathic accuracy: Differential ability or differential motivation? Personal Relationships 7, 1 (2000), 95--109.Google Scholar
Cross Ref
- Nicole Kämpfe, Jan Penzhorn, Julia Schikora, Julia Dünzl, and Jane Schneidenbach. 2009. Empathy and social desirability: a comparison of delinquent and non-delinquent participants using direct and indirect measures. Psychology, Crime & Law 15, 1 (2009), 1--17.Google Scholar
Cross Ref
- Marsha Kinder. 1991. Playing with power in movies, television, and video games: from Muppet Babies to Teenage Mutant Ninja Turtles. Univ of California Press.Google Scholar
- Kristi JK Klein and Sara D Hodges. 2001. Gender differences, motivation, and empathic accuracy: When it pays to understand. Personality and Social Psychology Bulletin 27, 6 (2001), 720--730.Google Scholar
Cross Ref
- Sara Konrath. 2013. The empathy paradox: Increasing disconnection in the age of increasing connection. In Handbook of research on technoself: Identity in a technological society. IGI Global, 204--228.Google Scholar
- Sara Konrath, Brian P Meier, and Brad J Bushman. 2018. Development and validation of the single item trait empathy scale (SITES). Journal of research in personality 73 (2018), 111--122.Google Scholar
Cross Ref
- Michal Kosinski, David Stillwell, and Thore Graepel. 2013. Private traits and attributes are predictable from digital records of human behavior. Proceedings of the National Academy of Sciences 110, 15 (2013), 5802--5805.Google Scholar
Cross Ref
- Shiro Kumano, Kazuhiro Otsuka, Dan Mikami, and Junji Yamato. 2011. Analyzing empathetic interactions based on the probabilistic modeling of the co-occurrence patterns of facial expressions in group meetings. In Face and Gesture 2011. IEEE, 43--50.Google Scholar
Cross Ref
- Serena Lecce, Irene Ceccato, Federica Bianco, Alessia Rosi, Sara Bottiroli, and Elena Cavallini. 2017. Theory of Mind and social relationships in older adults: the role of social motivation. Aging & Mental Health 21, 3 (2017), 253--258.Google Scholar
Cross Ref
- Marina Litvak, Jahna Otterbacher, Chee Siang Ang, and David Atkins. 2016. Social and linguistic behavior and its correlation to trait empathy. In Proceedings of the Workshop on Computational Modeling of People's Opinions, Personality, and Emotions in Social Media (PEOPLES). 128--137.Google Scholar
- Sarah Peregrine Lord, Elisa Sheng, Zac E Imel, John Baer, and David C Atkins. 2015. More than reflections: empathy in motivational interviewing includes language style synchrony between therapist and client. Behavior therapy 46, 3 (2015), 296--303.Google Scholar
- Christine Ma-Kellams and Jim Blascovich. 2012. Inferring the emotions of friends versus strangers: The role of culture and self-construal. Personality and Social Psychology Bulletin 38, 7 (2012), 933--945.Google Scholar
Cross Ref
- Yishay Mansour, Mehryar Mohri, and Afshin Rostamizadeh. 2009. Domain adaptation with multiple sources. In Advances in neural information processing systems. 1041--1048.Google Scholar
- Gretchen McAllister and Jacqueline Jordan Irvine. 2002. The role of empathy in teaching culturally diverse students: A qualitative study of teachers? beliefs. Journal of teacher education 53, 5 (2002), 433--443.Google Scholar
Cross Ref
- Alexey N Medvedev, Renaud Lambiotte, and Jean-Charles Delvenne. 2017. The anatomy of Reddit: An overview of academic research. In Dynamics on and of Complex Networks. Springer, 183--204.Google Scholar
- Yelena Mejova, Amy X Zhang, Nicholas Diakopoulos, and Carlos Castillo. 2014. Controversy and sentiment in online news. arXiv preprint arXiv:1409.8152 (2014).Google Scholar
- Saif M Mohammad and Peter D Turney. 2013. Crowdsourcing a word--emotion association lexicon. Computational Intelligence 29, 3 (2013), 436--465.Google Scholar
Cross Ref
- Sylvia A Morelli, Desmond C Ong, Rucha Makati, Matthew O Jackson, and Jamil Zaki. 2017. Empathy and well-being correlate with centrality in different social networks. Proceedings of the National Academy of Sciences 114, 37 (2017), 9843--9847.Google Scholar
Cross Ref
- Ed O'brien, Sara H Konrath, Daniel Grühn, and Anna Linda Hagen. 2012. Empathic concern and perspective taking: Linear and quadratic effects of age across the adult life span. Journals of Gerontology Series B: Psychological Sciences and Social Sciences 68, 2 (2012), 168--175.Google Scholar
Cross Ref
- Jahna Otterbacher, Chee Siang Ang, Marina Litvak, and David Atkins. 2017. Show me you care: Trait empathy, linguistic style, and mimicry on Facebook. ACM Transactions on Internet Technology (TOIT) 17, 1 (2017), 6.Google Scholar
Digital Library
- Ed O'Brien, Sara H Konrath, Daniel Grühn, and Anna Linda Hagen. 2013. Empathic concern and perspective taking: Linear and quadratic effects of age across the adult life span. Journals of Gerontology Series B: Psychological Sciences and Social Sciences 68, 2 (2013), 168--175.Google Scholar
Cross Ref
- Kyung Hye Park, Dong-hee Kim, Seok Kyoung Kim, Young Hoon Yi, Jae Hoon Jeong, Jiun Chae, Jiyeon Hwang, and HyeRin Roh. 2015. The relationships between empathy, stress and social support among medical students. International journal of medical education 6 (2015), 103.Google Scholar
- James W Pennebaker, Cindy K Chung, Joey Frazee, Gary M Lavergne, and David I Beaver. 2014. When small words foretell academic success: The case of college admissions essays. PloS one 9, 12 (2014), e115844.Google Scholar
Cross Ref
- James W Pennebaker, Martha E Francis, and Roger J Booth. 2001. Linguistic inquiry and word count: LIWC 2001. Mahway: Lawrence Erlbaum Associates 71, 2001 (2001), 2001.Google Scholar
- Jeffrey Pennington, Richard Socher, and Christopher Manning. 2014. Glove: Global vectors for word representation. In Proceedings of the 2014 conference on empirical methods in natural language processing (EMNLP). 1532--1543.Google Scholar
Cross Ref
- Daniella Perry, Talma Hendler, and Simone G Shamay-Tsoory. 2011. Can we share the joy of others? Empathic neural responses to distress vs joy. Social cognitive and affective neuroscience 7, 8 (2011), 909--916.Google Scholar
- Marco Polignano, Pierpaolo Basile, Gaetano Rossiello, Marco de Gemmis, and Giovanni Semeraro. 2017. Learning inclination to empathy from social media footprints. In Proceedings of the 25th Conference on User Modeling, Adaptation and Personalization. ACM, 383--384.Google Scholar
Digital Library
- Stephanie D Preston and Frans BM De Waal. 2002. Empathy: Its ultimate and proximate bases. Behavioral and brain sciences 25, 1 (2002), 1--20.Google Scholar
- Alexander Robertson, Luca Maria Aiello, and Daniele Quercia. 2019. The Language of Dialogue Is Complex. In Proceedings of the International AAAI Conference on Web and Social Media, Vol. 13. 428--439.Google Scholar
- Michelle Rodino-Colocino. 2018. Me too,# MeToo: Countering cruelty with empathy. Communication and Critical/Cultural Studies 15, 1 (2018), 96--100.Google Scholar
Cross Ref
- Scott Schieman and Karen Van Gundy. 2000. The personal and social links between age and self-reported empathy. Social Psychology Quarterly (2000), 152--174.Google Scholar
- Natalie Sest and Evita March. 2017. Constructing the cyber-troll: Psychopathy, sadism, and empathy. Personality and Individual Differences 119 (2017), 69--72.Google Scholar
- Yla R Tausczik and James W Pennebaker. 2010. The psychological meaning of words: LIWC and computerized text analysis methods. Journal of language and social psychology 29, 1 (2010), 24--54.Google Scholar
Cross Ref
- Mohsen Tavakol and Reg Dennick. 2011. Making sense of Cronbach's alpha. International journal of medical education 2 (2011), 53.Google Scholar
Cross Ref
- Ashton D Trice and Hunter W Greer. 2019. The Psychology of Moviegoing: Choosing, Viewing and Being Influenced by Films. McFarland.Google Scholar
- Linus Vanlaere, Trees Coucke, and Chris Gastmans. 2010. Experiential learning of empathy in a care-ethics lab. Nursing Ethics 17, 3 (2010), 325--336.Google Scholar
Cross Ref
- Barbara J Wilson. 2008. Media and children's aggression, fear, and altruism. The future of children 18, 1 (2008), 87--118.Google Scholar
- Karl-Andrew Woltin, Vincent Y Yzerbyt, and Olivier Corneille. 2011. On reducing an empathy gap: The impact of self-construal and order of judgment. British Journal of Social Psychology 50, 3 (2011), 553--562.Google Scholar
Cross Ref
- Bo Xiao, Daniel Bone, Maarten Van Segbroeck, Zac E Imel, David C Atkins, Panayiotis G Georgiou, and Shrikanth S Narayanan. 2014. Modeling therapist empathy through prosody in drug addiction counseling. In Fifteenth Annual Conference of the International Speech Communication Association.Google Scholar
Cross Ref
- Bo Xiao, Dogan Can, Panayiotis G Georgiou, David Atkins, and Shrikanth S Narayanan. 2012. Analyzing the language of therapist empathy in motivational interview based psychotherapy. In Proceedings of The 2012 Asia Pacific Signal and Information Processing Association Annual Summit and Conference. IEEE, 1--4.Google Scholar
- Bo Xiao, Zac E Imel, Panayiotis Georgiou, David C Atkins, and Shrikanth S Narayanan. 2016. Computational analysis and simulation of empathic behaviors: A survey of empathy modeling with behavioral signal processing framework. Current psychiatry reports 18, 5 (2016), 49.Google Scholar
- Diyi Yang, Zheng Yao, Joseph Seering, and Robert Kraut. 2019. The channel matters: Self-disclosure, reciprocity and social support in online cancer support groups. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1--15.Google Scholar
Digital Library
- Qing Zhou, Carlos Valiente, and Nancy Eisenberg. 2003. Empathy and its measurement. (2003).Google Scholar
Index Terms
The Language of Situational Empathy
Recommendations
Effects of (in)accurate empathy and situational valence on attitudes towards robots
HRI '10: Proceedings of the 5th ACM/IEEE international conference on Human-robot interactionEmpathy has great potential in human-robot interaction. However, the challenging nature of assessing the user's emotional state points to the importance of also understanding the effects of empathic behaviours incongruent with users' affective ...
Empathy for Everyone?: The Effect of Age When Evaluating a Virtual Agent
HAI '18: Proceedings of the 6th International Conference on Human-Agent InteractionThe present study investigated the role of age in the perception of emotional nonverbal behaviors of a virtual assistant in a 2 (seniors vs young participants) x 2 (happy vs sad situations) x 4 (three emotional nonverbal behaviors related to each ...
Situational determinants of cognitive, affective, and compassionate empathy in naturalistic digital interactions
Empathy is apparent in computer-mediated communication (CMC), yet little is known about the situational predictors of empathic responses when interacting digitally. We used a diary methodology to explore: (1) the degree three types of empathy (cognitive,...






Comments