The Influence of Personality Traits on User Interaction with Recommendation Interfaces

Abstract

Users’ personality traits can take an active role in affecting their behavior when they interact with a computer interface. However, in the area of recommender systems (RS), though personality-based RS has been extensively studied, most works focus on algorithm design, with little attention paid to studying whether and how the personality may influence users’ interaction with the recommendation interface. In this manuscript, we report the results of a user study (with 108 participants) that not only measured the influence of users’ personality traits on their perception and performance when using the recommendation interface but also employed an eye-tracker to in-depth reveal how personality may influence users’ eye-movement behavior. Moreover, being different from related work that has mainly been conducted in a single product domain, our user study was performed in three typical application domains (i.e., electronics like smartphones, entertainment like movies, and tourism like hotels). Our results show that mainly three personality traits, i.e., Openness to experience, Conscientiousness, and Agreeableness, significantly influence users’ perception and eye-movement behavior, but the exact influences vary across the domains. Finally, we provide a set of guidelines that might be constructive for designing a more effective recommendation interface based on user personality.

REFERENCES

1. [1] [n.d.]. https://www.tobiipro.com/product-listing/tobii-pro-x3-120/.
2. [2] Ajzen Icek. 2005. Attitudes, Personality, and Behavior. McGraw−Hill Education (UK).
3. [3] Al-Samarraie Hosam, Eldenfria Atef, and Dawoud Husameddin. 2017. The impact of personality traits on users information-seeking behavior. Information Processing & Management 53, 1 (2017), 237–247.
4. [4] Arockiam L. and Selvaraj J.. 2013. User interface design for effective e-learning based on personality traits. International Journal of Computer Applications 61 (2013), 28–32.
5. [5] Ashby Nathaniel J. S., Johnson Joseph G., Krajbich Ian, and Wedel Michel. 2016. Applications and innovations of eye-movement research in judgment and decision making. Journal of Behavioral Decision Making 29, 2–3 (2016), 96–102. . arXiv:https://onlinelibrary.wiley.com/doi/pdf/10.1002/bdm.1956
6. [6] Ashktorab Zahra, Jain Mohit, Liao Q. Vera, and Weisz Justin D.. 2019. Resilient chatbots: Repair strategy preferences for conversational breakdowns. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. 1–12.
7. [7] author Nigel Nicholson Corresponding, Soane Emma, Fenton-O’Creevy Mark, and Willman Paul. 2005. Personality and domain-specific risk taking. Journal of Risk Research 8, 2 (2005), 157–176. .
8. [8] Baranes Adrien, Oudeyer Pierre-Yves, and Gottlieb Jacqueline. 2015. Eye movements reveal epistemic curiosity in human observers. Vision Research 117, 1 (2015), 81–90.
9. [9] Benjamini Yoav and Hochberg Yosef. 1995. Controlling the false discovery rate: A practical and powerful approach to multiple testing. Journal of the Royal Statistical Society: Series B (Methodological) 57, 1 (1995), 289–300.
10. [10] Berkovsky Shlomo, Taib Ronnie, Koprinska Irena, Wang Eileen, Zeng Yucheng, Li Jingjie, and Kleitman Sabina. 2019. Detecting personality traits using eye-tracking data. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems. ACM, 1–12.
11. [11] Borys Magdalena and Plechawska-Wójcik Małgorzata. 2017. Eye-tracking metrics in perception and visual attention research. EJMT 3 (2017), 11–23.
12. [12] Byrne Michael D., Anderson John R., Douglass Scott, and Matessa Michael. 1999. Eye tracking the visual search of click-down menus. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems. 402–409.
13. [13] Cantador Iván, Fernández-tobías Ignacio, and Bellogín Alejandro. 2013. Relating personality types with user preferences in multiple entertainment domains. EMPIRE 1st Workshop on “Emotions and Personality in Personalized Services”, 10. June 2013, Rome (2013).
14. [14] Charness Gary, Gneezy Uri, and Kuhn Michael A.. 2012. Experimental methods: Between-subject and within-subject design. Journal of Economic Behavior & Organization 81, 1 (2012), 1–8.
15. [15] Chau Pyk, Cole M., Massey A. P., Montoya-Weiss M., and O’Keefe R. M.. 2002. Cultural differences in the online behavior of consumers. Communications of the ACM 45, 10 (2002), 138–143.
16. [16] Chen Fang, Ruiz Natalie, Choi Eric, Epps Julien, Khawaja M. Asif, Taib Ronnie, Yin Bo, and Wang Yang. 2013. Multimodal behavior and interaction as indicators of cognitive load. ACM Transactions on Interactive Intelligent Systems (TiiS) 2, 4 (2013), 1–36.
17. [17] Chen Li. 2010. Towards three-stage recommender support for online consumers: Implications from a user study. In International Conference on Web Information Systems Engineering. Springer, 365–375.
18. [18] Chen Li, Cai Wanling, Yan Dongning, and Berkovsky Shlomo. 2022. Eye-tracking-based personality prediction with recommendation interfaces. User Modeling and User-Adapted Interaction (2022).
19. [19] Chen Li and Pu Pearl. 2010. Experiments on the preference-based organization interface in recommender systems. ACM Transactions on Computer-Human Interaction 17, 1 (April2010), 1–33.
20. [20] Chen Li and Pu Pearl. 2010. Eye-tracking study of user behavior in recommender interfaces. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 375–380.
21. [21] Chen Li and Pu Pearl. 2011. Users’ eye gaze pattern in organization-based recommender interfaces. In Proceedings of the 16th International Conference on Intelligent User Interfaces. ACM, 311–314.
22. [22] Chen Li and Pu Pearl. 2014. Experiments on user experiences with recommender interfaces. Behaviour & Information Technology 33, 4 (2014), 372–394.
23. [23] Chen Li and Wang Feng. 2017. Explaining recommendations based on feature sentiments in product reviews. In Proceedings of the 22nd International Conference on Intelligent User Interfaces. ACM, 17–28.
24. [24] Chen Li, Wu Wen, and He Liang. 2013. How personality influences users’ needs for recommendation diversity?. In CHI’13 Extended Abstracts on Human Factors in Computing Systems. ACM, 829–834.
25. [25] Chen Li, Yan Dongning, and Wang Feng. 2019. User evaluations on sentiment-based recommendation explanations. ACM Transactions on Interactive Intelligent Systems (TiiS) 9, 4 (2019), 1–38.
26. [26] Chen Li, Yang Yonghua, Wang Ningxia, Yang Keping, and Yuan Quan. 2019. How serendipity improves user satisfaction with recommendations? A large-scale user evaluation. In The World Wide Web Conference (WWW’19). ACM, New York, NY, USA, 240–250.
27. [27] Cohen Jacob. 1992. A power primer. Psychological Bulletin 11, 1 (1992), 155–159.
28. [28] Costa Paul T. and McCrae Robert R.. 1992. Normal personality assessment in clinical practice: The NEO personality inventory. Psychological Assessment 4, 1 (1992), 5–13.
29. [29] Jr. Paul T. Costa and McCrae Robert R.. 2008. The Revised NEO Personality Inventory (NEO-PI-R).Sage Publications, Inc.
30. [30] Dumais Susan T., Buscher Georg, and Cutrell Edward. 2010. Individual differences in gaze patterns for web search. In Proceedings of the Third Symposium on Information Interaction in Context. 185–194.
31. [31] Ehmke Claudia and Wilson Stephanie. 2007. Identifying web usability problems from eye-tracking data. In Proceedings of the 21st British HCI Group Annual Conference on People and Computers. British Computer Society, 119–128.
32. [32] Elahi Mehdi, Braunhofer Matthias, Ricci Francesco, and Tkalcic Marko. 2013. Personality-based active learning for collaborative filtering recommender systems. In Congress of the Italian Association for Artificial Intelligence. Springer, 360–371.
33. [33] Félix Vinícius Basseto and Menezes André Felipe Berdusco. 2018. Comparisons of ten corrections methods for t-test in multiple comparisons via Monte Carlo study. Electronic Journal of Applied Statistical Analysis 11, 1 (2018), 74–91.
34. [34] Fernández-Tobías Ignacio, Braunhofer Matthias, Elahi Mehdi, Ricci Francesco, and Cantador Iván. 2016. Alleviating the new user problem in collaborative filtering by exploiting personality information. User Modeling and User-Adapted Interaction 26, 2–3 (2016), 221–255.
35. [35] Ferwerda Bruce, Graus Mark P., Vall Andreu, Tkalcic Marko, and Schedl Markus. 2016. The influence of users’ personality traits on satisfaction and attractiveness of diversified recommendation lists. In EMPIRE@ RecSys. 43–47.
36. [36] Field Andy. 2013. Discovering Statistics using SPSS. Sage.
37. [37] Franco-Watkins Ana M. and Johnson Joseph G.. 2011. Decision moving window: Using interactive eye tracking to examine decision processes. Behavior Research Methods 43, 853 (2011), 329–358.
38. [38] Glaholt M. G. and Reingold E. M.. 2011. Eye movement monitoring as a process tracing methodology in decision making research. Journal of Neuroscience, Psychology, and Economics 4, 2 (2011), 125–146.
39. [39] Goldberg Lewis R.. 1990. An alternative “description of personality”: The Big-Five factor structure. Journal of Personality and Social Psychology 59, 6 (1990), 1216–1229.
40. [40] Gretzel Ulrike, Mitsche Nicole, Hwang Yeong-Hyeon, and Fesenmaier Daniel R.. 2004. Tell me who you are and I will tell you where to go: Use of travel personalities in destination recommendation systems. Information Technology & Tourism 7, 1 (2004), 3–12.
41. [41] Haddock C. Keith, Rindskopf David, and Shadish William R.. 1998. Using odds ratios as effect sizes for meta-analysis of dichotomous data: A primer on methods and issues. Psychological Methods 3, 3 (1998), 339.
42. [42] Hu Rong and Pu Pearl. 2010. A study on user perception of personality-based recommender systems. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 291–302.
43. [43] Hu Rong and Pu Pearl. 2011. Enhancing recommendation diversity with organization interfaces. In Proceedings of the 16th International Conference on Intelligent User Interfaces. ACM, 347–350.
44. [44] Hu Rong and Pu Pearl. 2013. Exploring relations between personality and user rating behaviors. In UMAP Workshops. 1–12.
45. [45] Iacobucci Dawn, Posavac Steven S., Kardes Frank R., Schneider Matthew J ., and Popovich Deidre L.. 2015. Toward a more nuanced understanding of the statistical properties of a median split. Journal of Consumer Psychology 25, 4 (2015), 652–665.
46. [46] Jannach Dietmar, Jesse Mathias, Jugovac Michael, and Trattner Christoph. 2021. Exploring Multi-List User Interfaces for Similar-Item Recommendations. Association for Computing Machinery, New York, NY, USA, 224–228.
47. [47] Jannach Dietmar, Manzoor Ahtsham, Cai Wanling, and Chen Li. 2021. A survey on conversational recommender systems. ACM Comput. Surv. 54, 5, Article 105 (May2021), 36 pages.
48. [48] John Oliver P. and Srivastava Sanjay. 1999. The Big Five Trait Taxonomy: History, Measurement, and Theoretical Perspectives. University of California Berkeley.
49. [49] Jugovac Michael, Nunes Ingrid, and Jannach Dietmar. 2018. Investigating the decision-making behavior of maximizers and satisficers in the presence of recommendations. In Proceedings of the 26th Conference on User Modeling, Adaptation and Personalization. ACM, 279–283.
50. [50] Karumur Raghav Pavan, Nguyen Tien T., and Konstan Joseph A.. 2018. Personality, user preferences and behavior in recommender systems. Information Systems Frontiers 20, 6 (2018), 1241–1265.
51. [51] Kehoe Elizabeth G., Toomey John M., Balsters Joshua H., and Bokde Arun L. W.. 2012. Personality modulates the effects of emotional arousal and valence on brain activation. Social Cognitive and Affective Neuroscience 7, 7 (2012), 858–870.
52. [52] Kostov V. and Fukuda S.. 2001. Development of man-machine interfaces based on user preferences. In Proceedings of the 2001 IEEE International Conference on Control Applications (CCA’01) (Cat. No.01CH37204). 1124–1128.
53. [53] Kouki Pigi, Schaffer James, Pujara Jay, O’Donovan John, and Getoor Lise. 2019. Personalized explanations for hybrid recommender systems. In Proceedings of the 24th International Conference on Intelligent User Interfaces. ACM, 379–390.
54. [54] Lu Jie, Wu Dianshuang, Mao Mingsong, Wang Wei, and Zhang Guangquan. 2015. Recommender system application developments: A survey. Decision Support Systems 74, 1 (2015), 12–32.
55. [55] Maccatrozzo Valentina, Terstall Manon, Aroyo Lora, and Schreiber Guus. 2017. SIRUP: Serendipity in recommendations via user perceptions. In Proceedings of the 22nd International Conference on Intelligent User Interfaces (IUI’17). ACM, New York, NY, USA, 35–44.
56. [56] MacKenzie I. Scott. 2013. Human-Computer Interaction: An Empirical Research Perspective (1st ed.). Morgan Kaufmann Publishers Inc., San Francisco, CA, USA.
57. [57] Manolios Sandy, Hanjalic Alan, and Liem Cynthia C. S.. 2019. The influence of personal values on music taste. In Proceedings of the 13th ACM Conference on Recommender Systems. ACM, New York, NY, USA, 501–505.
58. [58] McCrae Robert R. and Jr Paul T. Costa. 1997. Conceptions and correlates of openness to experience. In Handbook of Personality Psychology. Elsevier, 825–847.
59. [59] McCrae Robert R. and John Oliver P.. 1992. An introduction to the five-factor model and its applications. Journal of Personality 60, 2 (1992), p175–215.
60. [60] McNee Sean M., Lam Shyong K., Konstan Joseph A., and Riedl John. 2003. Interfaces for eliciting new user preferences in recommender systems. In User Modeling 2003, Brusilovsky Peter, Corbett Albert, and Rosis Fiorella de (Eds.). Springer Berlin, Berlin, 178–187.
61. [61] Mello-Thoms Claudia, Nodine Calvin F., and Kundel Harold L.. 2002. What attracts the eye to the location of missed and reported breast cancers? In Proceedings of the 2002 Symposium on Eye Tracking Research & Applications. 111–117.
62. [62] Mitsuda Takashi and Glaholt Mackenzie G.. 2014. Gaze bias during visual preference judgements: Effects of stimulus category and decision instructions. Visual Cognition 22, 1 (2014), 11–29. .
63. [63] Nguyen Tien T., Harper F. Maxwell, Terveen Loren, and Konstan Joseph A.. 2018. User personality and user satisfaction with recommender systems. Information Systems Frontiers 20, 6 (2018), 1173–1189.
64. [64] Olejnik Stephen and Algina James. 2003. Generalized eta and omega squared statistics: Measures of effect size for some common research designs. Psychological Methods 8, 4 (2003), 434.
65. [65] Pachur Thorsten and Spaar Melanie. 2015. Domain-specific preferences for intuition and deliberation in decision making. Journal of Applied Research in Memory and Cognition 4, 3 (2015), 303–311.
66. [66] Parra Denis, Brusilovsky Peter, and Trattner Christoph. 2014. See what you want to see: Visual user-driven approach for hybrid recommendation. In Proceedings of the 19th International Conference on Intelligent User Interfaces. 235–240.
67. [67] Poole Alex and Ball Linden J.. 2005. Eye tracking in human-computer interaction and usability research: Current status and future. In Encyclopedia of Human-Computer Interaction, Ghaoui Claude (Ed.). Idea Group, Inc., Pennsylvania, 211–219.
68. [68] Pu Pearl and Chen Li. 2006. Trust building with explanation interfaces. In Proceedings of the 11th International Conference on Intelligent User Interfaces (IUI’06). ACM, NY, USA, 93–100.
69. [69] Pu Pearl and Chen Li. 2007. Trust-inspiring explanation interfaces for recommender systems. Knowledge-Based Systems 20, 6 (Aug.2007), 542–556.
70. [70] Purvis Alison, Howell Ryan T., and Iyer Ravi. 2011. Exploring the role of personality in the relationship between maximization and well-being. Personality and Individual Differences 50, 3 (2011), 370–375.
71. [71] Raptis George E., Fidas Christos A., and Avouris Nikolaos M.. 2017. On implicit elicitation of cognitive strategies using gaze transition entropies in pattern recognition tasks. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems. 1993–2000.
72. [72] Rauthmann John F., Seubert Christian T., Sachse Pierre, and Furtner Marco R.. 2012. Eyes as windows to the soul: Gazing behavior is related to personality. Journal of Research in Personality 46, 2 (2012), 147–156.
73. [73] Rayner Keith. 1998. Eye movements in reading and information processing: 20 years of research. Psychological Bulletin 124, 3 (1998), 372–422.
74. [74] Rentfrow Peter and Gosling Samuel. 2003. The Do Re Mi’s of everyday life: The structure and personality correlates of music preferences. Journal of Personality and Social Psychology 84, 6 (2003), 1236–1256.
75. [75] Riaz Muhammad Naveed, Riaz Muhammad Akram, and Batool Naila. 2012. Personality types as predictors of decision making styles. Journal of Behavioural Sciences 22, 2 (2012), 99–114.
76. [76] Ricci Francesco, Rokach Lior, and Shapira Bracha. 2011. Introduction to recommender systems handbook. In Recommender Systems Handbook. Springer, 1–35.
77. [77] Ricci Francesco, Rokach Lior, and Shapira Bracha. 2015. Recommender Systems Handbook (2nd ed.). Springer Publishing Company, Incorporated.
78. [78] Yang Nan Song Feng Du Kan Zhang Richard Carciofo, Jiaoyan. 2016. Psychometric evaluation of Chinese-language 44-item and 10-item Big Five personality inventories, including correlations with chronotype, mindfulness and mind wandering. PLoS ONE 11, 2 (2016).
79. [79] Risko Evan F., Anderson Nicola C., Lanthier Sophie, and Kingstone Alan. 2012. Curious eyes: Individual differences in personality predict eye movement behavior in scene-viewing. Cognition 122, 1 (2012), 86–90.
80. [80] Sadi Rasoul, Asl Hassan Ghalibaf, Rostami Mohammad Reza, Gholipour Aryan, and Gholipour Fattaneh. 2011. Behavioral finance: The explanation of investors personality and perceptual biases effects on financial decisions. International Journal of Economics and Finance 3, 5 (2011), 234–241.
81. [81] Salvucci Dario D. and Goldberg Joseph H.. 2000. Identifying fixations and saccades in eye-tracking protocols. In Proceedings of the 2000 Symposium on Eye Tracking Research & Applications (ETRA’00). ACM, New York, NY, USA, 71–78.
82. [82] Sarsam Samer Muthana and Al-Samarraie Hosam. 2018. Towards incorporating personality into the design of an interface: A method for facilitating users’ interaction with the display. User Modeling and User-Adapted Interaction 28, 1 (March2018), 75–96.
83. [83] Schwartz Barry, Ward Andrew, Monterosso John, Lyubomirsky Sonja, White Katherine, and Lehman Darrin R.. 2002. Maximizing versus satisficing: Happiness is a matter of choice. Journal of Personality and Social Psychology 83, 5 (2002), 1178–1197.
84. [84] Starke Alain, Asotic Edis, and Trattner Christoph. 2021. “Serving Each User”: Supporting Different Eating Goals Through a Multi-List Recommender Interface. Association for Computing Machinery, New York, NY, USA, 124–132.
85. [85] Stewart Neil, Hermens Frouke, and Matthews William J.. 2016. Eye movements in risky choice. Journal of Behavioral Decision Making 29, 2–3 (2016), 116–136. . arXiv:https://onlinelibrary.wiley.com/ doi/pdf/10.1002/bdm.1854
86. [86] Stoeber Joachim, Otto Kathleen, and Dalbert Claudia. 2009. Perfectionism and the Big Five: Conscientiousness predicts longitudinal increases in self-oriented perfectionism. Personality and Individual Differences 47, 4 (2009), 363–368.
87. [87] Tintarev Nava, Dennis Matt, and Masthoff Judith. 2013. Adapting recommendation diversity to openness to experience: A study of human behaviour. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 190–202.
88. [88] Tintarev Nava and Masthoff Judith. 2008. Over-and underestimation in different product domains. In Workshop on Recommender Systems Associated with ECAI. 14–19.
89. [89] Tintarev Nava and Masthoff Judith. 2012. Evaluating the effectiveness of explanations for recommender systems. User Modeling and User-Adapted Interaction 22, 4-5 (2012), 399–439.
90. [90] Tkalcic Marko and Chen Li. 2015. Personality and recommender systems. In Recommender Systems Handbook, Ricci Francesco, Rokach Lior, and Shapira Bracha (Eds.). Springer, 715–739. http://dblp.uni-trier.de/db/reference/sp/rsh2015.html#TkalcicC15.
91. [91] Tkalcic Marko, Kunaver Matevz, Tasic Jurij, and Košir Andrej. 2009. Personality based user similarity measure for a collaborative recommender system. In Proceedings of the 5th Workshop on Emotion in Human-Computer Interaction-Real World Challenges. 30–37.
92. [92] Tkalčič Marko, Quercia Daniele, and Graf Sabine. 2016. Preface to the special issue on personality in personalized systems. User Modeling and User-Adapted Interaction 26, 2–3 (2016), 103–107.
93. [93] Tsai Chun-Hua and Brusilovsky Peter. 2017. Enhancing recommendation diversity through a dual recommendation interface. In CEUR Workshop Proceedings, Vol. 1884. 10–15.
94. [94] Utz Sonja, Kerkhof Peter, and Bos Joost Van Den. 2012. Consumers rule: How consumer reviews influence perceived trustworthiness of online stores. Electronic Commerce Research and Applications 11, 1 (2012), 49–58.
95. [95] Wilbers Anne-Kathrin, Vennekoetter Alina, Kacauster Moritz, Hamborg Kai-Christoph, and Kaspar Kai. 2015. Personality traits and eye movements: An eye-tracking and pupillometry study. In Proceedings of the European Conference on Eye Movement. 268.
96. [96] Wong Alan and Carducci Bernardo. 2013. Does personality affect personal financial risk tolerance behavior? IUP Journal of Applied Finance 19, 3 (2013), 5–18.
97. [97] Wu Wen and Chen Li. 2015. Implicit acquisition of user personality for augmenting movie recommendations. In International Conference on User Modeling, Adaptation, and Personalization. Springer, 302–314.
98. [98] Wu Wen, Chen Li, and Zhao Yu. 2018. Personalizing recommendation diversity based on user personality. User Modeling and User-Adapted Interaction 28, 3 (2018), 237–276.
99. [99] Xavier Carolina. 2019. NEURAL: Towards Neuroticicism-Based User Interface Customization. Master’s Thesis. Instituto Superior Técnico, Universidade de Lisboa.
100. [100] Yamagishi Toshio. 2001. Trust as a form of social intelligence. In Russell Sage Foundation Series on Trust, Vol. 2. Trust in Society. Russell Sage Foundation, 121–147.
101. [101] Zhao Pengfei and Lee Dik Lun. 2016. How Much Novelty Is Relevant?: It Depends on Your Curiosity. In Proceedings of the 39th International ACM SIGIR Conference on Research and Development in Information Retrieval - SIGIR’16. ACM Press, 315–324.
102. [102] Ziemkiewicz Caroline, Crouser R. J., Yauilla Ashley Rye, Su S., Ribarsky W., and Chang R.. 2011. How locus of control influences compatibility with visualization style. 2011 IEEE Conference on Visual Analytics Science and Technology (VAST) (2011), 81–90.

Index Terms

• Computing methodologies

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods