Abstract
Automated mood recognition has been studied in recent times with great emphasis on stress in particular. Other affective states are also of great importance, as studying them can help in understanding human behaviours in more detail. Most of the studies conducted in the realisation of an automated system that is capable of recognising human moods have established that mood is personal—that is, mood perception differs amongst individuals. Previous machine learning--based frameworks confirm this hypothesis, with personalised models almost always outperforming the generalised methods. In this article, we propose a novel system for grouping individuals in what we refer to as “perception clusters” based on their physiological signals. We evaluate perception clusters with a trial of nine users in a work environment, recording physiological and activity data for at least 10 days. Our results reveal no significant difference in performance with respect to a personalised approach and that our method performs equally better against traditional generalised methods. Such an approach significantly reduces computational requirements that are otherwise necessary for personalised approaches requiring individual models developed separately for each user. Further, perception clusters manifest a direction towards semi-supervised affective modelling in which individual perceptions are inferred from the data.
- Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput. Surv. 46, 3 (Jan. 2014), Article 33. DOI:https://doi.org/10.1145/2499621Google Scholar
Digital Library
- R. A. Calvo and S. D’Mello. 2010. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1, 1 (Jan. 2010), 18--37.Google Scholar
Digital Library
- E. Ceja, V. Osmani, and O. Mayora. 2015. Automatic stress detection in working environments from smartphones’ accelerometer data: A first step. IEEE J. Biomed. Health Inform. 20, 4 (2015), 1053--1060.Google Scholar
Cross Ref
- Y. Chen and C. Shen. 2017. Performance analysis of smartphone-sensor behavior for human activity recognition. IEEE Access 5 (2017), 3095--3110.Google Scholar
- Yanhua Cheng and Daniel Gruhn. 2016. Perceived similarity in emotional reaction profiles between the self and a close other as a predictor of emotional well-being. J. Soc. Pers. Relat. 33, 6 (2016), 711--732. DOI:https://doi.org/10.1177/0265407515590278Google Scholar
- G. B. Folland. 2009. Fourier Analysis and Its Applications. American Mathematical Society. https://books.google.co.uk/books?id=ix2iCQ-o9x4C.Google Scholar
- S. Fuke, T. Suzuki, K. Nakayama, H. Tanaka, and S. Minami. 2013. Blood pressure estimation from pulse wave velocity measured on the chest. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’13). 6107--6110.Google Scholar
- M. Gjoreski, H. Gjoreski, M. Lutrek, and M. Gams. 2015. Automatic detection of perceived stress in campus students using smartphones. In Proceedings of the International Conference on Intelligent Environments. 132--135.Google Scholar
- Joel Goh, Jeffrey Pfeffer, and Stefanos Zenios. 2015. Exposure to harmful workplace practices could account for inequality in life spans across different demographic groups. Health Aff. 34, 10 (2015), 1761--1768.Google Scholar
- Nils Y. Hammerla, Reuben Kirkham, Peter Andras, and Thomas Ploetz. 2013. On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution. In Proceedings of the International Symposium on Wearable Computers (ISWC’13). ACM, New York, NY, 65--68.Google Scholar
- J. Hassard, K. Teoh, T. Cox, P. D. Dewe, M. Cosmar, R. Grundler, D. Flemming, B. Cosemans, and K. Van den Broek. 2014. Calculating the Cost of Work-Related Stress and Psychosocial Risks. Publications Office of the European Union, Luxembourg.Google Scholar
- I. T. Jolliffe. 1986. Principal Component Analysis. Springer Verlag.Google Scholar
- Arturas Kaklauskas, Edmundas Kazimieras Zavadskas, Marko Seniut, Gintautas Dzemyda, V. Stankevic, C. Simkevicius, T. Stankevic, et al. 2011. Web-based biometric computer mouse advisory system to analyze a user’s emotions and work productivity. Eng. Appl. AI 24, 6 (2011), 928--945. DOI:https://doi.org/10.1016/j.engappai.2011.04.006Google Scholar
- Leonard Kaufman and Peter J. Rousseeuw. 2008. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley 8 Sons. DOI:https://doi.org/10.1002/9780470316801.ch1Google Scholar
- Reuben Kirkham, Aftab Khan, Sourav Bhattacharya, Nils Hammerla, Sebastian Mellor, Daniel Roggen, and Thomas Ploetz. 2013. Automatic correction of annotation boundaries in activity datasets by class separation maximization. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (UbiComp’13 Adjunct). ACM, New York, NY, 673--678. DOI:https://doi.org/10.1145/2494091.2495988Google Scholar
Digital Library
- Robert LiKamWa, Yunxin Liu, Nicholas D. Lane, and Lin Zhong. 2013. MoodScope: Building a mood sensor from smartphone usage patterns. In Proceedings of the ACM Conference on Mobile Systems, Applications, and Services.Google Scholar
- Nicolai Meinshausen and Peter Bühlmann. 2010. Stability selection. J. R. Stat. Soc. Series B Stat. Methodol. 72, 4 (2010), 417--473. DOI:https://doi.org/10.1111/j.1467-9868.2010.00740.xGoogle Scholar
Cross Ref
- Sarah B. Mulkey, Rathinaswamy Govindan, Marina Metzler, Christopher B. Swisher, Laura Hitchings, Yunfei Wang, Robin Baker, G. Larry Maxwell, Anita Krishnan, and Adre J. du Plessis. 2020. Heart rate variability is depressed in the early transitional period for newborns with complex congenital heart disease. Clin. Auton. Res. 30, 2 (2020), 165--172. DOI:https://doi.org/10.1007/s10286-019-00616-wGoogle Scholar
- Annamaria Petito, Mario Altamura, Salvatore Iuso, Flavia A. Padalino, Francesco Sessa, Giovanna D’Andrea, Maurizio Margaglione, and Antonello Bellomo. 2016. The relationship between personality traits, the 5HTT polymorphisms, and the occurrence of anxiety and depressive symptoms in elite athletes. PLoS One 11, 6 (2016), 1--13. DOI:https://doi.org/10.1371/journal.pone.0156601Google Scholar
- John T. Ramshur. 2010. Design, Evaluation, and Application of Heart Rate Variability Analysis Software (HRVAS). Master’s Thesis. University of Memphis.Google Scholar
- Carl Edward Rasmussen and Christopher K. I. Williams. 2006. Gaussian Processes for Machine Learning. MIT Press.Google Scholar
Digital Library
- Kathryn Salt. 2017. Fit notes issued by GP practices, England: December 2014--March 2017. In Primary Care Domain. NHS Digital.Google Scholar
- Neil Schneiderman, Gail Ironson, and Scott D. Siegel. 2005. Stress and health: Psychological, behavioral, and biological determinants. Annu. Rev. Clin. Psychol. 1 (2005), 607--628.Google Scholar
Cross Ref
- Bernhard Schölkopf and Alexander J. Smola. 2001. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, MA.Google Scholar
Digital Library
- Dimitris Spathis, Sandra Servia-Rodriguez, Katayoun Farrahi, Cecilia Mascolo, and Jason Rentfrow. 2019. Sequence multi-task learning to forecast mental wellbeing from sparse self-reported data. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). ACM, New York, NY, 2886--2894. DOI:https://doi.org/10.1145/3292500.3330730Google Scholar
Digital Library
- Andrew Steptoe, Emma Easterlin, and Clemens Kirschbaum. 2017. Conscientiousness, hair cortisol concentration, and health behaviour in older men and women. Psychoneuroendocrinology 86 (2017), 122--127. DOI:https://doi.org/10.1016/j.psyneuen.2017.09.016Google Scholar
- Yoshihiko Suhara, Yinzhan Xu, and Alex “Sandy” Pentland. 2017. DeepMood: Forecasting depressed mood based on self-reported histories via recurrent neural networks. In Proceedings of the 26th International Conference on World Wide Web (WWW’17). 715--724. DOI:https://doi.org/10.1145/3038912.3052676Google Scholar
- Task Force of the European Society of Cardiology. 1996. Heart rate variability standards of measurement, physiological interpretation, and clinical use. Eur. Heart J. 17 (1996), 354--381.Google Scholar
- L. J. P. van der Maaten and G. E. Hinton. 2008. Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9 (2008), 2579--2605.Google Scholar
- S. Vatsikas, G. Kalogridis, T. Lewis, and M. Sooriyabandara. 2017. The experience of using the IES cities citizen-centric IoT platform. IEEE Commun. Mag. 55, 2 (Feb. 2017), 40--47. DOI:https://doi.org/10.1109/MCOM.2017.1600688CMGoogle Scholar
- Alexandros Zenonos, Aftab Khan, Georgios Kalogridis, Stefanos Vatsikas, Tim Lewis, and Mahesh Sooriyabandara. 2016. HealthyOffice: Mood recognition at work using smartphones and wearable sensors. In Proceedings of the IEEE PerCom Workshops. 1--6.Google Scholar
- Alexandros Zenonos, Sebastian Stein, and Nicholas R. Jennings. 2018. Coordinating measurements in uncertain participatory sensing settings. J. Artif. Intell. Res. 61 (2018), 433--474.Google Scholar
Digital Library
Index Terms
Perception Clusters: Automated Mood Recognition Using a Novel Cluster-Driven Modelling System
Recommendations
Moodcasting: home as shared emotional space
CHI EA '12: CHI '12 Extended Abstracts on Human Factors in Computing SystemsThe home experience revolves around an intangible yet pervasive dynamic: shared emotional space, in which members of the home are influenced by each other's expressions of mood as well as the associated values, activities, people and spaces that ...
The determinants and expression of computer-related anger
Studies of everyday computer-related anger are rare. To shed more light upon this anecdotally common phenomenon, retrospective self-report questionnaires were used to elicit closed-ended and open-ended responses from 126 members of the general public ...
The Effect of Different Affective Arousal Levels on Taste Perception
ICMI '20 Companion: Companion Publication of the 2020 International Conference on Multimodal InteractionThe emotions we experience shape our perception, and our emotion is shaped by our perceptions. Taste perception is also influenced by emotions. Positive and negative emotions alter sweetness, sourness, and bitterness perception. However, most previous ...






Comments