skip to main content
research-article

Perception Clusters: Automated Mood Recognition Using a Novel Cluster-Driven Modelling System

Published:30 December 2020Publication History
Skip Abstract Section

Abstract

Automated mood recognition has been studied in recent times with great emphasis on stress in particular. Other affective states are also of great importance, as studying them can help in understanding human behaviours in more detail. Most of the studies conducted in the realisation of an automated system that is capable of recognising human moods have established that mood is personal—that is, mood perception differs amongst individuals. Previous machine learning--based frameworks confirm this hypothesis, with personalised models almost always outperforming the generalised methods. In this article, we propose a novel system for grouping individuals in what we refer to as “perception clusters” based on their physiological signals. We evaluate perception clusters with a trial of nine users in a work environment, recording physiological and activity data for at least 10 days. Our results reveal no significant difference in performance with respect to a personalised approach and that our method performs equally better against traditional generalised methods. Such an approach significantly reduces computational requirements that are otherwise necessary for personalised approaches requiring individual models developed separately for each user. Further, perception clusters manifest a direction towards semi-supervised affective modelling in which individual perceptions are inferred from the data.

References

  1. Andreas Bulling, Ulf Blanke, and Bernt Schiele. 2014. A tutorial on human activity recognition using body-worn inertial sensors. ACM Comput. Surv. 46, 3 (Jan. 2014), Article 33. DOI:https://doi.org/10.1145/2499621Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. R. A. Calvo and S. D’Mello. 2010. Affect detection: An interdisciplinary review of models, methods, and their applications. IEEE Trans. Affect. Comput. 1, 1 (Jan. 2010), 18--37.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. E. Ceja, V. Osmani, and O. Mayora. 2015. Automatic stress detection in working environments from smartphones’ accelerometer data: A first step. IEEE J. Biomed. Health Inform. 20, 4 (2015), 1053--1060.Google ScholarGoogle ScholarCross RefCross Ref
  4. Y. Chen and C. Shen. 2017. Performance analysis of smartphone-sensor behavior for human activity recognition. IEEE Access 5 (2017), 3095--3110.Google ScholarGoogle Scholar
  5. Yanhua Cheng and Daniel Gruhn. 2016. Perceived similarity in emotional reaction profiles between the self and a close other as a predictor of emotional well-being. J. Soc. Pers. Relat. 33, 6 (2016), 711--732. DOI:https://doi.org/10.1177/0265407515590278Google ScholarGoogle Scholar
  6. G. B. Folland. 2009. Fourier Analysis and Its Applications. American Mathematical Society. https://books.google.co.uk/books?id=ix2iCQ-o9x4C.Google ScholarGoogle Scholar
  7. S. Fuke, T. Suzuki, K. Nakayama, H. Tanaka, and S. Minami. 2013. Blood pressure estimation from pulse wave velocity measured on the chest. In Proceedings of the International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’13). 6107--6110.Google ScholarGoogle Scholar
  8. M. Gjoreski, H. Gjoreski, M. Lutrek, and M. Gams. 2015. Automatic detection of perceived stress in campus students using smartphones. In Proceedings of the International Conference on Intelligent Environments. 132--135.Google ScholarGoogle Scholar
  9. Joel Goh, Jeffrey Pfeffer, and Stefanos Zenios. 2015. Exposure to harmful workplace practices could account for inequality in life spans across different demographic groups. Health Aff. 34, 10 (2015), 1761--1768.Google ScholarGoogle Scholar
  10. Nils Y. Hammerla, Reuben Kirkham, Peter Andras, and Thomas Ploetz. 2013. On preserving statistical characteristics of accelerometry data using their empirical cumulative distribution. In Proceedings of the International Symposium on Wearable Computers (ISWC’13). ACM, New York, NY, 65--68.Google ScholarGoogle Scholar
  11. J. Hassard, K. Teoh, T. Cox, P. D. Dewe, M. Cosmar, R. Grundler, D. Flemming, B. Cosemans, and K. Van den Broek. 2014. Calculating the Cost of Work-Related Stress and Psychosocial Risks. Publications Office of the European Union, Luxembourg.Google ScholarGoogle Scholar
  12. I. T. Jolliffe. 1986. Principal Component Analysis. Springer Verlag.Google ScholarGoogle Scholar
  13. Arturas Kaklauskas, Edmundas Kazimieras Zavadskas, Marko Seniut, Gintautas Dzemyda, V. Stankevic, C. Simkevicius, T. Stankevic, et al. 2011. Web-based biometric computer mouse advisory system to analyze a user’s emotions and work productivity. Eng. Appl. AI 24, 6 (2011), 928--945. DOI:https://doi.org/10.1016/j.engappai.2011.04.006Google ScholarGoogle Scholar
  14. Leonard Kaufman and Peter J. Rousseeuw. 2008. Finding Groups in Data: An Introduction to Cluster Analysis. John Wiley 8 Sons. DOI:https://doi.org/10.1002/9780470316801.ch1Google ScholarGoogle Scholar
  15. Reuben Kirkham, Aftab Khan, Sourav Bhattacharya, Nils Hammerla, Sebastian Mellor, Daniel Roggen, and Thomas Ploetz. 2013. Automatic correction of annotation boundaries in activity datasets by class separation maximization. In Proceedings of the 2013 ACM Conference on Pervasive and Ubiquitous Computing Adjunct Publication (UbiComp’13 Adjunct). ACM, New York, NY, 673--678. DOI:https://doi.org/10.1145/2494091.2495988Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Robert LiKamWa, Yunxin Liu, Nicholas D. Lane, and Lin Zhong. 2013. MoodScope: Building a mood sensor from smartphone usage patterns. In Proceedings of the ACM Conference on Mobile Systems, Applications, and Services.Google ScholarGoogle Scholar
  17. Nicolai Meinshausen and Peter Bühlmann. 2010. Stability selection. J. R. Stat. Soc. Series B Stat. Methodol. 72, 4 (2010), 417--473. DOI:https://doi.org/10.1111/j.1467-9868.2010.00740.xGoogle ScholarGoogle ScholarCross RefCross Ref
  18. Sarah B. Mulkey, Rathinaswamy Govindan, Marina Metzler, Christopher B. Swisher, Laura Hitchings, Yunfei Wang, Robin Baker, G. Larry Maxwell, Anita Krishnan, and Adre J. du Plessis. 2020. Heart rate variability is depressed in the early transitional period for newborns with complex congenital heart disease. Clin. Auton. Res. 30, 2 (2020), 165--172. DOI:https://doi.org/10.1007/s10286-019-00616-wGoogle ScholarGoogle Scholar
  19. Annamaria Petito, Mario Altamura, Salvatore Iuso, Flavia A. Padalino, Francesco Sessa, Giovanna D’Andrea, Maurizio Margaglione, and Antonello Bellomo. 2016. The relationship between personality traits, the 5HTT polymorphisms, and the occurrence of anxiety and depressive symptoms in elite athletes. PLoS One 11, 6 (2016), 1--13. DOI:https://doi.org/10.1371/journal.pone.0156601Google ScholarGoogle Scholar
  20. John T. Ramshur. 2010. Design, Evaluation, and Application of Heart Rate Variability Analysis Software (HRVAS). Master’s Thesis. University of Memphis.Google ScholarGoogle Scholar
  21. Carl Edward Rasmussen and Christopher K. I. Williams. 2006. Gaussian Processes for Machine Learning. MIT Press.Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Kathryn Salt. 2017. Fit notes issued by GP practices, England: December 2014--March 2017. In Primary Care Domain. NHS Digital.Google ScholarGoogle Scholar
  23. Neil Schneiderman, Gail Ironson, and Scott D. Siegel. 2005. Stress and health: Psychological, behavioral, and biological determinants. Annu. Rev. Clin. Psychol. 1 (2005), 607--628.Google ScholarGoogle ScholarCross RefCross Ref
  24. Bernhard Schölkopf and Alexander J. Smola. 2001. Learning with Kernels: Support Vector Machines, Regularization, Optimization, and Beyond. MIT Press, Cambridge, MA.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Dimitris Spathis, Sandra Servia-Rodriguez, Katayoun Farrahi, Cecilia Mascolo, and Jason Rentfrow. 2019. Sequence multi-task learning to forecast mental wellbeing from sparse self-reported data. In Proceedings of the 25th ACM SIGKDD International Conference on Knowledge Discovery and Data Mining (KDD’19). ACM, New York, NY, 2886--2894. DOI:https://doi.org/10.1145/3292500.3330730Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Andrew Steptoe, Emma Easterlin, and Clemens Kirschbaum. 2017. Conscientiousness, hair cortisol concentration, and health behaviour in older men and women. Psychoneuroendocrinology 86 (2017), 122--127. DOI:https://doi.org/10.1016/j.psyneuen.2017.09.016Google ScholarGoogle Scholar
  27. Yoshihiko Suhara, Yinzhan Xu, and Alex “Sandy” Pentland. 2017. DeepMood: Forecasting depressed mood based on self-reported histories via recurrent neural networks. In Proceedings of the 26th International Conference on World Wide Web (WWW’17). 715--724. DOI:https://doi.org/10.1145/3038912.3052676Google ScholarGoogle Scholar
  28. Task Force of the European Society of Cardiology. 1996. Heart rate variability standards of measurement, physiological interpretation, and clinical use. Eur. Heart J. 17 (1996), 354--381.Google ScholarGoogle Scholar
  29. L. J. P. van der Maaten and G. E. Hinton. 2008. Visualizing high-dimensional data using t-SNE. J. Mach. Learn. Res. 9 (2008), 2579--2605.Google ScholarGoogle Scholar
  30. S. Vatsikas, G. Kalogridis, T. Lewis, and M. Sooriyabandara. 2017. The experience of using the IES cities citizen-centric IoT platform. IEEE Commun. Mag. 55, 2 (Feb. 2017), 40--47. DOI:https://doi.org/10.1109/MCOM.2017.1600688CMGoogle ScholarGoogle Scholar
  31. Alexandros Zenonos, Aftab Khan, Georgios Kalogridis, Stefanos Vatsikas, Tim Lewis, and Mahesh Sooriyabandara. 2016. HealthyOffice: Mood recognition at work using smartphones and wearable sensors. In Proceedings of the IEEE PerCom Workshops. 1--6.Google ScholarGoogle Scholar
  32. Alexandros Zenonos, Sebastian Stein, and Nicholas R. Jennings. 2018. Coordinating measurements in uncertain participatory sensing settings. J. Artif. Intell. Res. 61 (2018), 433--474.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Perception Clusters: Automated Mood Recognition Using a Novel Cluster-Driven Modelling System

                  Recommendations

                  Comments

                  Login options

                  Check if you have access through your login credentials or your institution to get full access on this article.

                  Sign in

                  Full Access

                  • Published in

                    cover image ACM Transactions on Computing for Healthcare
                    ACM Transactions on Computing for Healthcare  Volume 2, Issue 1
                    Special Issue on Wearable Technologies for Smart Health: Part 2 and Regular Papers
                    January 2021
                    204 pages
                    ISSN:2691-1957
                    EISSN:2637-8051
                    DOI:10.1145/3446563
                    Issue’s Table of Contents

                    Copyright © 2020 ACM

                    Publisher

                    Association for Computing Machinery

                    New York, NY, United States

                    Publication History

                    • Published: 30 December 2020
                    • Revised: 1 August 2020
                    • Accepted: 1 August 2020
                    • Received: 1 August 2019
                    Published in health Volume 2, Issue 1

                    Permissions

                    Request permissions about this article.

                    Request Permissions

                    Check for updates

                    Qualifiers

                    • research-article
                    • Research
                    • Refereed
                  • Article Metrics

                    • Downloads (Last 12 months)30
                    • Downloads (Last 6 weeks)2

                    Other Metrics

                  PDF Format

                  View or Download as a PDF file.

                  PDF

                  eReader

                  View online with eReader.

                  eReader

                  HTML Format

                  View this article in HTML Format .

                  View HTML Format
                  About Cookies On This Site

                  We use cookies to ensure that we give you the best experience on our website.

                  Learn more

                  Got it!