skip to main content
research-article

Continuous Detection of Physiological Stress with Commodity Hardware

Published:11 April 2020Publication History
Skip Abstract Section

Abstract

Timely detection of an individual’s stress level has the potential to improve stress management, thereby reducing the risk of adverse health consequences that may arise due to mismanagement of stress. Recent advances in wearable sensing have resulted in multiple approaches to detect and monitor stress with varying levels of accuracy. The most accurate methods, however, rely on clinical-grade sensors to measure physiological signals; they are often bulky, custom made, and expensive, hence limiting their adoption by researchers and the general public. In this article, we explore the viability of commercially available off-the-shelf sensors for stress monitoring. The idea is to be able to use cheap, nonclinical sensors to capture physiological signals and make inferences about the wearer’s stress level based on that data. We describe a system involving a popular off-the-shelf heart rate monitor, the Polar H7; we evaluated our system with 26 participants in both a controlled lab setting with three well-validated stress-inducing stimuli and in free-living field conditions. Our analysis shows that using the off-the-shelf sensor alone, we were able to detect stressful events with an F1-score of up to 0.87 in the lab and 0.66 in the field, on par with clinical-grade sensors.

References

  1. M. Al’Absi and D. K. Arnett. 2000. Adrenocortical responses to psychological stress and risk for hypertension. Biomedicine 8 Pharmacotherapy 54, 5 (2000), 234--244.Google ScholarGoogle Scholar
  2. Mustafa Al’Absi, Stephan Bongard, Tony Buchanan, Gwendolyn A. Pincomb, Julio Licinio, and William R. Lovallo. 1997. Cardiovascular and neuroendocrine adjustment to public speaking and mental arithmetic stressors. Psychophysiology 34, 3 (May 1997), 266--275. DOI:https://doi.org/10.1111/j.1469-8986.1997.tb02397.xGoogle ScholarGoogle Scholar
  3. Marco Altini. 2015. Hardware for HRV: What Sensor Should You Use? Retrieved February 18, 2020 from https://www.hrv4training.com/blog/hardware-for-hrv-what-sensor-should-you-use.Google ScholarGoogle Scholar
  4. Android Central. 2016. Heart Rate Monitor Horribly Inaccurate? Retrieved February 18, 2020 from https://forums.androidcentral.com/samsung-gear-2-gear-2-neo/380007-heart-rate-monitor-horribly-inaccurate.html.Google ScholarGoogle Scholar
  5. Andrew Baum. 1990. Stress, intrusive imagery, and chronic distress. Health Psychology 9, 6 (1990), 653.Google ScholarGoogle ScholarCross RefCross Ref
  6. George E. Billman. 2013. The LF/HF ratio does not accurately measure cardiac sympatho-vagal balance. Frontiers in Physiology 4 (2013), 26. DOI:https://doi.org/10.3389/fphys.2013.00026Google ScholarGoogle ScholarCross RefCross Ref
  7. Biopac Systems Inc.2016. Biopac MP150. Retrieved February 18, 2020 from https://www.biopac.com/wp-content/uploads/MP150-Systems.pdf.Google ScholarGoogle Scholar
  8. George Boateng, Ryan Halter, John A. Batsis, and David Kotz. 2017. ActivityAware: An app for real-time daily activity level monitoring on the amulet wrist-worn device. In Proceedings of the IEEE PerCom Workshop on Pervasive Health Technologies (PerHealth’17). IEEE, Los Alamitos, CA, 431--435. DOI:https://doi.org/10.1109/PERCOMW.2017.7917601Google ScholarGoogle Scholar
  9. George Boateng, Vivian Genaro Motti, Varun Mishra, John A. Batsis, Josiah Hester, and David Kotz. 2019. Experience: Design, development and evaluation of a wearable device for mHealth applications. In Proceedings of the International Conference on Mobile Computing and Networking (MobiCom’19). DOI:https://doi.org/10.1145/3300061.3345432Google ScholarGoogle Scholar
  10. Andrey Bogomolov, Bruno Lepri, Michela Ferron, Fabio Pianesi, and Alex Sandy Pentland. 2014. Pervasive stress recognition for sustainable living. In Proceedings of the IEEE International Conference on Pervasive Computing and Communication Workshops, (PerCom Workshops’14). IEEE, Los Alamitos, CA, 345--350. DOI:https://doi.org/10.1109/PerComW.2014.6815230Google ScholarGoogle Scholar
  11. J. J. Braithwaite, D. G. Watson, R. Jones, and M. Rowe. 2013. A guide for analysing electrodermal activity (EDA) 8; skin conductance responses (SCRs) for psychological experiments. Psychophysiology 49, 8 (2013), 1--42.Google ScholarGoogle Scholar
  12. Grace Chen, Varun Mishra, and Ching-Hua Chen. 2019. Temporal factors of listening to music on stress reduction. In Adjunct Proceedings of the 2019 ACM International Joint Conference on Pervasive and Ubiquitous Computing and Proceedings of the 2019 ACM International Symposium on Wearable Computers (UbiComp/ISWC’19 Adjunct). ACM, New York, NY, 907--914. DOI:https://doi.org/10.1145/3341162.3346272Google ScholarGoogle Scholar
  13. Jongyoon Choi, B. Ahmed, and Ricardo Gutierrez-Osuna. 2012. Development and evaluation of an ambulatory stress monitor based on wearable sensors. IEEE Transactions on Information Technology in Biomedicine 16, 2 (2012), 279--286. DOI:https://doi.org/10.1109/TITB.2011.2169804Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. George P. Chrousos and Philip W. Gold. 1992. The concepts of stress and stress system disorders: Overview of physical and behavioral homeostasis. JAMA 267, 9 (1992), 1244--1252.Google ScholarGoogle ScholarCross RefCross Ref
  15. Matteo Ciman, Katarzyna Wac, and Ombretta Gaggi. 2015. iSenseStress: Assessing stress through human-smartphone interaction analysis. In Proceedings of the International Conference on Pervasive Computing Technologies for Healthcare (PerHealth’15). 84--91.Google ScholarGoogle Scholar
  16. Sheldon Cohen, Tom Kamarck, and Robin Mermelstein. 1983. A global measure of perceived stress. Journal of Health and Social Behavior 24, 4 (1983), 385--396.Google ScholarGoogle ScholarCross RefCross Ref
  17. Brian Edwards. 2011. Wearable Sensor by Affectiva Can Measure Anxiety and Is Helping Autism Research. Retrieved February 18, 2020 from https://www.imedicalapps.com/2011/10/wearable-sensor-by-affectiva-can-measure-anxiety-and-is-helping-autism-research/.Google ScholarGoogle Scholar
  18. Begum Egilmez, Emirhan Poyraz, Wenting Zhou, Gokhan Memik, Peter Dinda, and Nabil Alshurafa. 2017. UStress: Understanding college student subjective stress using wrist-based passive sensing. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications Workshops (PerCom Workshops’17). IEEE, Los Alamitos, CA, 673--678. DOI:https://doi.org/10.1109/PERCOMW.2017.7917644Google ScholarGoogle Scholar
  19. Emaptica. 2018. Empatica E4. Retrieved February 18, 2020 from https://www.empatica.com/en-eu/research/e4/.Google ScholarGoogle Scholar
  20. Michael R. Esco and Andrew A. Flatt. 2014. Ultra-short-term heart rate variability indexes at rest and post-exercise in athletes: Evaluating the agreement with accepted recommendations. Journal of Sports Science and Medicine 13, 3 (Sept. 2014), 535--541. http://www.ncbi.nlm.nih.gov/pubmed/25177179.Google ScholarGoogle Scholar
  21. S. M. Fox and W. L. Haskell. 1970. The exercise stress test: Needs for standardization. In Cardiology: Current Topics and Progress. Academic Press, New York, NY, 149--154.Google ScholarGoogle Scholar
  22. Ulla Fredriksson-Larsson, Eva Brink, Gunne Grankvist, Ingibjörg H. Jonsdottir, and Pia Alsen. 2015. The single-item measure of stress symptoms after myocardial infarction and its association with fatigue. Open Journal of Nursing 5, 04 (2015), 345.Google ScholarGoogle ScholarCross RefCross Ref
  23. Maurizio Garbarino, Matteo Lai, Simone Tognetti, Rosalind Picard, and Daniel Bender. 2014. Empatica E3—A wearable wireless multi-sensor device for real-time computerized biofeedback and data acquisition. In Proceedings of the International Conference on Wireless Mobile Communication and Healthcare. DOI:https://doi.org/10.4108/icst.mobihealth.2014.257418Google ScholarGoogle Scholar
  24. Enrique Garcia-Ceja, Venet Osmani, and Oscar Mayora. 2016. Automatic stress detection in working environments from smartphones’ accelerometer data: A first step. IEEE Journal of Biomedical and Health Informatics 20, 4 (July 2016), 1053--1060. DOI:https://doi.org/10.1109/JBHI.2015.2446195Google ScholarGoogle ScholarCross RefCross Ref
  25. Martin Gjoreski, Hristijan Gjoreski, Mitja Luštrek, and Matjaž Gams. 2016. Continuous stress detection using a wrist device: In laboratory and real life. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp’16 Adjunct). ACM, New York, NY, 1185--1193. DOI:https://doi.org/10.1145/2968219.2968306Google ScholarGoogle Scholar
  26. Martin Gjoreski, Mitja Luštrek, Matjaž Gams, and Hristijan Gjoreski. 2017. Monitoring stress with a wrist device using context. Journal of Biomedical Informatics 73 (Sept. 2017), 159--170. DOI:https://doi.org/10.1016/j.jbi.2017.08.006Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Kristina Grifantini. 2010. Sensor Detects Emotions Through the Skin. Retrieved February 18, 2020 from https://www.technologyreview.com/s/421316/sensor-detects-emotions-through-the-skin/.Google ScholarGoogle Scholar
  28. Tian Hao, Kimberly N. Walter, Marion J. Ball, Hung-Yang Chang, Si Sun, and Xinxin Zhu. 2017. StressHacker: Towards practical stress monitoring in the wild with smartwatches. In Proceedings of the AMIA Annual Symposium.Google ScholarGoogle Scholar
  29. Jennifer A. Healey and Rosalind W. Picard. 2005. Detecting stress during real-world driving tasks using physiological sensors. IEEE Transactions on Intelligent Transportation Systems 6, 2 (2005), 156--166.Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Javier Hernandez, Rob R. Morris, and Rosalind W. Picard. 2011. Call center stress recognition with person-specific models. In Affective Computing and Intelligent Interaction. Lecture Notes in Computer Science, Vol. 6974. Springer, 125--134 pages. DOI:https://doi.org/10.1007/978-3-642-24600-5_16Google ScholarGoogle Scholar
  31. Josiah Hester, Travis Peters, Tianlong Yun, Ronald Peterson, Joseph Skinner, Bhargav Golla, Kevin Storer, et al. 2016. Amulet: An energy-efficient, multi-application wearable platform. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys’16). ACM, New York, NY, 216--229. DOI:https://doi.org/10.1145/2994551.2994554Google ScholarGoogle Scholar
  32. Karen Hovsepian, Mustafa Al’Absi, Emre Ertin, Thomas Kamarck, Motohiro Nakajima, and Santosh Kumar. 2015. cStress: Towards a gold standard for continuous stress assessment in the mobile environment. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’15). 493--504. DOI:https://doi.org/10.1145/2750858.2807526Google ScholarGoogle Scholar
  33. Martin Kusserow, Oliver Amft, and Gerhard Troster. 2013. Monitoring stress arousal in the wild. IEEE Pervasive Computing 12, 2 (April 2013), 28--37. DOI:https://doi.org/10.1109/MPRV.2012.56Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Sylvain Laborde, Emma Mosley, and Julian F. Thayer. 2017. Heart rate variability and cardiac vagal tone in psychophysiological research—Recommendations for experiment planning, data analysis, and data reporting. Frontiers in Psychology 8 (2017), 213. DOI:https://doi.org/10.3389/fpsyg.2017.00213Google ScholarGoogle Scholar
  35. Hong Lu, Denise Frauendorfer, Mashfiqui Rabbi, Marianne S. Mast, Gokul T. Chittaranjan, Andrew T. Campbell, Daniel G. Perez, and Tanzeem Choudhury. 2012. StressSense: Detecting stress in unconstrained acoustic environments using smartphones. In Proceedings of the ACM Conference on Ubiquitous Computing (UbiComp’12). DOI:https://doi.org/10.1145/2370216.2370270Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Bruce S. McEwen and Eliot Stellar. 1993. Stress and the individual: Mechanisms leading to disease. Archives of Internal Medicine 153, 18 (1993), 2093--2101.Google ScholarGoogle ScholarCross RefCross Ref
  37. Varun Mishra, Tian Hao, Si Sun, Kimberly N. Walter, Marion J. Ball, Ching-Hua Chen, and Xinxin Zhu. 2018. Investigating the role of context in perceived stress detection in the wild. In Proceedings of the 2018 ACM International Joint Conference and the 2018 International Symposium on Pervasive and Ubiquitous Computing and Wearable Computers (UbiComp’18). ACM, New York, NY, 1708--1716. DOI:https://doi.org/10.1145/3267305.3267537Google ScholarGoogle Scholar
  38. Varun Mishra, Gunnar Pope, Sarah Lord, Stephanie Lewia, Byron Lowens, Kelly Caine, Sougata Sen, Ryan Halter, and David Kotz. 2018. The case for a commodity hardware solution for stress detection. In Proceedings of the ACM International Joint Conference on Pervasive and Ubiquitous Computing (UbiComp’18). ACM, New York, NY, 1717--1728. DOI:https://doi.org/10.1145/3267305.3267538Google ScholarGoogle Scholar
  39. Amir Muaremi, Bert Arnrich, and Gerhard Tröster. 2013. Towards measuring stress with smartphones and wearable devices during workday and sleep. BioNanoScience 3, 2 (2013), 172--183.Google ScholarGoogle ScholarCross RefCross Ref
  40. Amir Muaremi, Agon Bexheti, Franz Gravenhorst, Bert Arnrich, and Gerhard Troster. 2014. Monitoring the impact of stress on the sleep patterns of pilgrims using wearable sensors. In Proceedings of the IEEE-EMBS International Conference on Biomedical and Health Informatics (BHI’14). IEEE, Los Alamitos, CA, 185--188. DOI:https://doi.org/10.1109/BHI.2014.6864335Google ScholarGoogle Scholar
  41. NIMH. 2016. 5 Things You Should Know About Stress. Retrieved February 18, 2020 from https://www.nimh.nih.gov/health/publications/stress/index.shtml.Google ScholarGoogle Scholar
  42. K. Plarre, A. Raij, S. M. Hossain, A. A. Ali, M. Nakajima, M. Al’Absi, E. Ertin, et al. 2011. Continuous inference of psychological stress from sensory measurements collected in the natural environment. In Proceedings of the IEEE International Conference on Information Processing in Sensor Networks (IPSN’11). IEEE, Los Alamitos, CA, 97--108. http://ieeexplore.ieee.org/xpls/abs_all.jsp? arnumber=5779068.Google ScholarGoogle Scholar
  43. Polar. 2017. Polar H7. Retrieved February 18, 2020 from https://support.polar.com/us-en/support/H7_heart_rate_sensorGoogle ScholarGoogle Scholar
  44. Gunnar C. Pope, Varun Mishra, Stephanie Lewia, Byron Lowens, David Kotz, Sarah Lord, and Ryan Halter. 2018. An ultra-low resource wearable EDA sensor using wavelet compression. In Proceedings of the IEEE Conference on Body Sensor Networks (BSN’18). 193--196. DOI:https://doi.org/10.1109/BSN.2018.8329691Google ScholarGoogle Scholar
  45. R. Rosmond and P. Björntorp. 1998. Endocrine and metabolic aberrations in men with abdominal obesity in relation to anxio-depressive infirmity. Metabolism 47, 10 (1998), 1187--1193.Google ScholarGoogle ScholarCross RefCross Ref
  46. Pedro Sanches, Kristina Höök, Elsa Vaara, Claus Weymann, Markus Bylund, Pedro Ferreira, Nathalie Peira, and Marie Sjölinder. 2010. Mind the body! Designing a mobile stress management application encouraging personal reflection. In Proceedings of the ACM Conference on Designing Interactive Systems. ACM, New York, NY, 47--56.Google ScholarGoogle Scholar
  47. Akane Sano and Rosalind W. Picard. 2013. Stress recognition using wearable sensors and mobile phones. In Proceedings of the Humaine Association Conference on Affective Computing and Intelligent Interaction. IEEE, Los Alamitos, CA, 671--676. DOI:https://doi.org/10.1109/ACII.2013.117Google ScholarGoogle Scholar
  48. Hillol Sarker, Inbal Nahum-Shani, Mustafa Al’Absi, Santosh Kumar, Matthew Tyburski, Md M. Rahman, Karen Hovsepian, et al. 2016. Finding significant stress episodes in a discontinuous time series of rapidly varying mobile sensor data. In Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI’16). ACM, New York, NY, 4489--4501. DOI:https://doi.org/10.1145/2858036.2858218Google ScholarGoogle Scholar
  49. Fred Shaffer and J. P. Ginsberg. 2017. An overview of heart rate variability metrics and norms. Frontiers in Public Health 5 (2017), 258. DOI:https://doi.org/10.3389/fpubh.2017.00258Google ScholarGoogle ScholarCross RefCross Ref
  50. Feng-Tso Sun, Cynthia Kuo, Heng-Tze Cheng, Senaka Buthpitiya, Patricia Collins, and Martin Griss. 2012. Activity-aware mental stress detection using physiological sensors. In Mobile Computing, Applications, and Services. Lecture Notes of the Institute for Computer Sciences, Social Informatics, and Telecommunications Engineering, Vol. 76. Springer, 211--230. DOI:https://doi.org/10.1007/978-3-642-29336-8_16Google ScholarGoogle Scholar
  51. H. Tanaka, K. D. Monahan, and D. R. Seals. 2001. Age-predicted maximal heart rate revisited.Journal of the American College of Cardiology 37, 1 (Jan. 2001), 153--156. http://www.ncbi.nlm.nih.gov/pubmed/11153730.Google ScholarGoogle Scholar
  52. Sara Taylor, Natasha Jaques, Weixuan Chen, Szymon Fedor, Akane Sano, and Rosalind Picard. 2015. Automatic identification of artifacts in electrodermal activity data. In Proceedings of the 2015 37th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC’15), Vol. 2015. 1934--1937. DOI:https://doi.org/10.1109/EMBC.2015.7318762Google ScholarGoogle Scholar
  53. Julian F. Thayer, Fredrik Åhs, Mats Fredrikson, John J. Sollers, and Tor D. Wager. 2012. A meta-analysis of heart rate variability and neuroimaging studies: Implications for heart rate variability as a marker of stress and health. Neuroscience and Biobehavioral Reviews 36, 2 (Feb. 2012, 747--756. DOI:https://doi.org/10.1016/j.neubiorev.2011.11.009Google ScholarGoogle Scholar
  54. Vincent W. S. Tseng, Saeed Abdullah, Min Hane Aung, Franziska Wittleder, Michael Merrill, and Tanzeem Choudhury. 2016. Assessing mental health issues on college campuses: Preliminary findings from a pilot study. In Proceedings of the 2016 ACM International Joint Conference on Pervasive and Ubiquitous Computing: Adjunct (UbiComp’16 Adjunct). ACM, New York, NY, 1200--1208. DOI:https://doi.org/10.1145/2968219.2968308Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Rui Wang, Peilin Hao, Xia Zhou, Andrew T. Campbell, and Gabriella Harari. 2015. SmartGPA: How smartphones can assess and predict academic performance of college students. GetMobile: Mobile Computing and Communications 19, 4 (Oct. 2015), 13--17. DOI:https://doi.org/10.1145/2904337.2904343Google ScholarGoogle Scholar
  56. M. Wu. 2006. Trimmed and Winsorized Estimators. Ph.D. Dissertation. Michigan State University.Google ScholarGoogle Scholar
  57. Zephyr. 2018. Zephyr BioHarness 3. Retrieved February 18, 2020 from https://www.zephyranywhere.com/media/download/bioharness3-user-manual.pdf.Google ScholarGoogle Scholar
  58. Amazon. 2020. BioHarness 3 - Wireless Professional Heart Rate 8 Physiological Monitor with Bluetooth. https://www.amazon.com/BioHarness-Wireless-Professional-Physiological-Bluetooth/dp/B009ZUYNCW.Google ScholarGoogle Scholar

Index Terms

  1. Continuous Detection of Physiological Stress with Commodity Hardware

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!