skip to main content
research-article

KNOWME: An Energy-Efficient Multimodal Body Area Network for Physical Activity Monitoring

Published:01 August 2012Publication History
Skip Abstract Section

Abstract

The use of biometric sensors for monitoring an individual’s health and related behaviors, continuously and in real time, promises to revolutionize healthcare in the near future. In an effort to better understand the complex interplay between one’s medical condition and social, environmental, and metabolic parameters, this article presents the KNOWME platform, a complete, end-to-end, body area sensing system that integrates off-the-shelf biometric sensors with a Nokia N95 mobile phone to continuously monitor the metabolic signals of a subject. With a current focus on pediatric obesity, KNOWME employs metabolic signals to monitor and evaluate physical activity. KNOWME development and in-lab deployment studies have revealed three major challenges: (1) the need for robustness to highly varying operating environments due to subject-induced variability, such as mobility or sensor placement; (2) balancing the tension between achieving high fidelity data collection and minimizing network energy consumption; and (3) accurate physical activity detection using a modest number of sensors. The KNOWME platform described herein directly addresses these three challenges. Design robustness is achieved by creating a three-tiered sensor data collection architecture. The system architecture is designed to provide robust, continuous, multichannel data collection and scales without compromising normal mobile device operation. Novel physical activity detection methods which exploit new representations of sensor signals provide accurate and efficient physical activity detection. The physical activity detection method employs personalized training phases and accounts for intersession variability. Finally, exploiting the features of the hardware implementation, a low-complexity sensor sampling algorithm is developed, resulting in significant energy savings without loss of performance.

References

  1. AliveTechnologies. 2008. Wireless health monitors from alive technology. www.alivetec.com.Google ScholarGoogle Scholar
  2. Annavaram, M., Medvidovic, N., Mitra, U., Narayanan, S., Sukhatme, G., Meng, Z., Qiu, S., Kumar, R., Thatte, G., and Spruijt-Metz, D. 2008. Multimodal sensing for pediatric obesity applications. In Proceedings of the International Workshop on Urban Community, and Social Applications of Networked Sensing System (UrbanSense08). 21--25.Google ScholarGoogle Scholar
  3. Arfken, G., Weber, H., and Weber, H. 1985. Mathematical Methods for Physicists. Academic Press, New York, NY.Google ScholarGoogle Scholar
  4. Bao, L. and Intille, S. 2004. Activity recognition from user-annotated acceleration data. In Proceedings of the 2nd International Conference on Pervasive Computing. Lecture Notes in Computer Science, vol. 3001, Springer, Berlin, 1--17.Google ScholarGoogle Scholar
  5. Benbasat, A. and Paradiso, J. 2007. A framework for the automated generation of power-efficient classifiers for embedded sensor nodes. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys). 219--232. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Bonomi, A., Goris, A., Yin, B., and Westerterp, K. 2009. Detection of type, duration, and intensity of physical activity using an accelerometer. Med. Sci. Sports Exercise 41, 9, 1770--1777.Google ScholarGoogle ScholarCross RefCross Ref
  7. Caballero, B. 2007. The global epidemic of obesity: An overview. Epidemiol. Rev. 29, 1, 1--5.Google ScholarGoogle ScholarCross RefCross Ref
  8. Campbell, W., Campbell, J., Reynolds, D., Singer, E., and Torres-Carrasquillo, P. 2006. Support vector machines for speaker and language recognition. Comput. Speech Lang. 20, 2--3, 210--229.Google ScholarGoogle ScholarCross RefCross Ref
  9. Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chen, K. and Bassett, D. 2005. The technology of accelerometry-based activity monitors: Current and future. Med. Sci. Sports Exercise 37, 11, S490--500.Google ScholarGoogle ScholarCross RefCross Ref
  11. Chen, K. and Sun, M. 1997. Improving energy expenditure estimation by using a triaxial accelerometer. J. Appl. Physiol. 83, 6, 2112--2122.Google ScholarGoogle ScholarCross RefCross Ref
  12. Clifford, G., Azuaje, F., and McSharry, P. 2006. Advanced Methods and Tools for ECG Data Analysis. Artech House, Norwood, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Collins, L., Murphy, S., and Bierman, K. 2004. A conceptual framework for adaptive preventive interventions. Prev. Sci. 5, 3, 185--196.Google ScholarGoogle ScholarCross RefCross Ref
  14. Collins, R., Kashdan, T., and Gollnisch, G. 2003. The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption. Exp. Clin. Psychopharmacol. 11, 73--78.Google ScholarGoogle ScholarCross RefCross Ref
  15. Cristianini, N. and Shawe-Taylor, J. 2000. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, Cambridge, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Crouter, S., Clowers, K., and Jr., D. B. 2006. A novel method for using accelerometer data to predict energy expenditure. J. Appl. Physiol. 100, 4, 1324--1331.Google ScholarGoogle ScholarCross RefCross Ref
  17. Ermes, M., Parkka, J., Mantyjarvi, J., and Korhonen, I. 2008. Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions. IEEE Trans. Inform. Technol. Biomed. 12, 1, 20--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Freedman, M., Lester, K., Milby, C. M. J., and Schumacher, J. 2006. Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment. J. Subst. Abuse Treat. 30, 105--111.Google ScholarGoogle ScholarCross RefCross Ref
  19. Godfrey, A., Conway, R., Meagher, D., and ÓLaighin, G. 2008. Direct measurement of human movement by accelerometry. Med. Eng. Phys. 30, 10, 1364--1386.Google ScholarGoogle ScholarCross RefCross Ref
  20. Hoh, B., Gruteserand, M., Herring, R., Ban, J., Work, D., Herrera, J., Bayen, A., Annavaram, M., and Jacobson, Q. 2008. Virtual trip lines for distributed privacy-preserving traffic monitoring. In Proceedings of ACM International Conference on Mobile Systems, Applications, and Services (MobiSys). Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Huynh, D. 2008. Human activity recognition with wearable sensors. Ph.D. disserattion, Darmstadt University of Technology.Google ScholarGoogle Scholar
  22. Huynh, T., Blanke, U., and Schiele, B. 2007. Scalable recognition of daily activities with wearable sensors. In Proceedings of the 3rd International Conference on Location and Context Awareness. Lecture Notes in Computer Science, vol. 4718, Springer, Berlin, 50. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ipsen, I. and Lee, D. 2006. Determinant approximations. Numerical Linear Algebra with Applications. Under review.Google ScholarGoogle Scholar
  24. Jatoba, L. C., Grossmann, U., Kunze, C., Ottenbacher, J., and Stork, W. 2008. Context-aware mobile health monitoring: Evaluation of different pattern recognition methods for classification of physical activity. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS).Google ScholarGoogle Scholar
  25. Kang, S., Lee, J., Jang, H., Lee, H., Lee, Y., Park, S., Park, T., and Song, J. 2008. Seemon: Scalable and energy-efficient context monitoring framework from sensor-rich mobile environments. In Proceedings of the ACM International Conference on Mobile Systems, Applications, and Services (MobiSys). Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Krause, A., Siewiorek, D., Smailagic, A., and Farringdon, J. 2005. Unsupervised, dynamic identification of physiological and activity context in wearable computing. In Proceedings of the IEEE International Symposium on Wearable Computers. 88--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Lester, J., Choudhury, T., and Borriello, G. 2006. A practical approach to recognizing physical activities. In Proceedings of the 4th International Conference on Pervasive Computing. Lecture Notes in Computer Science, vol. 3968, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Levine, J. A., Schleusner, S. J., and Jensen, M. D. 2000. Energy expenditure of nonexercise activity. Am. J. Clin. Nutr. 72, 6, 1451--1454.Google ScholarGoogle ScholarCross RefCross Ref
  29. Lianiotis, D. 1969. A class of upper bounds on probability of error for multihypotheses pattern recognition. IEEE Trans. Inf. Theory 15, 6, 730--731. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Linh, T., Osowski, S., and Stodolski, M. 2003. On-line heart beat recognition using Hermite polynomials and neuro-fuzzy network. IEEE Trans. Instrum. Meas. 52, 4, 1224--1231.Google ScholarGoogle ScholarCross RefCross Ref
  31. Liu, Y., Veeravalli, B., and Viswanathan, S. 2007. Critical-path based low-energy scheduling algorithms for body area network systems. In Proceedings of the 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Maguire, D. and Frisby, R. 2009. Comparison of feature classification algorithms for activity recognition based on accelerometer and heart rate data. In Proceedings of the 9th Information Technology and Telecommunication Conference.Google ScholarGoogle Scholar
  33. Maurer, U., Rowe, A., Smailagic, A., and Siewiorek, D. 2006. Location and activity recognition using eWatch: A wearable sensor platform. In Ambient Intelligence in Everyday Life. Lecture Notes in Computer Science, vol. 3864, Springer, Berlin, 86--102. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Miluzzo, E., Lane, N. D., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S. B., Zheng, X., and Campbell, A. T. 2008. Sensing meets mobile social networks: The design, implementation and evaluation of the cenceme application. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys’08). 337--350. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Mohammadi, G., Shoushtari, P., Ardekani, B., and Shamsollahi, M. 2006. Person identification by using AR model for EEG signals. Proc. World Acad. Sci. Eng. Tech. 11, 5.Google ScholarGoogle Scholar
  36. Ogden, C., Carroll, M., and Flegal, K. 2008. High body mass index for age among us children and adolescents, 2003-2006. J. Am. Med. Assoc. 299, 20, 2401--2405.Google ScholarGoogle ScholarCross RefCross Ref
  37. PAGAC. 2008. Physical activity guidelines advisory committee report. Tech. rep., Department of Health and Human Services, Washington D.C. http://www.health.gov/paguidelines/report/.Google ScholarGoogle Scholar
  38. Parkka, J., Ermes, M., Korpipaa, P., Mantyjarvi, J., Peltola, J., Korhonen, I., Technol, V., and Tampere, F. 2006. Activity classification using realistic data from wearable sensors. IEEE Trans. Inf. Technol. Biomed. 10, 1, 119--128. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Patrick, K., Griswold, W. G., Raab, F., and Intille, S. S. 2008. Health and the mobile phone. Am. J. Prevent. Med. 35, 2, 177--181.Google ScholarGoogle ScholarCross RefCross Ref
  40. Pawar, T., Chaudhuri, S., and Duttagupta, S. 2007. Body movement activity recognition for ambulatory cardiac monitoring. IEEE Trans. Biomed. Eng. 54, 5, 874--882.Google ScholarGoogle ScholarCross RefCross Ref
  41. Pfeiffer, K., McIver, K., Dowda, M., Almeida, M., and Pate, R. 2006. Validation and calibration of the actical accelerometer in preschool children. Med. Sci. Sports Exercise 38, 1, 152--157.Google ScholarGoogle ScholarCross RefCross Ref
  42. Ravi, N., Dandekar, N., Mysore, P., and Littman, M. 2005. Activity recognition from accelerometer data. In Proceedings of the 17th Conference on Innovative Artificial Intelligence 20, 3, 1541--1547. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., and Jones, M. 2005. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tobacco Control 14, 255--261.Google ScholarGoogle ScholarCross RefCross Ref
  44. Ross, A., Nandakumar, K., and Jain, A. 2006. Handbook of Multibiometrics. Springer, Berlin. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Ryder, J., Longstaff, B., Reddy, S., and Estrin, D. 2009. Ambulation: A tool for monitoring mobility patterns over time using mobile phones. In Proceedings of the IEEE International Conference on Social Computing: Workshop on Social Computing with Mobile Phones and Sensors: Modeling, Sensing and Sharing. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Shih, E., Bahl, P., and Sinclair, M. 2002. Wake on wireless: An event driven energy saving strategy for battery operated devices. In Proceedings of the ACM International Conference on Mobile Computing and Networking (MobiCom). Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Shin, M., Tsang, P. P., Kotz, D., and Cornelius, C. 2009. Deamon: Energy-efficient sensor monitoring. In Proceedings of the 6th IEEE Communications Society Conference on Sensor, Mesh, and Ad Hoc Communications and Networks (SECON). Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Siewiorek, D., Smailagic, A., Furukawa, J., Moraveji, N., Reiger, K., and Shaffer, J. 2003. Sensay: A context-aware mobile phone. In Proceedings of the International Semantic Web Conference (ISWC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Sirard, J. and Pate, R. 2001. Physical activity assessment in children and adolescents. Sports Med. 31, 6, 439--454.Google ScholarGoogle ScholarCross RefCross Ref
  50. Spruijt-Metz, D., Berrigan, D., Kelly, L., McConnell, R., Dueker, D., Lindsey, G., Atienza, A., Michel, S., Irwin, M., Wolch, J., Jerrett, M., Tatalovich, Z., and Redline, S. 2008. Measures of Physical Activity and Exercise. Handbook of Assessment Methods for Obesity and Eating Behaviors, Related Problems and Weight: Measures, Theory and Research. Sage Publications Inc., Thousand Oaks, CA.Google ScholarGoogle Scholar
  51. Spruijt-Metz, D., Li, M., Thatte, G., Sukhatme, G., Annavaram, M., Ghosh, S., Rozgic, V., Mitra, U., Medvidovic, N., Belcher, B., and Narayanan, S. 2009. Differentiating physical activity modalities in youth using heartbeat waveform shape and differences between adjacent waveforms. In Proceedings of the International Conference on Diet and Activity Methods.Google ScholarGoogle Scholar
  52. Sturm, R. 2002. The effects of obesity, smoking, and drinking on medical problems and costs. Health Affairs 21, 2, 245--253.Google ScholarGoogle ScholarCross RefCross Ref
  53. Sun, D., Schmidt, G., and Teo-Koh, S. 2008. Validation of the rt3 accelerometer for measuring physical activity of children in simulated free-living conditions. Pediatric Exercise Sci. 20, 2, 181--197.Google ScholarGoogle ScholarCross RefCross Ref
  54. Sun, F.-W., Jiang, Y., and Baras, J. 2003. On the convergence of the inverses of toeplitz matrices and its applications. IEEE Trans. Inf. Theory 49, 1, 180--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Thatte, G., Rozgic, V., Li, M., Ghosh, S., Mitra, U., Narayanan, S., Annavaram, M., and Spruijt-Metz, D. 2009. Optimal allocation of time-resources for multihypothesis activity-level detection. In Proceedings of the International Conference on Distributed Computing in Sensor Systems (DCOSS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Wilansky, A. 1951. The row-sums of the inverse matrix. Am. Math. Mon. 58, 9, 614--615.Google ScholarGoogle ScholarCross RefCross Ref
  57. Yan, L., Zhong, L., and Jha, N. 2007. Energy comparison and optimization of wireless body-area network technologies. In Proceedings of the ICST 2nd International Conference on Body Area Networks. Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Zhang, J. and Chu, F. 2005. Real-time modeling and prediction of physiological hand tremor. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).Google ScholarGoogle Scholar

Index Terms

  1. KNOWME: An Energy-Efficient Multimodal Body Area Network for Physical Activity Monitoring

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM Transactions on Embedded Computing Systems
        ACM Transactions on Embedded Computing Systems  Volume 11, Issue S2
        Special Section on CAPA'09, Special Section on WHS'09, and Special Section VCPSS' 09
        August 2012
        396 pages
        ISSN:1539-9087
        EISSN:1558-3465
        DOI:10.1145/2331147
        Issue’s Table of Contents

        Copyright © 2012 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 1 August 2012
        • Accepted: 1 September 2010
        • Revised: 1 June 2010
        • Received: 1 October 2009
        Published in tecs Volume 11, Issue S2

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!