Abstract
The use of biometric sensors for monitoring an individual’s health and related behaviors, continuously and in real time, promises to revolutionize healthcare in the near future. In an effort to better understand the complex interplay between one’s medical condition and social, environmental, and metabolic parameters, this article presents the KNOWME platform, a complete, end-to-end, body area sensing system that integrates off-the-shelf biometric sensors with a Nokia N95 mobile phone to continuously monitor the metabolic signals of a subject. With a current focus on pediatric obesity, KNOWME employs metabolic signals to monitor and evaluate physical activity. KNOWME development and in-lab deployment studies have revealed three major challenges: (1) the need for robustness to highly varying operating environments due to subject-induced variability, such as mobility or sensor placement; (2) balancing the tension between achieving high fidelity data collection and minimizing network energy consumption; and (3) accurate physical activity detection using a modest number of sensors. The KNOWME platform described herein directly addresses these three challenges. Design robustness is achieved by creating a three-tiered sensor data collection architecture. The system architecture is designed to provide robust, continuous, multichannel data collection and scales without compromising normal mobile device operation. Novel physical activity detection methods which exploit new representations of sensor signals provide accurate and efficient physical activity detection. The physical activity detection method employs personalized training phases and accounts for intersession variability. Finally, exploiting the features of the hardware implementation, a low-complexity sensor sampling algorithm is developed, resulting in significant energy savings without loss of performance.
- AliveTechnologies. 2008. Wireless health monitors from alive technology. www.alivetec.com.Google Scholar
- Annavaram, M., Medvidovic, N., Mitra, U., Narayanan, S., Sukhatme, G., Meng, Z., Qiu, S., Kumar, R., Thatte, G., and Spruijt-Metz, D. 2008. Multimodal sensing for pediatric obesity applications. In Proceedings of the International Workshop on Urban Community, and Social Applications of Networked Sensing System (UrbanSense08). 21--25.Google Scholar
- Arfken, G., Weber, H., and Weber, H. 1985. Mathematical Methods for Physicists. Academic Press, New York, NY.Google Scholar
- Bao, L. and Intille, S. 2004. Activity recognition from user-annotated acceleration data. In Proceedings of the 2nd International Conference on Pervasive Computing. Lecture Notes in Computer Science, vol. 3001, Springer, Berlin, 1--17.Google Scholar
- Benbasat, A. and Paradiso, J. 2007. A framework for the automated generation of power-efficient classifiers for embedded sensor nodes. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys). 219--232. Google Scholar
Digital Library
- Bonomi, A., Goris, A., Yin, B., and Westerterp, K. 2009. Detection of type, duration, and intensity of physical activity using an accelerometer. Med. Sci. Sports Exercise 41, 9, 1770--1777.Google Scholar
Cross Ref
- Caballero, B. 2007. The global epidemic of obesity: An overview. Epidemiol. Rev. 29, 1, 1--5.Google Scholar
Cross Ref
- Campbell, W., Campbell, J., Reynolds, D., Singer, E., and Torres-Carrasquillo, P. 2006. Support vector machines for speaker and language recognition. Comput. Speech Lang. 20, 2--3, 210--229.Google Scholar
Cross Ref
- Chang, C.-C. and Lin, C.-J. 2001. LIBSVM: A library for support vector machines. Software available at http://www.csie.ntu.edu.tw/~cjlin/libsvm. Google Scholar
Digital Library
- Chen, K. and Bassett, D. 2005. The technology of accelerometry-based activity monitors: Current and future. Med. Sci. Sports Exercise 37, 11, S490--500.Google Scholar
Cross Ref
- Chen, K. and Sun, M. 1997. Improving energy expenditure estimation by using a triaxial accelerometer. J. Appl. Physiol. 83, 6, 2112--2122.Google Scholar
Cross Ref
- Clifford, G., Azuaje, F., and McSharry, P. 2006. Advanced Methods and Tools for ECG Data Analysis. Artech House, Norwood, MA. Google Scholar
Digital Library
- Collins, L., Murphy, S., and Bierman, K. 2004. A conceptual framework for adaptive preventive interventions. Prev. Sci. 5, 3, 185--196.Google Scholar
Cross Ref
- Collins, R., Kashdan, T., and Gollnisch, G. 2003. The feasibility of using cellular phones to collect ecological momentary assessment data: Application to alcohol consumption. Exp. Clin. Psychopharmacol. 11, 73--78.Google Scholar
Cross Ref
- Cristianini, N. and Shawe-Taylor, J. 2000. An Introduction to Support Vector Machines and Other Kernel-based Learning Methods. Cambridge University Press, Cambridge, UK. Google Scholar
Digital Library
- Crouter, S., Clowers, K., and Jr., D. B. 2006. A novel method for using accelerometer data to predict energy expenditure. J. Appl. Physiol. 100, 4, 1324--1331.Google Scholar
Cross Ref
- Ermes, M., Parkka, J., Mantyjarvi, J., and Korhonen, I. 2008. Detection of daily activities and sports with wearable sensors in controlled and uncontrolled conditions. IEEE Trans. Inform. Technol. Biomed. 12, 1, 20--26. Google Scholar
Digital Library
- Freedman, M., Lester, K., Milby, C. M. J., and Schumacher, J. 2006. Cell phones for ecological momentary assessment with cocaine-addicted homeless patients in treatment. J. Subst. Abuse Treat. 30, 105--111.Google Scholar
Cross Ref
- Godfrey, A., Conway, R., Meagher, D., and ÓLaighin, G. 2008. Direct measurement of human movement by accelerometry. Med. Eng. Phys. 30, 10, 1364--1386.Google Scholar
Cross Ref
- Hoh, B., Gruteserand, M., Herring, R., Ban, J., Work, D., Herrera, J., Bayen, A., Annavaram, M., and Jacobson, Q. 2008. Virtual trip lines for distributed privacy-preserving traffic monitoring. In Proceedings of ACM International Conference on Mobile Systems, Applications, and Services (MobiSys). Google Scholar
Digital Library
- Huynh, D. 2008. Human activity recognition with wearable sensors. Ph.D. disserattion, Darmstadt University of Technology.Google Scholar
- Huynh, T., Blanke, U., and Schiele, B. 2007. Scalable recognition of daily activities with wearable sensors. In Proceedings of the 3rd International Conference on Location and Context Awareness. Lecture Notes in Computer Science, vol. 4718, Springer, Berlin, 50. Google Scholar
Digital Library
- Ipsen, I. and Lee, D. 2006. Determinant approximations. Numerical Linear Algebra with Applications. Under review.Google Scholar
- Jatoba, L. C., Grossmann, U., Kunze, C., Ottenbacher, J., and Stork, W. 2008. Context-aware mobile health monitoring: Evaluation of different pattern recognition methods for classification of physical activity. In Proceedings of the 30th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBS).Google Scholar
- Kang, S., Lee, J., Jang, H., Lee, H., Lee, Y., Park, S., Park, T., and Song, J. 2008. Seemon: Scalable and energy-efficient context monitoring framework from sensor-rich mobile environments. In Proceedings of the ACM International Conference on Mobile Systems, Applications, and Services (MobiSys). Google Scholar
Digital Library
- Krause, A., Siewiorek, D., Smailagic, A., and Farringdon, J. 2005. Unsupervised, dynamic identification of physiological and activity context in wearable computing. In Proceedings of the IEEE International Symposium on Wearable Computers. 88--97. Google Scholar
Digital Library
- Lester, J., Choudhury, T., and Borriello, G. 2006. A practical approach to recognizing physical activities. In Proceedings of the 4th International Conference on Pervasive Computing. Lecture Notes in Computer Science, vol. 3968, 1--16. Google Scholar
Digital Library
- Levine, J. A., Schleusner, S. J., and Jensen, M. D. 2000. Energy expenditure of nonexercise activity. Am. J. Clin. Nutr. 72, 6, 1451--1454.Google Scholar
Cross Ref
- Lianiotis, D. 1969. A class of upper bounds on probability of error for multihypotheses pattern recognition. IEEE Trans. Inf. Theory 15, 6, 730--731. Google Scholar
Digital Library
- Linh, T., Osowski, S., and Stodolski, M. 2003. On-line heart beat recognition using Hermite polynomials and neuro-fuzzy network. IEEE Trans. Instrum. Meas. 52, 4, 1224--1231.Google Scholar
Cross Ref
- Liu, Y., Veeravalli, B., and Viswanathan, S. 2007. Critical-path based low-energy scheduling algorithms for body area network systems. In Proceedings of the 13th IEEE International Conference on Embedded and Real-Time Computing Systems and Applications. Google Scholar
Digital Library
- Maguire, D. and Frisby, R. 2009. Comparison of feature classification algorithms for activity recognition based on accelerometer and heart rate data. In Proceedings of the 9th Information Technology and Telecommunication Conference.Google Scholar
- Maurer, U., Rowe, A., Smailagic, A., and Siewiorek, D. 2006. Location and activity recognition using eWatch: A wearable sensor platform. In Ambient Intelligence in Everyday Life. Lecture Notes in Computer Science, vol. 3864, Springer, Berlin, 86--102. Google Scholar
Digital Library
- Miluzzo, E., Lane, N. D., Fodor, K., Peterson, R., Lu, H., Musolesi, M., Eisenman, S. B., Zheng, X., and Campbell, A. T. 2008. Sensing meets mobile social networks: The design, implementation and evaluation of the cenceme application. In Proceedings of the ACM Conference on Embedded Networked Sensor Systems (SenSys’08). 337--350. Google Scholar
Digital Library
- Mohammadi, G., Shoushtari, P., Ardekani, B., and Shamsollahi, M. 2006. Person identification by using AR model for EEG signals. Proc. World Acad. Sci. Eng. Tech. 11, 5.Google Scholar
- Ogden, C., Carroll, M., and Flegal, K. 2008. High body mass index for age among us children and adolescents, 2003-2006. J. Am. Med. Assoc. 299, 20, 2401--2405.Google Scholar
Cross Ref
- PAGAC. 2008. Physical activity guidelines advisory committee report. Tech. rep., Department of Health and Human Services, Washington D.C. http://www.health.gov/paguidelines/report/.Google Scholar
- Parkka, J., Ermes, M., Korpipaa, P., Mantyjarvi, J., Peltola, J., Korhonen, I., Technol, V., and Tampere, F. 2006. Activity classification using realistic data from wearable sensors. IEEE Trans. Inf. Technol. Biomed. 10, 1, 119--128. Google Scholar
Digital Library
- Patrick, K., Griswold, W. G., Raab, F., and Intille, S. S. 2008. Health and the mobile phone. Am. J. Prevent. Med. 35, 2, 177--181.Google Scholar
Cross Ref
- Pawar, T., Chaudhuri, S., and Duttagupta, S. 2007. Body movement activity recognition for ambulatory cardiac monitoring. IEEE Trans. Biomed. Eng. 54, 5, 874--882.Google Scholar
Cross Ref
- Pfeiffer, K., McIver, K., Dowda, M., Almeida, M., and Pate, R. 2006. Validation and calibration of the actical accelerometer in preschool children. Med. Sci. Sports Exercise 38, 1, 152--157.Google Scholar
Cross Ref
- Ravi, N., Dandekar, N., Mysore, P., and Littman, M. 2005. Activity recognition from accelerometer data. In Proceedings of the 17th Conference on Innovative Artificial Intelligence 20, 3, 1541--1547. Google Scholar
Digital Library
- Rodgers, A., Corbett, T., Bramley, D., Riddell, T., Wills, M., Lin, R.-B., and Jones, M. 2005. Do u smoke after txt? Results of a randomised trial of smoking cessation using mobile phone text messaging. Tobacco Control 14, 255--261.Google Scholar
Cross Ref
- Ross, A., Nandakumar, K., and Jain, A. 2006. Handbook of Multibiometrics. Springer, Berlin. Google Scholar
Digital Library
- Ryder, J., Longstaff, B., Reddy, S., and Estrin, D. 2009. Ambulation: A tool for monitoring mobility patterns over time using mobile phones. In Proceedings of the IEEE International Conference on Social Computing: Workshop on Social Computing with Mobile Phones and Sensors: Modeling, Sensing and Sharing. Google Scholar
Digital Library
- Shih, E., Bahl, P., and Sinclair, M. 2002. Wake on wireless: An event driven energy saving strategy for battery operated devices. In Proceedings of the ACM International Conference on Mobile Computing and Networking (MobiCom). Google Scholar
Digital Library
- Shin, M., Tsang, P. P., Kotz, D., and Cornelius, C. 2009. Deamon: Energy-efficient sensor monitoring. In Proceedings of the 6th IEEE Communications Society Conference on Sensor, Mesh, and Ad Hoc Communications and Networks (SECON). Google Scholar
Digital Library
- Siewiorek, D., Smailagic, A., Furukawa, J., Moraveji, N., Reiger, K., and Shaffer, J. 2003. Sensay: A context-aware mobile phone. In Proceedings of the International Semantic Web Conference (ISWC). Google Scholar
Digital Library
- Sirard, J. and Pate, R. 2001. Physical activity assessment in children and adolescents. Sports Med. 31, 6, 439--454.Google Scholar
Cross Ref
- Spruijt-Metz, D., Berrigan, D., Kelly, L., McConnell, R., Dueker, D., Lindsey, G., Atienza, A., Michel, S., Irwin, M., Wolch, J., Jerrett, M., Tatalovich, Z., and Redline, S. 2008. Measures of Physical Activity and Exercise. Handbook of Assessment Methods for Obesity and Eating Behaviors, Related Problems and Weight: Measures, Theory and Research. Sage Publications Inc., Thousand Oaks, CA.Google Scholar
- Spruijt-Metz, D., Li, M., Thatte, G., Sukhatme, G., Annavaram, M., Ghosh, S., Rozgic, V., Mitra, U., Medvidovic, N., Belcher, B., and Narayanan, S. 2009. Differentiating physical activity modalities in youth using heartbeat waveform shape and differences between adjacent waveforms. In Proceedings of the International Conference on Diet and Activity Methods.Google Scholar
- Sturm, R. 2002. The effects of obesity, smoking, and drinking on medical problems and costs. Health Affairs 21, 2, 245--253.Google Scholar
Cross Ref
- Sun, D., Schmidt, G., and Teo-Koh, S. 2008. Validation of the rt3 accelerometer for measuring physical activity of children in simulated free-living conditions. Pediatric Exercise Sci. 20, 2, 181--197.Google Scholar
Cross Ref
- Sun, F.-W., Jiang, Y., and Baras, J. 2003. On the convergence of the inverses of toeplitz matrices and its applications. IEEE Trans. Inf. Theory 49, 1, 180--190. Google Scholar
Digital Library
- Thatte, G., Rozgic, V., Li, M., Ghosh, S., Mitra, U., Narayanan, S., Annavaram, M., and Spruijt-Metz, D. 2009. Optimal allocation of time-resources for multihypothesis activity-level detection. In Proceedings of the International Conference on Distributed Computing in Sensor Systems (DCOSS). Google Scholar
Digital Library
- Wilansky, A. 1951. The row-sums of the inverse matrix. Am. Math. Mon. 58, 9, 614--615.Google Scholar
Cross Ref
- Yan, L., Zhong, L., and Jha, N. 2007. Energy comparison and optimization of wireless body-area network technologies. In Proceedings of the ICST 2nd International Conference on Body Area Networks. Google Scholar
Digital Library
- Zhang, J. and Chu, F. 2005. Real-time modeling and prediction of physiological hand tremor. In Proceedings of the IEEE International Conference on Acoustics, Speech, and Signal Processing (ICASSP).Google Scholar
Index Terms
KNOWME: An Energy-Efficient Multimodal Body Area Network for Physical Activity Monitoring
Recommendations
The hybrid mobile wireless sensor networks for data gathering
IWCMC '06: Proceedings of the 2006 international conference on Wireless communications and mobile computingIntroducing heterogeneous mobile devices, such as mobile phones into the large scale sparse wireless sensor networks is a promising research direction. These devices acting as mobile sinks offer many benefits to the network. For instance, they help to ...
Controlling Home and Office Appliances with Smart Phones
Most home and office appliances contain microprocessors. All these appliances have some user interface, but many users become frustrated with their appliances' difficult, complex functions. However, a new framework, the personal universal controller (...
Design and implementation of a ubiquitous health monitoring system
In recent years, because of the decline in birth-rate and the growth in the population of elderly people, the lack of doctors and the increase of the medical cost is becoming a big problem. One of solutions for this problem is to prevent the humans from ...






Comments