skip to main content
research-article

Physical activity recognition using multiple sensors embedded in a wearable device

Published:22 February 2013Publication History
Skip Abstract Section

Abstract

In this article, we present a wearable intelligence device for activity monitoring applications. We developed and evaluated algorithms to recognize physical activities from data acquired using a 3-axis accelerometer with a single camera worn on a body. The recognition process is performed in two steps: at first the features for defining a human activity are measured by the 3-axis accelerometer sensor and the image sensor embedded in a wearable device. Then, the physical activity corresponding to the measured features is determined by applying the SVM classifier. The 3-axis accelerometer sensor computes the correlation between axes and the magnitude of the FFT for other features of an activity. Acceleration data is classified into nine activity labels. Through the image sensor, multiple optical flow vectors computed on each grid image patch are extracted as features for defining an activity. In the experiments, we showed that an overall accuracy rate of activity recognition based our method was 92.78%.

References

  1. Bao, L. and Intille, S. 2005. Activity recognition from user-annotated acceleration data. In Lecture Notes in Computer Science, vol. 3001, 1--17.Google ScholarGoogle Scholar
  2. Barron, J., Fleet, D., and Beauchemin, S. 1994. Performance of optical flow techniques. Int. J. Comput. Vis. 12, 1, 43--77. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Cho, Y., Nam, Y., Choi, Y., and Cho, W. 2008. SmartBuckle: Human Activity recognition using a 3-axis accelerometer and a wearable camera. In Proceedings of the ACM HealthNet. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cho, Y., Nam, Y., Kim, T., Kim, J., and Cho, W. 2007. SmartPendant: An intelligent device for human activity recognition and location tracking. In Proceedings of the ICUCT/IWUCT International Conference on Ubiquitous Convergence Technology, 119--121.Google ScholarGoogle Scholar
  5. Clarkson, B., Mase, K., and Pentland, A. 2000. Recognizing user context via wearable sensors. In Proceedings of the IEEE International Symposium on Wearable Computing, 69--76. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Cutler, R. and Turk, M. 1998. View-based interpretation of real-time optical flow for gesture recognition. In Proceedings of the 3rd IEEE International Conference Automatic Face and Gesture Recognition, 14--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. DeVaul, R. and Dunn, S. 2001. Real-time motion classification for wearable computing applications. Project paper, http://www.media.mit.edu/wearables/mithril/realtime.pdf.Google ScholarGoogle Scholar
  8. Gao, J., Collins, R. T., Hauptman, A. G., and Wactlar, H. D. 2004. Articulated motion modeling for activity analysis. In Proceedings of the IEEE Workshop on Articulated and Nonrigid Motion, 20--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Hsu, C., Chang, C., and Lin, C. 2003. A practical guide to support vector classification. http://www.csie.ntu.edu.tw/cjlin/papers.html.Google ScholarGoogle Scholar
  10. Husz, Z., Wallace, A., and Green, P. 2007. Human activity recognition with action primitives. In Proceedings of the AVSS2007, 330--335. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Huynh, T., Blanke, U., and Schiele, B. 2007. Scalable recognition of daily activities with wearable Sensors. In Lecture Notes in Computer Science vol. 4718, 50--67. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Kern, N., Schiele, B., and Schmidt, A. 2003. Multi-sensor activity context detection for wearable computing. ambient intelligence. In Lecture Notes in Computer Science vol. 2875, 220--232.Google ScholarGoogle ScholarCross RefCross Ref
  13. Krause, A., Siewiore, D., Smailagic, A., and Farringdon, J. 2005. Unsupervised, Dynamic identification of physiological and activity context in wearable computing. In Proceedings of the 7th IEEE International Symposium, 88--97. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Lester, J., Choudhury, T., and Borriello. G. 2006. A Practical Approach to Recognizing Physical Activities. In Lecture Notes in Computer Science, vol. 3968, 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Losch, M., Schmidt-Rohr, S., Knoop, S., Vacek, S., and Dillmann, R. 2007. Feature set selection and optimal classifier for human activity recognition. In Proceedings of ROMAN.Google ScholarGoogle Scholar
  16. Lu, C. M. and Ferrier, N. J. 2004. Repetitive motion analysis: segmentation and event classification. IEEE Trans. Patt. Anal. Mach. Intell. 26, 2, 258--263. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Lucas, B. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings DARPA Image Understanding Workshop (DARPA), 121--130.Google ScholarGoogle Scholar
  18. Ma, G. and Lin, X. 2004. Typical sequences extraction and recognition. In Proceedings of HCIIEECV'04, 60--71.Google ScholarGoogle Scholar
  19. Nakata, T. 2006. Recognizing human activities in video by multi-resolutional optical flows. In Proceedings of the IEEE/RSJ International Conference Intelligent Robots and Systems, 1793--1798.Google ScholarGoogle ScholarCross RefCross Ref
  20. Open Source Computer Vision Library, http://www.intel.com/research/mrl/research/opencv.Google ScholarGoogle Scholar
  21. Polana, R. and Nelson, R. C. 1997. Detection and recognition of periodic, nonrigid motion. Int. J. Comput. Vis. 23, 3, 261--282. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ravi, N., Dandekar, N., Mysore, P. and Littman, M. 2005. Activity recognition from accelerometer data. In Proceedings of the 17th Innovative Applications of Artificial Intelligence Conference, 11--18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Solà i Carós, J., Chételat, O., Celka, P., and Dasen, S. 2005. Very low complexity algorithm for ambulatory activity classification. In Proceedings of the 3rd European Medical and Biological Engineering Conference (EMBEC'05).Google ScholarGoogle Scholar
  24. Souhila, K. and Karim, A. 2007. Optical flow based robot obstacle avoidance. Int. J. Adv. Robot. Syst. 4, 1, 13--16.Google ScholarGoogle ScholarCross RefCross Ref
  25. Yilmaz, A. and Shah, M. 2005. Recognizing human actions in videos acquired by uncalibrated moving cameras. In Proceedings of the 10th IEEE International Conference on Computer Vision (ICCV'05), 150--157. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Physical activity recognition using multiple sensors embedded in a wearable device

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!