skip to main content
research-article
Public Access

Seamless Vision-assisted Placement Calibration for Wearable Inertial Sensors

Published:07 July 2017Publication History
Skip Abstract Section

Abstract

Wearable inertial devices are being widely used in the applications of activity tracking, health care, and professional sports, and their usage is on a rapid rise. Signal processing algorithms for these devices are often designed to work with a known location of the wearable sensor on the body. However, in reality, the wearable sensor may be worn at different body locations due to the user's preference or unintentional misplacement. The calibration of the sensor location is important to ensure that the algorithms operate correctly. In this article, we propose an auto-calibration technique for determining the location of wearables on the body by fusing the 3-axis accelerometer data from the devices and three-dimensional camera (i.e., Kinect) information obtained from the environment. The automatic calibration is achieved by a cascade decision-tree-based classifier on top of the minimum least-squares errors obtained by solving Wahba's problem, operating on heterogeneous sensors. The core contribution of our work is that there is no extra burden on the user as a result of this technique. The calibration is done seamlessly, leveraging sensor fusion in an Internet-of-Things setting opportunistically when the user is present in front of an environmental camera performing arbitrary movements. Our approach is evaluated with two different types of movements: simple actions (e.g., sit-to-stand or picking up phone) and complicated tasks (e.g., cooking or playing basketball), yielding 100% and 82.56% recall for simple actions and for complicated tasks, respectively, in determining the correct location of sensors.

References

  1. G. Bahle, P. Lukowicz, K. Kunze, and K. Kise. 2013. I see you: How to improve wearable activity recognition by leveraging information from environmental cameras. In Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 409--412.Google ScholarGoogle Scholar
  2. R. Bartlett. 2007. Introduction to Sports Biomechanics: Analysing Human Movement Patterns. Routledge.Google ScholarGoogle Scholar
  3. T. R. Bennett, C. Savaglio, D. Lu, H. Massey, X. Wang, J. Wu, and R. Jafari. 2014. Motionsynthesis toolset (most): A toolset for human motion data synthesis and validation. In Proceedings of the 4th ACM MobiHoc Workshop on Pervasive Wireless Healthcare. ACM, 25--30. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. D. J. Berndt and J. Clifford. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the KDD Workshop. Seattle, WA. 10, 359--370. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Y. J. Chang, S. F. Chen, and J. D. Huang. 2011. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disabil. 32, 6, 2566--2570.Google ScholarGoogle ScholarCross RefCross Ref
  6. Y. L. Chen. 2001. Application of tilt sensors in human-computer mouse interface for people with disabilities. IEEE Trans. Neur. Syst. Rehabil. Eng. 9, 3 (2001), 289--294.Google ScholarGoogle ScholarCross RefCross Ref
  7. J. L. Crassidis, K. L. Lai, and R. R. Harman. 2005. Real-time attitude-independent three-axis magnetometer calibration. J. Guid. Control Dynam. 28, 1 (2005), 115--120.Google ScholarGoogle ScholarCross RefCross Ref
  8. H. Ghasemzadeh and R. Jafari. 2011. Physical movement monitoring using body sensor networks: A phonological approach to construct spatial decision trees. IEEE Trans. Industr. Inform. 7, 1 (2011), 66--77.Google ScholarGoogle ScholarCross RefCross Ref
  9. P. D. Groves. 2013. Principles of GNSS, Inertial, And Multisensor Integrated Navigation Systems. Artech House.Google ScholarGoogle Scholar
  10. T. Helten, M. Muller, H. P. Seidel, and C. Theobalt. 2013. Real-time body tracking with one depth camera and inertial sensors. In Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV). IEEE, 1105--1112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. K. Hung, Y. Zhang, and B. Tai. 2004. Wearable medical devices for tele-home healthcare. In Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEMBS’04). IEEE, 5384--5387.Google ScholarGoogle Scholar
  12. E. Jovanov, A. Milenkovic, C. Otto, and P. C. De Groen. 2005. A wireless body area network of intelligent motion sensors for computer assisted physical rehabilitation. J. NeuroEng. Rehabil. 2, 1 (2005), 6.Google ScholarGoogle ScholarCross RefCross Ref
  13. J. Kjeldskov and C. Graham. 2003. A review of mobile HCI research methods. In Human-computer Interaction with Mobile Devices and Services. Springer, 317--335.Google ScholarGoogle Scholar
  14. K. Kunze and P. Lukowicz. 2007. Using acceleration signatures from everyday activities for on-body device location. In Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers. IEEE, 115--116. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. K. Kunze, P. Lukowicz, H. Junker, and G. Tröster. 2005. Where am i: Recognizing on-body positions of wearable sensors. In Location-and Context-awareness. Springer, 264--275. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. B. Lange, C. Y. Chang, E. Suma, B. Newman, A. S. Rizzo, and M. Bolas. 2011. Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 1831--1834.Google ScholarGoogle Scholar
  17. E. A. Lee, J. Rabaey, B. Hartmann, J. Kubiatowicz, K. Pister, A. Sangiovanni-Vincentelli, S. A. Seshia, J. Wawrzynek, D. Wessel, and T. S. Rosing. 2014. The swarm at the edge of the cloud. IEEE Des. Test 31, 3 (2014), 8--20.Google ScholarGoogle ScholarCross RefCross Ref
  18. G. M. Lerner. 1978. Three-axis attitude determination. Spacecr. Attitude Determ. Control 73 (1978), 420--428.Google ScholarGoogle Scholar
  19. R. Lienhart, L. Liang, and A. Kuranov. 2003. A detector tree of boosted classifiers for real-time object detection and tracking. In Proceedings of the 2003 International Conference on Multimedia and Expo (ICME’03). IEEE, II--277. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. S. Madgwick. 2010. An efficient orientation filter for inertial and inertial/magnetic sensor arrays. Report x-io and University of Bristol (UK).Google ScholarGoogle Scholar
  21. D. Mizell. 2003. Using gravity to estimate accelerometer orientation. In Null. IEEE, 252. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. B. Najafi, K. Aminian, A. Paraschiv-Ionescu, F. Loew, C. J. Bula, and P. Robert. 2003. Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly. IEEE Trans. Biomed. Eng. 50, 6 (2003), 711--723.Google ScholarGoogle ScholarCross RefCross Ref
  23. I. Oikonomidis, N. Kyriazis, and A. A. Argyros. 2011. Efficient model-based 3d tracking of hand articulations using kinect. In BMVC, 1, 2, 3.Google ScholarGoogle Scholar
  24. I. Oikonomidis, N. Kyriazis, and A. A. Argyros. 2012. Tracking the articulated motion of two strongly interacting hands. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1862--1869. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. G. Pons-Moll, A. Baak, T. Helten, M. Muller, H. P. Seidel, and B. Rosenhahn. 2010. Multisensor-fusion for 3d full-body human motion capture. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 663--670.Google ScholarGoogle Scholar
  26. D. M. W. Powers. 2011. Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation. Journal of Machine Learning Technologies 2, 1 (2011), 37--63.Google ScholarGoogle ScholarCross RefCross Ref
  27. D. Roggen, K. Förster, A. Calatroni, T. Holleczek, Y. Fang, G. Tröster, P. Lukowicz, G. Pirkl, D. Bannach, and K. Kunze. 2009. Opportunity: Towards opportunistic activity and context recognition systems. In Proceedings of the 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks and Workshops (WoWMoM’09). IEEE, 1--6.Google ScholarGoogle Scholar
  28. M. E. Sargin, Y. Yemez, and E. Erzin. 2007. Audiovisual synchronization and fusion using canonical correlation analysis. IEEE Trans. Multimed. 9, 7 (2007), 1396--1403. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. P. G. Savage. 1998. Strapdown inertial navigation integration algorithm design part 1: Attitude algorithms. J. Guid. Control Dynam. 21, 1 (1998), 19--28.Google ScholarGoogle ScholarCross RefCross Ref
  30. A. Vahdatpour, N. Amini, and M. Sarrafzadeh. 2011. On-body device localization for health and medical monitoring applications. In Proceedings of the 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 37--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. P. Viola and M. J. Jones. 2004. Robust real-time face detection. Int. J. Comput. Vis. 57, 2 (2004), 137--154. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. G. Wahba. 1965. A least squares estimate of satellite attitude. SIAM Rev. 7, 3 (1965), 409--409.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. D. Weenk, B. J. F. Van Beijnum, C. T. Baten, H. J. Hermens, and P. H. Veltink. 2013. Automatic identification of inertial sensor placement on human body segments during walking. J. Neuroeng. Rehabil. 10, 1 (2013), 31.Google ScholarGoogle ScholarCross RefCross Ref
  34. J. Wu, Z. Wang, S. Raghuraman, B. Prabhakaran, and R. Jafari. 2014. Demonstration abstract: Upper body motion capture system using inertial sensors. In Proceedings of the 13th International Symposium on Information Processing in Sensor Networks (IPSN-14). IEEE, 351--352. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Seamless Vision-assisted Placement Calibration for Wearable Inertial Sensors

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!