Abstract
Wearable inertial devices are being widely used in the applications of activity tracking, health care, and professional sports, and their usage is on a rapid rise. Signal processing algorithms for these devices are often designed to work with a known location of the wearable sensor on the body. However, in reality, the wearable sensor may be worn at different body locations due to the user's preference or unintentional misplacement. The calibration of the sensor location is important to ensure that the algorithms operate correctly. In this article, we propose an auto-calibration technique for determining the location of wearables on the body by fusing the 3-axis accelerometer data from the devices and three-dimensional camera (i.e., Kinect) information obtained from the environment. The automatic calibration is achieved by a cascade decision-tree-based classifier on top of the minimum least-squares errors obtained by solving Wahba's problem, operating on heterogeneous sensors. The core contribution of our work is that there is no extra burden on the user as a result of this technique. The calibration is done seamlessly, leveraging sensor fusion in an Internet-of-Things setting opportunistically when the user is present in front of an environmental camera performing arbitrary movements. Our approach is evaluated with two different types of movements: simple actions (e.g., sit-to-stand or picking up phone) and complicated tasks (e.g., cooking or playing basketball), yielding 100% and 82.56% recall for simple actions and for complicated tasks, respectively, in determining the correct location of sensors.
- G. Bahle, P. Lukowicz, K. Kunze, and K. Kise. 2013. I see you: How to improve wearable activity recognition by leveraging information from environmental cameras. In Proceedings of the 2013 IEEE International Conference on Pervasive Computing and Communications Workshops (PERCOM Workshops). IEEE, 409--412.Google Scholar
- R. Bartlett. 2007. Introduction to Sports Biomechanics: Analysing Human Movement Patterns. Routledge.Google Scholar
- T. R. Bennett, C. Savaglio, D. Lu, H. Massey, X. Wang, J. Wu, and R. Jafari. 2014. Motionsynthesis toolset (most): A toolset for human motion data synthesis and validation. In Proceedings of the 4th ACM MobiHoc Workshop on Pervasive Wireless Healthcare. ACM, 25--30. Google Scholar
Digital Library
- D. J. Berndt and J. Clifford. 1994. Using dynamic time warping to find patterns in time series. In Proceedings of the KDD Workshop. Seattle, WA. 10, 359--370. Google Scholar
Digital Library
- Y. J. Chang, S. F. Chen, and J. D. Huang. 2011. A Kinect-based system for physical rehabilitation: A pilot study for young adults with motor disabilities. Res. Dev. Disabil. 32, 6, 2566--2570.Google Scholar
Cross Ref
- Y. L. Chen. 2001. Application of tilt sensors in human-computer mouse interface for people with disabilities. IEEE Trans. Neur. Syst. Rehabil. Eng. 9, 3 (2001), 289--294.Google Scholar
Cross Ref
- J. L. Crassidis, K. L. Lai, and R. R. Harman. 2005. Real-time attitude-independent three-axis magnetometer calibration. J. Guid. Control Dynam. 28, 1 (2005), 115--120.Google Scholar
Cross Ref
- H. Ghasemzadeh and R. Jafari. 2011. Physical movement monitoring using body sensor networks: A phonological approach to construct spatial decision trees. IEEE Trans. Industr. Inform. 7, 1 (2011), 66--77.Google Scholar
Cross Ref
- P. D. Groves. 2013. Principles of GNSS, Inertial, And Multisensor Integrated Navigation Systems. Artech House.Google Scholar
- T. Helten, M. Muller, H. P. Seidel, and C. Theobalt. 2013. Real-time body tracking with one depth camera and inertial sensors. In Proceedings of the 2013 IEEE International Conference on Computer Vision (ICCV). IEEE, 1105--1112. Google Scholar
Digital Library
- K. Hung, Y. Zhang, and B. Tai. 2004. Wearable medical devices for tele-home healthcare. In Proceedings of the 26th Annual International Conference of the IEEE Engineering in Medicine and Biology Society (IEMBS’04). IEEE, 5384--5387.Google Scholar
- E. Jovanov, A. Milenkovic, C. Otto, and P. C. De Groen. 2005. A wireless body area network of intelligent motion sensors for computer assisted physical rehabilitation. J. NeuroEng. Rehabil. 2, 1 (2005), 6.Google Scholar
Cross Ref
- J. Kjeldskov and C. Graham. 2003. A review of mobile HCI research methods. In Human-computer Interaction with Mobile Devices and Services. Springer, 317--335.Google Scholar
- K. Kunze and P. Lukowicz. 2007. Using acceleration signatures from everyday activities for on-body device location. In Proceedings of the 2007 11th IEEE International Symposium on Wearable Computers. IEEE, 115--116. Google Scholar
Digital Library
- K. Kunze, P. Lukowicz, H. Junker, and G. Tröster. 2005. Where am i: Recognizing on-body positions of wearable sensors. In Location-and Context-awareness. Springer, 264--275. Google Scholar
Digital Library
- B. Lange, C. Y. Chang, E. Suma, B. Newman, A. S. Rizzo, and M. Bolas. 2011. Development and evaluation of low cost game-based balance rehabilitation tool using the Microsoft Kinect sensor. In Proceedings of the 2011 Annual International Conference of the IEEE Engineering in Medicine and Biology Society (EMBC). IEEE, 1831--1834.Google Scholar
- E. A. Lee, J. Rabaey, B. Hartmann, J. Kubiatowicz, K. Pister, A. Sangiovanni-Vincentelli, S. A. Seshia, J. Wawrzynek, D. Wessel, and T. S. Rosing. 2014. The swarm at the edge of the cloud. IEEE Des. Test 31, 3 (2014), 8--20.Google Scholar
Cross Ref
- G. M. Lerner. 1978. Three-axis attitude determination. Spacecr. Attitude Determ. Control 73 (1978), 420--428.Google Scholar
- R. Lienhart, L. Liang, and A. Kuranov. 2003. A detector tree of boosted classifiers for real-time object detection and tracking. In Proceedings of the 2003 International Conference on Multimedia and Expo (ICME’03). IEEE, II--277. Google Scholar
Digital Library
- S. Madgwick. 2010. An efficient orientation filter for inertial and inertial/magnetic sensor arrays. Report x-io and University of Bristol (UK).Google Scholar
- D. Mizell. 2003. Using gravity to estimate accelerometer orientation. In Null. IEEE, 252. Google Scholar
Digital Library
- B. Najafi, K. Aminian, A. Paraschiv-Ionescu, F. Loew, C. J. Bula, and P. Robert. 2003. Ambulatory system for human motion analysis using a kinematic sensor: monitoring of daily physical activity in the elderly. IEEE Trans. Biomed. Eng. 50, 6 (2003), 711--723.Google Scholar
Cross Ref
- I. Oikonomidis, N. Kyriazis, and A. A. Argyros. 2011. Efficient model-based 3d tracking of hand articulations using kinect. In BMVC, 1, 2, 3.Google Scholar
- I. Oikonomidis, N. Kyriazis, and A. A. Argyros. 2012. Tracking the articulated motion of two strongly interacting hands. In Proceedings of the 2012 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 1862--1869. Google Scholar
Digital Library
- G. Pons-Moll, A. Baak, T. Helten, M. Muller, H. P. Seidel, and B. Rosenhahn. 2010. Multisensor-fusion for 3d full-body human motion capture. In Proceedings of the 2010 IEEE Conference on Computer Vision and Pattern Recognition (CVPR). IEEE, 663--670.Google Scholar
- D. M. W. Powers. 2011. Evaluation: from precision, recall and f-measure to roc, informedness, markedness and correlation. Journal of Machine Learning Technologies 2, 1 (2011), 37--63.Google Scholar
Cross Ref
- D. Roggen, K. Förster, A. Calatroni, T. Holleczek, Y. Fang, G. Tröster, P. Lukowicz, G. Pirkl, D. Bannach, and K. Kunze. 2009. Opportunity: Towards opportunistic activity and context recognition systems. In Proceedings of the 2009 IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks and Workshops (WoWMoM’09). IEEE, 1--6.Google Scholar
- M. E. Sargin, Y. Yemez, and E. Erzin. 2007. Audiovisual synchronization and fusion using canonical correlation analysis. IEEE Trans. Multimed. 9, 7 (2007), 1396--1403. Google Scholar
Digital Library
- P. G. Savage. 1998. Strapdown inertial navigation integration algorithm design part 1: Attitude algorithms. J. Guid. Control Dynam. 21, 1 (1998), 19--28.Google Scholar
Cross Ref
- A. Vahdatpour, N. Amini, and M. Sarrafzadeh. 2011. On-body device localization for health and medical monitoring applications. In Proceedings of the 2011 IEEE International Conference on Pervasive Computing and Communications (PerCom). IEEE, 37--44. Google Scholar
Digital Library
- P. Viola and M. J. Jones. 2004. Robust real-time face detection. Int. J. Comput. Vis. 57, 2 (2004), 137--154. Google Scholar
Digital Library
- G. Wahba. 1965. A least squares estimate of satellite attitude. SIAM Rev. 7, 3 (1965), 409--409.Google Scholar
Digital Library
- D. Weenk, B. J. F. Van Beijnum, C. T. Baten, H. J. Hermens, and P. H. Veltink. 2013. Automatic identification of inertial sensor placement on human body segments during walking. J. Neuroeng. Rehabil. 10, 1 (2013), 31.Google Scholar
Cross Ref
- J. Wu, Z. Wang, S. Raghuraman, B. Prabhakaran, and R. Jafari. 2014. Demonstration abstract: Upper body motion capture system using inertial sensors. In Proceedings of the 13th International Symposium on Information Processing in Sensor Networks (IPSN-14). IEEE, 351--352. Google Scholar
Digital Library
Index Terms
Seamless Vision-assisted Placement Calibration for Wearable Inertial Sensors
Recommendations
Real-Time Joint Axes Estimation of the Hip and Knee Joint during Gait using Inertial Sensors
iWOAR '18: Proceedings of the 5th International Workshop on Sensor-based Activity Recognition and InteractionInertial Measurement Units (IMUs) have proven to be a promising candidate for joint kinematics assessment during human locomotion. The benefits associated with IMU-based joint angle measurements are ease of handling, flexibility and low cost. However, a ...
Opportunistic calibration of sensor orientation using the Kinect and inertial measurement unit sensor fusion
WH '15: Proceedings of the conference on Wireless HealthSensor misplacement is a common obstacle that prevents inertial-based technology from providing reliable motion inference. Traditional approaches require certain calibration postures or activities to be performed. However, this may not be feasible for ...
A body sensor network with electromyogram and inertial sensors: multimodal interpretation of muscular activities
Special section on affective and pervasive computing for healthcareThe evaluation of the postural control system (PCS) has applications in rehabilitation, sports medicine, gait analysis, fall detection, and diagnosis of many diseases associated with a reduction in balance ability. Standing involves significant muscle ...






Comments