Towards realtime measurement of connectedness in human movement

ABSTRACT

With the proliferation of wearable sensors, we have access to rich information regarding human movement that gives us insights into our daily activities like never before. In a sensor rich environment, it is desirable to build systems that are aware of human interactions by studying contextual information. In this paper, we attempt to quantify one such contextual cue - the connectedness of physical movement. Inspired by the Semblance of Typology Entrainments, we estimate the connectedness of trained dancers as observed from inertial sensors, using a diverse set of techniques such as quaternion correlation, approximate entropy, Fourier temporal pyramids, and discrete cosine transform. Preliminary experiments show that it is possible to robustly estimate connectedness that is invariant to frequency, amplitude, noise or time lag.

References

1. Aylward, R., Lovell, S. D., and Paradiso, J. A. A compact, wireless, wearable sensor network for interactive dance ensembles. In Wearable and Implantable Body Sensor Networks, 2006. BSN 2006. International Workshop on, IEEE (2006), 4--pp.
2. Aylward, R., and Paradiso, J. A. Sensemble: a wireless, compact, multi-user sensor system for interactive dance. In Proceedings of the 2006 conference on New interfaces for musical expression, IRCAMCentre Pompidou (2006), 134--139.
3. Bahri, M. Relationships between convolution and correlation for fourier transform and quaternion fourier transform. Int. Journal of Math. Analysis 7, 43 (2013), 2101--2109.
4. Delaherche, E., Chetouani, M., Mahdhaoui, A., Saint-Georges, C., Viaux, S., and Cohen, D. Interpersonal synchrony: A survey of evaluation methods across disciplines. Affective Computing, IEEE Transactions on 3, 3 (2012), 349--365.
5. Ell, T. A., and Sangwine, S. J. Decomposition of 2d hypercomplex fourier transforms into pairs of complex fourier transforms. In Proc. Eusipco, vol. 2 (2000), 1061--1064.
6. Freed, A. Semblance Typology of Entrainments. http://adrianfreed.com/content/semblance-typology-entrainments. Accessed: 2015-03-10.
7. Marsh, K. L., Richardson, M. J., and Schmidt, R. C. Social connection through joint action and interpersonal coordination. Top Cogn Sci 1, 2 (4 2009), 320--39.
8. Pei, S.-C. C., Ding, J.-J. J., and Chang, J.-H. H. Efficient implementation of quaternion fourier transform, convolution, and correlation by 2-d complex fft. Signal Processing, IEEE Transactions on 49, 11 (2001), 2783--2797.
9. Pincus, S., and Singer, B. H. Randomness and degrees of irregularity. Proceedings of the National Academy of Sciences 93, 5 (1996), 2083--2088.
10. Pincus, S. M. Approximate entropy as a measure of system complexity. Proceedings of the National Academy of Sciences 88, 6 (1991), 2297--2301.
11. Pirsiavash, H., Vondrick, C., and Torralba, A. Assessing the quality of actions. In 13th European Conference on Computer Vision (ECCV), Zurich, Switzerland, September 6--12, 2014, Proceedings, Part VI (2014), 556--571.
12. Sexton, B. A., and Jones, J. C. Means of complex numbers. Texas College Mathematics Journal 1, 1 (2005), 1--4.
13. Wang, J., Liu, Z., Wu, Y., and Yuan, J. Mining actionlet ensemble for action recognition with depth cameras. In (CVPR), 2012 (June 2012), 1290--1297.

Index Terms

• Applied computing

  • Arts and humanities

• Human-centered computing

  • Collaborative and social computing

• Social and professional topics

  • Professional topics

    • Computing and business