Nonlinear dance motion analysis and motion editing using Hilbert-Huang transform

ABSTRACT

Human motions (especially dance motions) are very noisy, and it is hard to analyze and edit the motions. To resolve this problem, we propose a new method to decompose and modify the motions using the Hilbert-Huang transform (HHT). First, HHT decomposes a chromatic signal into "monochromatic" signals that are the so-called Intrinsic Mode Functions (IMFs) using an Empirical Mode Decomposition (EMD) [6]. After applying the Hilbert Transform to each IMF, the instantaneous frequencies of the "monochromatic" signals can be obtained. The HHT has the advantage to analyze non-stationary and nonlinear signals such as human-joint-motions over FFT or Wavelet transform.

In the present paper, we propose a new framework to analyze and extract some new features from a famous Japanese threesome pop singer group called "Perfume", and compare it with Waltz and Salsa dance. Using the EMD, their dance motions can be decomposed into motion (choreographic) primitives or IMFs. Therefore we can scale, combine, subtract, exchange, and modify those IMFs, and can blend them into new dance motions self-consistently. Our analysis and framework can lead to a motion editing and blending method to create a new dance motion from different dance motions.

References

1. Ronald Newbold Bracewell and Ronald N Bracewell. 1986. The Fourier transform and its applications. Vol. 31999. McGraw-Hill New York.
2. Daniel PW Ellis. 2007. Beat tracking by dynamic programming. Journal of New Music Research 36, 1 (2007), 51--60.
3. Rich Gross. 2012. Tempo Indications and Beats Per Minute (BPM) Reference for Social Dance Genres. http://www.hollywoodballroomdc.com/recommended-tempos-for-dance-music/. (January 2012).
4. Rachel Heck and Michael Gleicher. 2007. Parametric motion graphs. In Proceedings of the 2007 symposium on Interactive 3D graphics and games. ACM, 129--136.
5. Jianzhao Huang, Jian Xie, Feng Li, and Liang Li. 2013. A THRESHOLD DENOISING METHOD BASED ON EMD. Journal of Theoretical and Applied Information Technology 47, 1 (2013).
6. Norden Eh Huang. 2014. Hilbert-Huang transform and its applications. Vol. 16. World Scientific.
7. Jehee Lee and Sung Yong Shin. 1999. A hierarchical approach to interactive motion editing for human-like figures. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 39--48.
8. J Niu, Y Liu, W Jiang, X Li, and G Kuang. 2012. Weighted average frequency algorithm for Hilbert-Huang spectrum and its application to micro-Doppler estimation. IET Radar, Sonar & Navigation 6, 7 (2012), 595--602.
9. Naveed Rehman and Danilo P Mandic. 2009. Multivariate empirical mode decomposition. In Proceedings of The Royal Society of London A: Mathematical, Physical and Engineering Sciences. The Royal Society, rspa20090502.
10. Munetoshi Unuma, Ken Anjyo, and Ryozo Takeuchi. 1995. Fourier principles for emotion-based human figure animation. In Proceedings of the 22nd annual conference on Computer graphics and interactive techniques. ACM, 91--96.
11. Naveed ur Rehman, Cheolsoo Park, Norden E Huang, and Danilo P Mandic. 2013. EMD via MEMD: multivariate noise-aided computation of standard EMD. Advances in Adaptive Data Analysis 5, 02 (2013), 1350007.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • Motion capture

  • Computer graphics

    • Animation

      • Motion processing

• Mathematics of computing

  • Mathematical analysis