skip to main content
research-article

Music-driven character animation

Published:06 November 2009Publication History
Skip Abstract Section

Abstract

Music-driven character animation extracts musical features from a song and uses them to create an animation. This article presents a system that builds a new animation directly from musical attributes, rather than simply synchronizing it to the music like similar systems. Using a simple script that identifies the movements involved in the performance and their timing, the user can easily control the animation of characters. Another unique feature of the system is its ability to incorporate multiple characters into the same animation, both with synchronized and unsynchronized movements. A system that integrates Celtic dance movements is developed in this article. An evaluation of the results shows that the majority of animations are found to be appealing to viewers and that altering the music can change the attractiveness of the final result.

Skip Supplemental Material Section

Supplemental Material

yang1

1st supplemental movie file for Music-driven character animation

yang3

3rd supplemental movie file for Music-driven character animation

yang2

2nd supplemental movie file for Music-driven character animation

References

  1. Alankus, G., Bayazit, A. A., and Bayazit, B. 2005. Automated motion synthesis for dancing characters. Comput. Animation Virtual Worlds 16, 3-4, 259--271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bello, J. P., Daudet, L., Abdallah, S., Duxbury, C., Davies, M., and Sandler, M.B. 2005. A Tutorial on onset detection in music signals. IEEE Trans. Speech Audio Proc. 13, 5, 1035--1047.Google ScholarGoogle ScholarCross RefCross Ref
  3. Cardle, M., Barthe, L., Brooks, S., and Robinson, P. 2002. Music-driven motion editing: local motion transformation guided by music analysis. In Proceedings of Eurographics. 38--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Dixon, S. 2003. On the analysis of musical expression in audio signals. In Proceedings of the Conference on Storage and Retrieval for Media Databases. vol. 5021. 122--132.Google ScholarGoogle ScholarCross RefCross Ref
  5. Dunne, C. 1996. Celtic Feet. Acorn Media.Google ScholarGoogle Scholar
  6. Fod, A., Mataric, M. J., and Jenkins, O. 2002. Automated derivation of primitives for movement classification. Autonomous Robots 12, 1, 39--54. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Goto, M. 2001. An audio-based real-time beat tracking system for music with or without drum-sounds. J. New Music Res. 30, 2, 159--171.Google ScholarGoogle ScholarCross RefCross Ref
  8. Goto, M. and Muraoka, Y. 1994. A beat tracking system for acoustic signals of music. In Proceedings of ACM Multimedia. 365--372. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Goto, M. and Muraoka, Y. 1999. Real-time beat tracking for drumless audio signals: chord change detection for musical decisions. Speech Comm. 27, 3-4, 311--335. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Kim, T., Il Park, S., and Shin, S. Y. 2003. Rhythmic-motion synthesis based on motion-beat analysis. ACM Trans. Graph. 22, 3, 392--401. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Scheirer, E. 1998. Tempo and beat analysis of acoustic musical signals. J. Acoustical Soc. Amer. 103:1, 588--601.Google ScholarGoogle ScholarCross RefCross Ref
  12. Shiratori, T., Nakazawa, A., and Ikeuchi, K. 2004. Detecting dance motion structure through music analysis. In Proceedings of the International Conference on Face and Gesture Recognition. 857--862. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Shiratori, T., Nakazawa, A., and Ikeuchi, K. 2006. Dancing-to-music character animation. Eurographics 25, 3.Google ScholarGoogle ScholarCross RefCross Ref
  14. Taylor, R., Torres, D., and Boulanger, P. 2005. Using music to interact with a virtual character. In Proceedings of New Interfaces for Musical Expressions. 220--223. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Tzanetakis, G., Essl, G., and Cook, P. 2001. Audio analysis using the discrete wavelet transform. In Proceedings of the WSES International Conference on Acoustics and Music: Theory and Applications.Google ScholarGoogle Scholar
  16. Woch, A. and Plamondon, R. 2004. Using the framework of the kinematic theory for definition of a movement primitive. Motor Contr. 18, 547--557.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Music-driven character animation

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          • Published in

            cover image ACM Transactions on Multimedia Computing, Communications, and Applications
            ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 5, Issue 4
            October 2009
            103 pages
            ISSN:1551-6857
            EISSN:1551-6865
            DOI:10.1145/1596990
            Issue’s Table of Contents

            Copyright © 2009 ACM

            Publisher

            Association for Computing Machinery

            New York, NY, United States

            Publication History

            • Published: 6 November 2009
            • Accepted: 1 October 2007
            • Revised: 1 September 2007
            • Received: 1 January 2007
            Published in tomm Volume 5, Issue 4

            Permissions

            Request permissions about this article.

            Request Permissions

            Check for updates

            Qualifiers

            • research-article
            • Research
            • Refereed

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!