skip to main content
research-article

A functional skeleton transfer

Published:27 September 2021Publication History
Skip Abstract Section

Abstract

The animation community has spent significant effort trying to ease rigging procedures. This is necessitated because the increasing availability of 3D data makes manual rigging infeasible. However, object animations involve understanding elaborate geometry and dynamics, and such knowledge is hard to infuse even with modern data-driven techniques. Automatic rigging methods do not provide adequate control and cannot generalize in the presence of unseen artifacts. As an alternative, one can design a system for one shape and then transfer it to other objects. In previous work, this has been implemented by solving the dense point-to-point correspondence problem. Such an approach requires a significant amount of supervision, often placing hundreds of landmarks by hand. This paper proposes a functional approach for skeleton transfer that uses limited information and does not require a complete match between the geometries. To do so, we suggest a novel representation for the skeleton properties, namely the functional regressor, which is compact and invariant to different discretizations and poses. We consider our functional regressor a new operator to adopt in intrinsic geometry pipelines for encoding the pose information, paving the way for several new applications. We numerically stress our method on a large set of different shapes and object classes, providing qualitative and numerical evaluations of precision and computational efficiency. Finally, we show a preliminar transfer of the complete rigging scheme, introducing a promising direction for future explorations.

Skip Supplemental Material Section

Supplemental Material

References

  1. Brett Allen, Brian Curless, and Zoran Popović. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM transactions on graphics (TOG) 22 (2003), 587--594.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Quentin Avril, Donya Ghafourzadeh, Srinivasan Ramachandran, Sahel Fallahdoust, Sarah Ribet, Olivier Dionne, Martin de Lasa, and Eric Paquette. 2016. Animation setup transfer for 3D characters. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 115--126.Google ScholarGoogle Scholar
  3. Ilya Baran and Jovan Popović. 2007. Automatic rigging and animation of 3d characters. ACM Transactions on graphics (TOG) 26 (2007), 72-es.Google ScholarGoogle Scholar
  4. Jean Basset, Stefanie Wuhrer, Edmond Boyer, and Franck Multon. 2019. Contact preserving shape transfer for rigging-free motion retargeting. In Motion, Interaction and Games. 1--10.Google ScholarGoogle Scholar
  5. Federica Bogo, Javier Romero, Matthew Loper, and Michael J. Black. 2014. FAUST: Dataset and evaluation for 3D mesh registration. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). IEEE, Piscataway, NJ, USA.Google ScholarGoogle Scholar
  6. Federica Bogo, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2017. Dynamic FAUST: Registering Human Bodies in Motion. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).Google ScholarGoogle Scholar
  7. Steve Capell, Matthew Burkhart, Brian Curless, Tom Duchamp, and Zoran Popović. 2005. Physically based rigging for deformable characters. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation. 301--310.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kwang-Jin Choi and Hyeong-Seok Ko. 2000. Online motion retargetting. The Journal of Visualization and Computer Animation 11 (2000), 223--235.Google ScholarGoogle ScholarCross RefCross Ref
  9. Danielle Ezuz and Mirela Ben-Chen. 2017. Deblurring and Denoising of Maps between Shapes. Computer Graphics Forum 36, 5 (2017), 165--174.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Michael Gleicher. 1998. Retargetting motion to new characters. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. 33--42.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Nikolas Hesse, Sergi Pujades, Javier Romero, Michael J. Black, Christoph Bodensteiner, Michael Arens, Ulrich G. Hofmann, Uta Tacke, Mijna Hadders-Algra, Raphael Weinberger, Wolfgang Muller-Felber, and A. Sebastian Schroeder. 2018. Learning an Infant Body Model from RGB-D Data for Accurate Full Body Motion Analysis. In Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI).Google ScholarGoogle Scholar
  12. Alec Jacobson, Ilya Baran, Ladislav Kavan, Jovan Popović, and Olga Sorkine. 2012. Fast Automatic Skinning Transformations. ACM Trans. Graph. 31, 4, Article 77 (July 2012), 10 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Taeil Jin, Meekyoung Kim, and Sung-Hee Lee. 2018. Aura mesh: Motion retargeting to preserve the spatial relationships between skinned characters. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 311--320.Google ScholarGoogle Scholar
  14. Binh Huy Le and Zhigang Deng. 2012. Smooth Skinning Decomposition with Rigid Bones. ACM Trans. Graph. 31, 6, Article 199 (Nov. 2012), 10 pages. https://doi.org/10.1145/2366145.2366218Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Binh Huy Le and Zhigang Deng. 2014. Robust and Accurate Skeletal Rigging from Mesh Sequences. ACM Trans. Graph. 33, 4, Article 84 (July 2014), 10 pages. https://doi.org/10.1145/2601097.2601161Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Jehee Lee and Sung Yong Shin. 1999. A hierarchical approach to interactive motion editing for human-like figures. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. 39--48.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. B. Lévy. 2006. Laplace-Beltrami Eigenfunctions Towards an Algorithm That Understands Geometry. In Proc. SMI. IEEE, Washington, DC, 13--25.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Zhiguang Liu, Antonio Mucherino, Ludovic Hoyet, and Franck Multon. 2018. Surface based motion retargeting by preserving spatial relationship. In Proceedings of the 11th Annual International Conference on Motion, Interaction, and Games. 1--11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. 2015. SMPL: A skinned multi-person linear model. ACM transactions on graphics (TOG) 34 (2015), 1--16.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Riccardo Marin, Simone Melzi, Emanuele Rodolà, and Umberto Castellani. 2020. Farm: Functional automatic registration method for 3d human bodies. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 160--173.Google ScholarGoogle Scholar
  21. Simone Melzi, Riccardo Marin, Pietro Musoni, Filippo Bardon, Marco Tarini, and Umberto Castellani. 2020. Intrinsic/extrinsic embedding for functional remeshing of 3D shapes. Computers & Graphics 88 (2020), 1--12.Google ScholarGoogle ScholarCross RefCross Ref
  22. Simone Melzi, Riccardo Marin, Emanuele Rodolà, Umberto Castellani, Jing Ren, Adrien Poulenard, Peter Wonka, and Maks Ovsjanikov. 2019a. SHREC 2019: Matching Humans with Different Connectivity. In Eurographics Workshop on 3D Object Retrieval. The Eurographics Association.Google ScholarGoogle Scholar
  23. Simone Melzi, Jing Ren, Emanuele Rodolá, Peter Wonka, and Maks Ovsjanikov. 2019b. ZoomOut: Spectral Upsampling for Efficient Shape Correspondence. arXiv:1904.07865 [cs.GR]Google ScholarGoogle Scholar
  24. Mark Meyer, Mathieu Desbrun, Peter Schröder, and Alan H Barr. 2003. Discrete Differential-Geometry Operators for Triangulated 2-Manifolds. In Visualization and mathematics III. Springer, New York, NY, 35--57.Google ScholarGoogle Scholar
  25. Anastasia Moutafidou and Ioannis Fudos. 2019. A Mesh Correspondence Approach for Efficient Animation Transfer.. In CGVC. 129--133.Google ScholarGoogle Scholar
  26. Saifeng Ni, Ran luo, Yue Zhang, Madhukar Budagavi, Andrew Joseph Dickerson, Abhishek Nagar, and Xiaohu Guo. 2020. Scan2Avatar: Automatic Rigging for 3D Raw Human Scans. In ACM SIGGRAPH 2020 Posters (Virtual Event, USA) (SIGGRAPH '20). Association for Computing Machinery, New York, NY, USA, Article 15, 2 pages. https://doi.org/10.1145/3388770.3407420Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Dorian Nogneng, Simone Melzi, Emanuele Rodolà, Umberto Castellani, Michael Bronstein, and Maks Ovsjanikov. 2018. Improved Functional Mappings via Product Preservation. Computer Graphics Forum 37, 2 (2018), 179--190.Google ScholarGoogle ScholarCross RefCross Ref
  28. Dorian Nogneng and Maks Ovsjanikov. 2017. Informative Descriptor Preservation via Commutativity for Shape Matching. Computer Graphics Forum (2017).Google ScholarGoogle Scholar
  29. Verónica Costa Orvalho, Ernesto Zacur, and Antonio Susin. 2008. Transferring the rig and animations from a character to different face models. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 1997--2012.Google ScholarGoogle Scholar
  30. Maks Ovsjanikov, Mirela Ben-Chen, Justin Solomon, Adrian Butscher, and Leonidas Guibas. 2012. Functional maps: a flexible representation of maps between shapes. ACM Transactions on Graphics (TOG) 31, 4 (2012), 30:1--30:11.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Gautam Pai, Jing Ren, Simone Melzi, Peter Wonka, and Maks Ovsjanikov. 2021. Fast Sinkhorn Filters: Using Matrix Scaling for Non-Rigid Shape Correspondence with Functional Maps. In CVPR.Google ScholarGoogle Scholar
  32. Gopika Rajendran and Ojus Thomas Lee. 2020. Virtual Character Animation based on Data-driven Motion Capture using Deep Learning Technique. In 2020 IEEE 15th International Conference on Industrial and Information Systems (ICHS). IEEE, 333--338.Google ScholarGoogle ScholarCross RefCross Ref
  33. Jing Ren, Simone Melzi, Maks Ovsjanikov, and Peter Wonka. 2020. MapTree: Recovering Multiple Solutions in the Space of Maps. ACM Trans. Graph. 39, 6 (Nov. 2020).Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Jing Ren, Mikhail Panine, Peter Wonka, and Maks Ovsjanikov. 2019. Structured regularization of functional map computations. Computer Graphics Forum 38, 5 (2019), 39--53.Google ScholarGoogle ScholarCross RefCross Ref
  35. Jing Ren, Adrien Poulenard, Peter Wonka, and Maks Ovsjanikov. 2018. Continuous and Orientation-preserving Correspondences via Functional Maps. ACM Transactions on Graphics (TOG) 37, 6 (2018).Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Emanuele Rodolà, Michael Moeller, and Daniel Cremers. 2015. Point-wise Map Recovery and Refinement from Functional Correspondence. In Proc. Vision, Modeling and Visualization (VMV).Google ScholarGoogle Scholar
  37. Jaewoo Seo, Yeongho Seol, Daehyeon Wi, Younghui Kim, and Junyong Noh. 2010. Rigging transfer. Computer Animation and Virtual Worlds 21, 3-4 (2010), 375--386.Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Çağlar Seylan and Yusuf Sahillioğlu. 2019. 3D skeleton transfer for meshes and clouds. Graphical Models 105 (2019), 101041.Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Nicholas Sharp and Keenan Crane. 2020. A Laplacian for Nonmanifold Triangle Meshes. Computer Graphics Forum (SGP) 39, 5 (2020).Google ScholarGoogle Scholar
  40. Gabriel Taubin. 1995. A Signal Processing Approach to Fair Surface Design. In Proc. CGIT. ACM, New York, NY, 351--358.Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. B. Vallet and B. Lévy. 2008. Spectral Geometry Processing with Manifold Harmonics. Computer Graphics Forum 27, 2 (2008), 251--260.Google ScholarGoogle ScholarCross RefCross Ref
  42. Baorong Yang, Junfeng Yao, and Xiaohu Guo. 2018. DMAT: Deformable medial axis transform for animated mesh approximation. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 301--311.Google ScholarGoogle Scholar
  43. Silvia Zuffi, Angjoo Kanazawa, David Jacobs, and Michael J. Black. 2017. 3D Menagerie: Modeling the 3D Shape and Pose of Animals. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).Google ScholarGoogle Scholar

Index Terms

  1. A functional skeleton transfer

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
        Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 4, Issue 3
        September 2021
        268 pages
        EISSN:2577-6193
        DOI:10.1145/3488568
        Issue’s Table of Contents

        Copyright © 2021 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 27 September 2021
        Published in pacmcgit Volume 4, Issue 3

        Permissions

        Request permissions about this article.

        Request Permissions

        Check for updates

        Qualifiers

        • research-article
        • Research
        • Refereed
      • Article Metrics

        • Downloads (Last 12 months)81
        • Downloads (Last 6 weeks)12

        Other Metrics

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!