Abstract
The animation community has spent significant effort trying to ease rigging procedures. This is necessitated because the increasing availability of 3D data makes manual rigging infeasible. However, object animations involve understanding elaborate geometry and dynamics, and such knowledge is hard to infuse even with modern data-driven techniques. Automatic rigging methods do not provide adequate control and cannot generalize in the presence of unseen artifacts. As an alternative, one can design a system for one shape and then transfer it to other objects. In previous work, this has been implemented by solving the dense point-to-point correspondence problem. Such an approach requires a significant amount of supervision, often placing hundreds of landmarks by hand. This paper proposes a functional approach for skeleton transfer that uses limited information and does not require a complete match between the geometries. To do so, we suggest a novel representation for the skeleton properties, namely the functional regressor, which is compact and invariant to different discretizations and poses. We consider our functional regressor a new operator to adopt in intrinsic geometry pipelines for encoding the pose information, paving the way for several new applications. We numerically stress our method on a large set of different shapes and object classes, providing qualitative and numerical evaluations of precision and computational efficiency. Finally, we show a preliminar transfer of the complete rigging scheme, introducing a promising direction for future explorations.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, A functional skeleton transfer
- Brett Allen, Brian Curless, and Zoran Popović. 2003. The space of human body shapes: reconstruction and parameterization from range scans. ACM transactions on graphics (TOG) 22 (2003), 587--594.Google Scholar
Digital Library
- Quentin Avril, Donya Ghafourzadeh, Srinivasan Ramachandran, Sahel Fallahdoust, Sarah Ribet, Olivier Dionne, Martin de Lasa, and Eric Paquette. 2016. Animation setup transfer for 3D characters. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 115--126.Google Scholar
- Ilya Baran and Jovan Popović. 2007. Automatic rigging and animation of 3d characters. ACM Transactions on graphics (TOG) 26 (2007), 72-es.Google Scholar
- Jean Basset, Stefanie Wuhrer, Edmond Boyer, and Franck Multon. 2019. Contact preserving shape transfer for rigging-free motion retargeting. In Motion, Interaction and Games. 1--10.Google Scholar
- Federica Bogo, Javier Romero, Matthew Loper, and Michael J. Black. 2014. FAUST: Dataset and evaluation for 3D mesh registration. In Proceedings IEEE Conf. on Computer Vision and Pattern Recognition (CVPR). IEEE, Piscataway, NJ, USA.Google Scholar
- Federica Bogo, Javier Romero, Gerard Pons-Moll, and Michael J. Black. 2017. Dynamic FAUST: Registering Human Bodies in Motion. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).Google Scholar
- Steve Capell, Matthew Burkhart, Brian Curless, Tom Duchamp, and Zoran Popović. 2005. Physically based rigging for deformable characters. In Proceedings of the 2005 ACM SIGGRAPH/Eurographics symposium on Computer animation. 301--310.Google Scholar
Digital Library
- Kwang-Jin Choi and Hyeong-Seok Ko. 2000. Online motion retargetting. The Journal of Visualization and Computer Animation 11 (2000), 223--235.Google Scholar
Cross Ref
- Danielle Ezuz and Mirela Ben-Chen. 2017. Deblurring and Denoising of Maps between Shapes. Computer Graphics Forum 36, 5 (2017), 165--174.Google Scholar
Digital Library
- Michael Gleicher. 1998. Retargetting motion to new characters. In Proceedings of the 25th annual conference on Computer graphics and interactive techniques. 33--42.Google Scholar
Digital Library
- Nikolas Hesse, Sergi Pujades, Javier Romero, Michael J. Black, Christoph Bodensteiner, Michael Arens, Ulrich G. Hofmann, Uta Tacke, Mijna Hadders-Algra, Raphael Weinberger, Wolfgang Muller-Felber, and A. Sebastian Schroeder. 2018. Learning an Infant Body Model from RGB-D Data for Accurate Full Body Motion Analysis. In Int. Conf. on Medical Image Computing and Computer Assisted Intervention (MICCAI).Google Scholar
- Alec Jacobson, Ilya Baran, Ladislav Kavan, Jovan Popović, and Olga Sorkine. 2012. Fast Automatic Skinning Transformations. ACM Trans. Graph. 31, 4, Article 77 (July 2012), 10 pages.Google Scholar
Digital Library
- Taeil Jin, Meekyoung Kim, and Sung-Hee Lee. 2018. Aura mesh: Motion retargeting to preserve the spatial relationships between skinned characters. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 311--320.Google Scholar
- Binh Huy Le and Zhigang Deng. 2012. Smooth Skinning Decomposition with Rigid Bones. ACM Trans. Graph. 31, 6, Article 199 (Nov. 2012), 10 pages. https://doi.org/10.1145/2366145.2366218Google Scholar
Digital Library
- Binh Huy Le and Zhigang Deng. 2014. Robust and Accurate Skeletal Rigging from Mesh Sequences. ACM Trans. Graph. 33, 4, Article 84 (July 2014), 10 pages. https://doi.org/10.1145/2601097.2601161Google Scholar
Digital Library
- Jehee Lee and Sung Yong Shin. 1999. A hierarchical approach to interactive motion editing for human-like figures. In Proceedings of the 26th annual conference on Computer graphics and interactive techniques. 39--48.Google Scholar
Digital Library
- B. Lévy. 2006. Laplace-Beltrami Eigenfunctions Towards an Algorithm That Understands Geometry. In Proc. SMI. IEEE, Washington, DC, 13--25.Google Scholar
Digital Library
- Zhiguang Liu, Antonio Mucherino, Ludovic Hoyet, and Franck Multon. 2018. Surface based motion retargeting by preserving spatial relationship. In Proceedings of the 11th Annual International Conference on Motion, Interaction, and Games. 1--11.Google Scholar
Digital Library
- Matthew Loper, Naureen Mahmood, Javier Romero, Gerard Pons-Moll, and Michael J Black. 2015. SMPL: A skinned multi-person linear model. ACM transactions on graphics (TOG) 34 (2015), 1--16.Google Scholar
Digital Library
- Riccardo Marin, Simone Melzi, Emanuele Rodolà, and Umberto Castellani. 2020. Farm: Functional automatic registration method for 3d human bodies. In Computer Graphics Forum, Vol. 39. Wiley Online Library, 160--173.Google Scholar
- Simone Melzi, Riccardo Marin, Pietro Musoni, Filippo Bardon, Marco Tarini, and Umberto Castellani. 2020. Intrinsic/extrinsic embedding for functional remeshing of 3D shapes. Computers & Graphics 88 (2020), 1--12.Google Scholar
Cross Ref
- Simone Melzi, Riccardo Marin, Emanuele Rodolà, Umberto Castellani, Jing Ren, Adrien Poulenard, Peter Wonka, and Maks Ovsjanikov. 2019a. SHREC 2019: Matching Humans with Different Connectivity. In Eurographics Workshop on 3D Object Retrieval. The Eurographics Association.Google Scholar
- Simone Melzi, Jing Ren, Emanuele Rodolá, Peter Wonka, and Maks Ovsjanikov. 2019b. ZoomOut: Spectral Upsampling for Efficient Shape Correspondence. arXiv:1904.07865 [cs.GR]Google Scholar
- Mark Meyer, Mathieu Desbrun, Peter Schröder, and Alan H Barr. 2003. Discrete Differential-Geometry Operators for Triangulated 2-Manifolds. In Visualization and mathematics III. Springer, New York, NY, 35--57.Google Scholar
- Anastasia Moutafidou and Ioannis Fudos. 2019. A Mesh Correspondence Approach for Efficient Animation Transfer.. In CGVC. 129--133.Google Scholar
- Saifeng Ni, Ran luo, Yue Zhang, Madhukar Budagavi, Andrew Joseph Dickerson, Abhishek Nagar, and Xiaohu Guo. 2020. Scan2Avatar: Automatic Rigging for 3D Raw Human Scans. In ACM SIGGRAPH 2020 Posters (Virtual Event, USA) (SIGGRAPH '20). Association for Computing Machinery, New York, NY, USA, Article 15, 2 pages. https://doi.org/10.1145/3388770.3407420Google Scholar
Digital Library
- Dorian Nogneng, Simone Melzi, Emanuele Rodolà, Umberto Castellani, Michael Bronstein, and Maks Ovsjanikov. 2018. Improved Functional Mappings via Product Preservation. Computer Graphics Forum 37, 2 (2018), 179--190.Google Scholar
Cross Ref
- Dorian Nogneng and Maks Ovsjanikov. 2017. Informative Descriptor Preservation via Commutativity for Shape Matching. Computer Graphics Forum (2017).Google Scholar
- Verónica Costa Orvalho, Ernesto Zacur, and Antonio Susin. 2008. Transferring the rig and animations from a character to different face models. In Computer Graphics Forum, Vol. 27. Wiley Online Library, 1997--2012.Google Scholar
- Maks Ovsjanikov, Mirela Ben-Chen, Justin Solomon, Adrian Butscher, and Leonidas Guibas. 2012. Functional maps: a flexible representation of maps between shapes. ACM Transactions on Graphics (TOG) 31, 4 (2012), 30:1--30:11.Google Scholar
Digital Library
- Gautam Pai, Jing Ren, Simone Melzi, Peter Wonka, and Maks Ovsjanikov. 2021. Fast Sinkhorn Filters: Using Matrix Scaling for Non-Rigid Shape Correspondence with Functional Maps. In CVPR.Google Scholar
- Gopika Rajendran and Ojus Thomas Lee. 2020. Virtual Character Animation based on Data-driven Motion Capture using Deep Learning Technique. In 2020 IEEE 15th International Conference on Industrial and Information Systems (ICHS). IEEE, 333--338.Google Scholar
Cross Ref
- Jing Ren, Simone Melzi, Maks Ovsjanikov, and Peter Wonka. 2020. MapTree: Recovering Multiple Solutions in the Space of Maps. ACM Trans. Graph. 39, 6 (Nov. 2020).Google Scholar
Digital Library
- Jing Ren, Mikhail Panine, Peter Wonka, and Maks Ovsjanikov. 2019. Structured regularization of functional map computations. Computer Graphics Forum 38, 5 (2019), 39--53.Google Scholar
Cross Ref
- Jing Ren, Adrien Poulenard, Peter Wonka, and Maks Ovsjanikov. 2018. Continuous and Orientation-preserving Correspondences via Functional Maps. ACM Transactions on Graphics (TOG) 37, 6 (2018).Google Scholar
Digital Library
- Emanuele Rodolà, Michael Moeller, and Daniel Cremers. 2015. Point-wise Map Recovery and Refinement from Functional Correspondence. In Proc. Vision, Modeling and Visualization (VMV).Google Scholar
- Jaewoo Seo, Yeongho Seol, Daehyeon Wi, Younghui Kim, and Junyong Noh. 2010. Rigging transfer. Computer Animation and Virtual Worlds 21, 3-4 (2010), 375--386.Google Scholar
Digital Library
- Çağlar Seylan and Yusuf Sahillioğlu. 2019. 3D skeleton transfer for meshes and clouds. Graphical Models 105 (2019), 101041.Google Scholar
Digital Library
- Nicholas Sharp and Keenan Crane. 2020. A Laplacian for Nonmanifold Triangle Meshes. Computer Graphics Forum (SGP) 39, 5 (2020).Google Scholar
- Gabriel Taubin. 1995. A Signal Processing Approach to Fair Surface Design. In Proc. CGIT. ACM, New York, NY, 351--358.Google Scholar
Digital Library
- B. Vallet and B. Lévy. 2008. Spectral Geometry Processing with Manifold Harmonics. Computer Graphics Forum 27, 2 (2008), 251--260.Google Scholar
Cross Ref
- Baorong Yang, Junfeng Yao, and Xiaohu Guo. 2018. DMAT: Deformable medial axis transform for animated mesh approximation. In Computer Graphics Forum, Vol. 37. Wiley Online Library, 301--311.Google Scholar
- Silvia Zuffi, Angjoo Kanazawa, David Jacobs, and Michael J. Black. 2017. 3D Menagerie: Modeling the 3D Shape and Pose of Animals. In IEEE Conf. on Computer Vision and Pattern Recognition (CVPR).Google Scholar
Index Terms
A functional skeleton transfer
Recommendations
Rigging transfer
CASA' 2010 Special IssueRealistic character animation requires elaborate rigging built on top of high quality 3D models. Sophisticated anatomically based rigs are often the choice of visual effect studios where life-like animation of CG characters is the primary objective. ...
3D skeleton transfer for meshes and clouds
Graphical abstractDisplay Omitted
AbstractWe present a curve-skeleton extraction method in the form of curve-skeleton transfer from the source shape to the target. The shapes we deal with need to be in correspondence. They are discretized as meshes embedded in 3D and are not ...
An art-directed wrinkle system for CG character clothing and skin
We present a kinematic system for creating art-directed clothing and skin wrinkles on CG characters used in the production of computer-animated feature films. This system employs a curve-based method for generating wrinkles on reference poses, which are ...






Comments