Gengdai Liu
ABSTRACT
We present Persona, a real-time human face-oriented visual effect solution on mobile devices. Persona consists of a 3D face tracker with multi-scale reconstruction models for different-level of mobile devices and a visual effect authoring tool. Our face tracker is able to reliably predict a sequence of facial and illumination parameters from a monocular video in real-time. Those parameters can then be used to develop many interesting applications. We demonstrate that our method outperforms existing state-of-the-art work about 3D face reconstruction on mobile devices and showcase results generated by our tool.
Supplemental Material
Available for Download
- Yu Deng, Jiaolong Yang, Sicheng Xu, Dong Chen, Yunde Jia, and Xin Tong. 2019. Accurate 3D Face Reconstruction With Weakly-Supervised Learning: From Single Image to Image Set. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR) Workshops.Google Scholar
Cross Ref
- Ivan Grishchenko, Artsiom Ablavatski, Yury Kartynnik, Karthik Raveendran, and Matthias Grundmann. 2020. Attention Mesh: High-fidelity Face Mesh Prediction in Real-time. arxiv:2006.10962 [cs.CV]Google Scholar
- Hao Li, Thibaut Weise, and Mark Pauly. 2010. Example-Based Facial Rigging. ACM Transactions on Graphics (Proceedings SIGGRAPH 2010) 29, 3 (July 2010).Google Scholar
Index Terms
Persona: Real-Time Neural 3D Face Reconstruction for Visual Effects on Mobile Devices
Recommendations
Expressive 3D face for mobile devices
Beyond being a digital appliance, a mobile device now increases overall quality of life by providing easy access to value-adding information. We can, however, embed media customization technology into these devices to further enhance their usage. ...
Multi-pose face reconstruction and Gabor-based dictionary learning for face recognition
AbstractMany methods based on data and model analysis have been proposed to overcome the adverse effect of poses, occlusion, and illumination on face recognition. Frontal face generation from multi-pose faces is still a widely studied and challenging ...
Occlusion recovery face recognition based on information reconstruction
AbstractThe face data in the wild have a face occlusion, complex background, and inestimable posture, leading to more sample classification errors. To alleviate the problem of face occlusion, we apply facial information reconstruction to occluded face ...
Comments