Abstract
This article tackles the problem of joint estimation of human age and facial expression. This is an important yet challenging problem because expressions can alter face appearances in a similar manner to human aging. Different from previous approaches that deal with the two tasks independently, our approach trains a convolutional neural network (CNN) model that unifies ordinal regression and multi-class classification in a single framework. We demonstrate experimentally that our method performs more favorably against state-of-the-art approaches.
- Timo Ahonen, Abdenour Hadid, and Matti Pietikäinen. 2006. Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28, 12 (2006), 2037--2041.Google Scholar
Digital Library
- Fares Alnajar, Zhongyu Lou, José Manuel Álvarez, and Theo Gevers. 2014. Expression-invariant age estimation. In Proc. BMVC. Google Scholar
Cross Ref
- Grigory Antipov, Moez Baccouche, Sid-Ahmed Berrani, and Jean-Luc Dugelay. 2016. Apparent age estimation from face images combining general and children-specialized deep learning models. In Proc. CVPR Workshops. 801--809. Google Scholar
Cross Ref
- Joan Bruna and Stéphane Mallat. 2013. Invariant scattering convolution networks. IEEE Trans. Pattern Anal. Mach. Intell. 35, 8 (2013), 1872--1886.Google Scholar
Digital Library
- Kuang-Yu Chang and Chu-Song Chen. 2015. A learning framework for age rank estimation based on face images with scattering transform. IEEE Trans. Image Processing 24, 3 (2015), 785--798. Google Scholar
Cross Ref
- Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2010. A ranking approach for human ages estimation based on face images. In Proc. ICPR. 3396--3399. Google Scholar
Digital Library
- Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2011. Ordinal hyperplanes ranker with cost sensitivities for age estimation. In Proc. CVPR. 585--592. Google Scholar
Digital Library
- Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2013. Intensity rank estimation of facial expressions based on a single image. In Proc. SMC. 3157--3162. Google Scholar
Digital Library
- Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. 2001. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 6 (2001), 681--685. Google Scholar
Digital Library
- Hamdi Dibeklioglu, Fares Alnajar, Albert Ali Salah, and Theo Gevers. 2015. Combining facial dynamics with appearance for age estimation. IEEE Trans. Image Processing 24, 6 (2015), 1928--1943. Google Scholar
Cross Ref
- Natalie C. Ebner, Michaela Riediger, and Ulman Lindenberger. 2010. FACES--A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods 42, 1 (2010), 351--362. Google Scholar
Cross Ref
- David Freedman. 2005. Statistical Models: Theory and Practice. Cambridge University Press. Google Scholar
Cross Ref
- Bin-Bin Gao, Chao Xing, Chen-Wei Xie, Jianxin Wu, and Xin Geng. 2017. Deep label distribution learning with label ambiguity. IEEE Trans. Image Processing 26, 6 (2017), 2825--2838. Google Scholar
Digital Library
- Xin Geng, Zhi-Hua Zhou, and Kate Smith-Miles. 2007. Automatic age estimation based on facial aging patterns. IEEE Trans. Pattern Anal. Mach. Intell. 29, 12 (2007), 2234--2240. Google Scholar
Digital Library
- Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2016. Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38, 1 (2016), 142--158. Google Scholar
Digital Library
- Guodong Guo, Rui Guo, and Xin Li. 2013. Facial expression recognition influenced by human aging. IEEE Trans. Affective Computing 4, 3 (2013), 291--298. Google Scholar
Digital Library
- Guodong Guo and Guowang Mu. 2010a. Human age estimation: What is the influence across race and gender? In Proc. CVPRW. Google Scholar
Cross Ref
- Guodong Guo and Guowang Mu. 2010b. A study of large-scale ethnicity estimation with gender and age variations. In Proc. CVPRW. Google Scholar
Cross Ref
- Guodong Guo and Guowang Mu. 2013. Joint estimation of age, gender and ethnicity: CCA vs. PLS. In Proc. FG. 1--6. Google Scholar
Cross Ref
- Guodong Guo, Guowang Mu, Yun Fu, and Thomas S. Huang. 2009. Human age estimation using bio-inspired features. In Proc. CVPR. 112--119. Google Scholar
Cross Ref
- Guodong Guo and Xiaolong Wang. 2012. A study on human age estimation under facial expression changes. In Proc. CVPR. 2547--2553.Google Scholar
- Guodong Guo and Chao Zhang. 2014. A study on cross-population age estimation. In Proc. CVPR. 4257--4263. Google Scholar
Digital Library
- Abdenour Hadid. 2011. Analyzing facial behavioral features from videos. In Proc. Int’l Workshop Human Behavior Unterstanding. 52--61. Google Scholar
Digital Library
- Hu Han, Charles Otto, Xiaoming Liu, and Anil K. Jain. 2015. Demographic estimation from face images: Human vs. machine performance. IEEE Trans. Pattern Anal. Mach. Intell. 37, 6 (2015), 1148--1161. Google Scholar
Cross Ref
- Ivan Huerta, Carles Fernández, Carlos Segura, Javier Hernando, and Andrea Prati. 2015. A deep analysis on age estimation. Pattern Recognition Letters 68 (2015), 239--249. Google Scholar
Digital Library
- Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. CAFFE: Convolutional architecture for fast feature embedding. In Proc. ACM MM. 675--678. Google Scholar
Digital Library
- Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proc. NIPS.Google Scholar
Digital Library
- Andreas Lanitis, Chrisina Draganova, and Chris Christodoulou. 2004. Comparing different classifiers for automatic age estimation. IEEE Trans. Syst., Man, Cybern. B, Cybern. 34, 1 (2004), 621--628. Google Scholar
Digital Library
- Changsheng Li, Qingshan Liu, Weishan Dong, Xiaobin Zhu, Jing Liu, and Hanqing Lu. 2015. Human age estimation based on locality and ordinal information. IEEE Trans. Cybernetics 45, 11 (2015), 2522--2534. Google Scholar
Cross Ref
- Changsheng Li, Qingshan Liu, Jing Liu, and Hanqing Lu. 2012. Learning ordinal discriminative features for age estimation. In Proc. CVPR. 2570--2577.Google Scholar
- Hsuan-Tien Lin and Ling Li. 2012. Reduction from cost-sensitive ordinal ranking to weighted binary classification. Neural Computation 24, 5 (2012), 1329--1367. Google Scholar
Digital Library
- Refik Can Malli, Mehmet Aygun, and Hazim Kemal Ekenel. 2016. Apparent age estimation using ensemble of deep learning models. In Proc. CVPR Workshops. 714--721. Google Scholar
Cross Ref
- Meredith Minear and Denise C. Park. 2004. A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, 8 Computers 36, 4 (2004), 630--633.Google Scholar
- Zhenxing Niu, Mo Zhou, Le Wang, Xinbo Gao, and Gang Hua. 2016. Ordinal regression with multiple output CNN for age estimation. In Proc. CVPR. 4920--4928. DOI:http://dx.doi.org/10.1109/CVPR.2016.532 Google Scholar
Cross Ref
- Jhony K. Pontes, Alceu S. Britto Jr., Clinton Fookes, and Alessandro L. Koerich. 2016. A flexible hierarchical approach for facial age estimation based on multiple features. Pattern Recognition 54 (2016), 34--51. DOI:http://dx.doi.org/10.1016/j.patcog.2015.12.003 Google Scholar
Digital Library
- Haoyu Ren and Ze-Nian Li. 2014. Age estimation based on complexity-aware features. In Proc. ACCV. 115--128.Google Scholar
- Karl Ricanek and Tamirat Tesafaye. 2006. MORPH: A longitudinal image database of normal adult age-progression. In Proc. FGR. 341--345. Google Scholar
Digital Library
- Rasmus Rothe, Radu Timofte, and Luc Van Gool. 2016. Deep expectation of real and apparent age from a single image without facial landmarks. International Journal of Computer Vision (2016), 1--14. DOI:http://dx.doi.org/10.1007/s11263-016-0940-3 Google Scholar
Digital Library
- Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. ImageNet large scale visual recognition challenge. Int’l J. Computer Visionl (2015), 1--42.Google Scholar
- Yi Sun, Xiaogang Wang, and Xiaoou Tang. 2015. Deeply learned face representations are sparse, selective, and robust. In Proc. CVPR. 2892--2900. Google Scholar
Cross Ref
- Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proc. CVPR. 1--9. Google Scholar
Cross Ref
- Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf. 2014. DeepFace: Closing the gap to human-level performance in face verification. In Proc. CVPR. 1701--1708. Google Scholar
Digital Library
- Zichang Tan, Shuai Zhou, Jun Wan, Zhen Lei, and Stan Z. Li. 2016. Age estimation based on a single network with soft softmax of aging modeling. In Proc. ACCV. 203--216.Google Scholar
- Shangfei Wang, Shan Wu, Zhen Gao, and Qiang Ji. 2016. Facial expression recognition through modeling age-related spatial patterns. Multimedia Tools Appl. 75, 7 (2016), 3937--3954. DOI:http://dx.doi.org/10.1007/s11042-015-3107-2 Google Scholar
Digital Library
- Xiaolong Wang, Rui Guo, and Chandra Kambhamettu. 2015. Deeply-learned feature for age estimation. In Proc. WACV. 534--541. Google Scholar
Digital Library
- Xiaolong Wang and Chandra Kambhamettu. 2015. Age estimation via unsupervised neural networks. In Proc. FG. 1--6.Google Scholar
- Huei-Fang Yang, Bo-Yao Lin, Kuang-Yu Chang, and Chu-Song Chen. 2015. Automatic age estimation from face images via deep ranking. In Proc. BMVC. 55.1--55.11. Google Scholar
Cross Ref
- Peng Yang, Lin Zhong, and Dimitris N. Metaxas. 2010. Ranking model for facial age estimation. In Proc. ICPR. 3404--3407. Google Scholar
Digital Library
- Dong Yi, Zhen Lei, and Stan Z. Li. 2014. Age estimation by multi-scale convolutional network. In Proc. ACCV. 144--158.Google Scholar
- Chao Zhang and Guodong Guo. 2013. Age estimation with expression changes using multiple aging subspaces. In Proc. IEEE BTAS. 1--6. Google Scholar
Cross Ref
- Zhanpeng Zhang, Ping Luo, Chen Change Loy, and Xiaoou Tang. 2014. Facial landmark detection by deep multi-task learning. In Proc. ECCV. 94--108. Google Scholar
Cross Ref
Index Terms
Joint Estimation of Age and Expression by Combining Scattering and Convolutional Networks
Recommendations
A Facial Expression Recognition System Using Convolutional Networks
SIBGRAPI '15: Proceedings of the 2015 28th SIBGRAPI Conference on Graphics, Patterns and ImagesFacial expression recognition has been an active research area in the past ten years, with a growing application area like avatar animation and neuromarketing. The recognition of facial expressions is not an easy problem for machine learning methods, ...
Research Progress of Facial Expression Recognition Based on Deep Learning
CAIH2020: Proceedings of the 2020 Conference on Artificial Intelligence and HealthcareFacial expression recognition is a practical application in the field of artificial intelligence. This article focuses on the introduction of the principles of each facial expression recognition method based on deep learning in chronological order, as ...
Integrated Expression-Invariant Face Recognition with Constrained Optical Flow
PSIVT '09: Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video TechnologyFace recognition is one of the most intensively studied topics in computer vision and pattern recognition. A constrained optical flow algorithm, which combines the advantages of the unambiguous correspondence of feature point labeling and the flexible ...






Comments