skip to main content
research-article

Joint Estimation of Age and Expression by Combining Scattering and Convolutional Networks

Published:04 January 2018Publication History
Skip Abstract Section

Abstract

This article tackles the problem of joint estimation of human age and facial expression. This is an important yet challenging problem because expressions can alter face appearances in a similar manner to human aging. Different from previous approaches that deal with the two tasks independently, our approach trains a convolutional neural network (CNN) model that unifies ordinal regression and multi-class classification in a single framework. We demonstrate experimentally that our method performs more favorably against state-of-the-art approaches.

References

  1. Timo Ahonen, Abdenour Hadid, and Matti Pietikäinen. 2006. Face description with local binary patterns: Application to face recognition. IEEE Trans. Pattern Anal. Mach. Intell. 28, 12 (2006), 2037--2041.Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Fares Alnajar, Zhongyu Lou, José Manuel Álvarez, and Theo Gevers. 2014. Expression-invariant age estimation. In Proc. BMVC. Google ScholarGoogle ScholarCross RefCross Ref
  3. Grigory Antipov, Moez Baccouche, Sid-Ahmed Berrani, and Jean-Luc Dugelay. 2016. Apparent age estimation from face images combining general and children-specialized deep learning models. In Proc. CVPR Workshops. 801--809. Google ScholarGoogle ScholarCross RefCross Ref
  4. Joan Bruna and Stéphane Mallat. 2013. Invariant scattering convolution networks. IEEE Trans. Pattern Anal. Mach. Intell. 35, 8 (2013), 1872--1886.Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Kuang-Yu Chang and Chu-Song Chen. 2015. A learning framework for age rank estimation based on face images with scattering transform. IEEE Trans. Image Processing 24, 3 (2015), 785--798. Google ScholarGoogle ScholarCross RefCross Ref
  6. Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2010. A ranking approach for human ages estimation based on face images. In Proc. ICPR. 3396--3399. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2011. Ordinal hyperplanes ranker with cost sensitivities for age estimation. In Proc. CVPR. 585--592. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Kuang-Yu Chang, Chu-Song Chen, and Yi-Ping Hung. 2013. Intensity rank estimation of facial expressions based on a single image. In Proc. SMC. 3157--3162. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Timothy F. Cootes, Gareth J. Edwards, and Christopher J. Taylor. 2001. Active appearance models. IEEE Trans. Pattern Anal. Mach. Intell. 23, 6 (2001), 681--685. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hamdi Dibeklioglu, Fares Alnajar, Albert Ali Salah, and Theo Gevers. 2015. Combining facial dynamics with appearance for age estimation. IEEE Trans. Image Processing 24, 6 (2015), 1928--1943. Google ScholarGoogle ScholarCross RefCross Ref
  11. Natalie C. Ebner, Michaela Riediger, and Ulman Lindenberger. 2010. FACES--A database of facial expressions in young, middle-aged, and older women and men: Development and validation. Behavior Research Methods 42, 1 (2010), 351--362. Google ScholarGoogle ScholarCross RefCross Ref
  12. David Freedman. 2005. Statistical Models: Theory and Practice. Cambridge University Press. Google ScholarGoogle ScholarCross RefCross Ref
  13. Bin-Bin Gao, Chao Xing, Chen-Wei Xie, Jianxin Wu, and Xin Geng. 2017. Deep label distribution learning with label ambiguity. IEEE Trans. Image Processing 26, 6 (2017), 2825--2838. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Xin Geng, Zhi-Hua Zhou, and Kate Smith-Miles. 2007. Automatic age estimation based on facial aging patterns. IEEE Trans. Pattern Anal. Mach. Intell. 29, 12 (2007), 2234--2240. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ross Girshick, Jeff Donahue, Trevor Darrell, and Jitendra Malik. 2016. Region-based convolutional networks for accurate object detection and segmentation. IEEE Trans. Pattern Anal. Mach. Intell. 38, 1 (2016), 142--158. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Guodong Guo, Rui Guo, and Xin Li. 2013. Facial expression recognition influenced by human aging. IEEE Trans. Affective Computing 4, 3 (2013), 291--298. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Guodong Guo and Guowang Mu. 2010a. Human age estimation: What is the influence across race and gender? In Proc. CVPRW. Google ScholarGoogle ScholarCross RefCross Ref
  18. Guodong Guo and Guowang Mu. 2010b. A study of large-scale ethnicity estimation with gender and age variations. In Proc. CVPRW. Google ScholarGoogle ScholarCross RefCross Ref
  19. Guodong Guo and Guowang Mu. 2013. Joint estimation of age, gender and ethnicity: CCA vs. PLS. In Proc. FG. 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  20. Guodong Guo, Guowang Mu, Yun Fu, and Thomas S. Huang. 2009. Human age estimation using bio-inspired features. In Proc. CVPR. 112--119. Google ScholarGoogle ScholarCross RefCross Ref
  21. Guodong Guo and Xiaolong Wang. 2012. A study on human age estimation under facial expression changes. In Proc. CVPR. 2547--2553.Google ScholarGoogle Scholar
  22. Guodong Guo and Chao Zhang. 2014. A study on cross-population age estimation. In Proc. CVPR. 4257--4263. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Abdenour Hadid. 2011. Analyzing facial behavioral features from videos. In Proc. Int’l Workshop Human Behavior Unterstanding. 52--61. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Hu Han, Charles Otto, Xiaoming Liu, and Anil K. Jain. 2015. Demographic estimation from face images: Human vs. machine performance. IEEE Trans. Pattern Anal. Mach. Intell. 37, 6 (2015), 1148--1161. Google ScholarGoogle ScholarCross RefCross Ref
  25. Ivan Huerta, Carles Fernández, Carlos Segura, Javier Hernando, and Andrea Prati. 2015. A deep analysis on age estimation. Pattern Recognition Letters 68 (2015), 239--249. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Yangqing Jia, Evan Shelhamer, Jeff Donahue, Sergey Karayev, Jonathan Long, Ross Girshick, Sergio Guadarrama, and Trevor Darrell. 2014. CAFFE: Convolutional architecture for fast feature embedding. In Proc. ACM MM. 675--678. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Alex Krizhevsky, Ilya Sutskever, and Geoffrey E. Hinton. 2012. ImageNet classification with deep convolutional neural networks. In Proc. NIPS.Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Andreas Lanitis, Chrisina Draganova, and Chris Christodoulou. 2004. Comparing different classifiers for automatic age estimation. IEEE Trans. Syst., Man, Cybern. B, Cybern. 34, 1 (2004), 621--628. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Changsheng Li, Qingshan Liu, Weishan Dong, Xiaobin Zhu, Jing Liu, and Hanqing Lu. 2015. Human age estimation based on locality and ordinal information. IEEE Trans. Cybernetics 45, 11 (2015), 2522--2534. Google ScholarGoogle ScholarCross RefCross Ref
  30. Changsheng Li, Qingshan Liu, Jing Liu, and Hanqing Lu. 2012. Learning ordinal discriminative features for age estimation. In Proc. CVPR. 2570--2577.Google ScholarGoogle Scholar
  31. Hsuan-Tien Lin and Ling Li. 2012. Reduction from cost-sensitive ordinal ranking to weighted binary classification. Neural Computation 24, 5 (2012), 1329--1367. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Refik Can Malli, Mehmet Aygun, and Hazim Kemal Ekenel. 2016. Apparent age estimation using ensemble of deep learning models. In Proc. CVPR Workshops. 714--721. Google ScholarGoogle ScholarCross RefCross Ref
  33. Meredith Minear and Denise C. Park. 2004. A lifespan database of adult facial stimuli. Behavior Research Methods, Instruments, 8 Computers 36, 4 (2004), 630--633.Google ScholarGoogle Scholar
  34. Zhenxing Niu, Mo Zhou, Le Wang, Xinbo Gao, and Gang Hua. 2016. Ordinal regression with multiple output CNN for age estimation. In Proc. CVPR. 4920--4928. DOI:http://dx.doi.org/10.1109/CVPR.2016.532 Google ScholarGoogle ScholarCross RefCross Ref
  35. Jhony K. Pontes, Alceu S. Britto Jr., Clinton Fookes, and Alessandro L. Koerich. 2016. A flexible hierarchical approach for facial age estimation based on multiple features. Pattern Recognition 54 (2016), 34--51. DOI:http://dx.doi.org/10.1016/j.patcog.2015.12.003 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Haoyu Ren and Ze-Nian Li. 2014. Age estimation based on complexity-aware features. In Proc. ACCV. 115--128.Google ScholarGoogle Scholar
  37. Karl Ricanek and Tamirat Tesafaye. 2006. MORPH: A longitudinal image database of normal adult age-progression. In Proc. FGR. 341--345. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Rasmus Rothe, Radu Timofte, and Luc Van Gool. 2016. Deep expectation of real and apparent age from a single image without facial landmarks. International Journal of Computer Vision (2016), 1--14. DOI:http://dx.doi.org/10.1007/s11263-016-0940-3 Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Olga Russakovsky, Jia Deng, Hao Su, Jonathan Krause, Sanjeev Satheesh, Sean Ma, Zhiheng Huang, Andrej Karpathy, Aditya Khosla, Michael Bernstein, Alexander C. Berg, and Li Fei-Fei. 2015. ImageNet large scale visual recognition challenge. Int’l J. Computer Visionl (2015), 1--42.Google ScholarGoogle Scholar
  40. Yi Sun, Xiaogang Wang, and Xiaoou Tang. 2015. Deeply learned face representations are sparse, selective, and robust. In Proc. CVPR. 2892--2900. Google ScholarGoogle ScholarCross RefCross Ref
  41. Christian Szegedy, Wei Liu, Yangqing Jia, Pierre Sermanet, Scott Reed, Dragomir Anguelov, Dumitru Erhan, Vincent Vanhoucke, and Andrew Rabinovich. 2015. Going deeper with convolutions. In Proc. CVPR. 1--9. Google ScholarGoogle ScholarCross RefCross Ref
  42. Yaniv Taigman, Ming Yang, Marc’Aurelio Ranzato, and Lior Wolf. 2014. DeepFace: Closing the gap to human-level performance in face verification. In Proc. CVPR. 1701--1708. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Zichang Tan, Shuai Zhou, Jun Wan, Zhen Lei, and Stan Z. Li. 2016. Age estimation based on a single network with soft softmax of aging modeling. In Proc. ACCV. 203--216.Google ScholarGoogle Scholar
  44. Shangfei Wang, Shan Wu, Zhen Gao, and Qiang Ji. 2016. Facial expression recognition through modeling age-related spatial patterns. Multimedia Tools Appl. 75, 7 (2016), 3937--3954. DOI:http://dx.doi.org/10.1007/s11042-015-3107-2 Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Xiaolong Wang, Rui Guo, and Chandra Kambhamettu. 2015. Deeply-learned feature for age estimation. In Proc. WACV. 534--541. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Xiaolong Wang and Chandra Kambhamettu. 2015. Age estimation via unsupervised neural networks. In Proc. FG. 1--6.Google ScholarGoogle Scholar
  47. Huei-Fang Yang, Bo-Yao Lin, Kuang-Yu Chang, and Chu-Song Chen. 2015. Automatic age estimation from face images via deep ranking. In Proc. BMVC. 55.1--55.11. Google ScholarGoogle ScholarCross RefCross Ref
  48. Peng Yang, Lin Zhong, and Dimitris N. Metaxas. 2010. Ranking model for facial age estimation. In Proc. ICPR. 3404--3407. Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Dong Yi, Zhen Lei, and Stan Z. Li. 2014. Age estimation by multi-scale convolutional network. In Proc. ACCV. 144--158.Google ScholarGoogle Scholar
  50. Chao Zhang and Guodong Guo. 2013. Age estimation with expression changes using multiple aging subspaces. In Proc. IEEE BTAS. 1--6. Google ScholarGoogle ScholarCross RefCross Ref
  51. Zhanpeng Zhang, Ping Luo, Chen Change Loy, and Xiaoou Tang. 2014. Facial landmark detection by deep multi-task learning. In Proc. ECCV. 94--108. Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Joint Estimation of Age and Expression by Combining Scattering and Convolutional Networks

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!