Abstract
Currently, the surveillance camera-based person re-identification is still challenging because of diverse factors such as people’s changing poses and various illumination. The various poses make it hard to conduct feature matching across images, and the illumination changes make color-based features unreliable. In this article, we present SKEPRID,1 a skeleton-based person re-identification method that handles strong pose and illumination changes jointly. To reduce the impacts of pose changes on re-identification, we estimate the joints’ positions of a person based on the deep learning technique and thus make it possible to extract features on specific body parts with high accuracy. Based on the skeleton information, we design a set of local color comparison-based cloth-type features, which are resistant to various lighting conditions. Moreover, to better evaluate SKEPRID, we build the PO8LI2 dataset, which has large pose and illumination diversity. Our experimental results show that SKEPRID outperforms state-of-the-art approaches in the case of strong pose and illumination variation.
- S. M. Safdarnejad, X. Liu, L. Udpa, B. Andrus, J. Wood, and D. Craven. 2015. Sports videos in the wild (SVW): A video dataset for sports analysis. In Proceedings of the IEEE FG, vol. 1. 1--7.Google Scholar
- J. Liu, J. Luo, and M. Shah. 2009. Recognizing realistic actions from videos in the wild. In Proceedings of the IEEE CVPR. 1996--2003.Google Scholar
- S. Ramagiri, R. Kavi, and V. Kulathumani. 2011. Real-time multi-view human action recognition using a wireless camera network. In Proceedings of the ACM/IEEE ICDSC. 1--6.Google Scholar
- W. Li, R. Zhao, and X. Wang. 2012. Human re-identification with transferred metric learning. In Proceedings of the ACCV. 31--44. Google Scholar
Digital Library
- D. S. Cheng, M. Cristani, M. Stoppa, L. Bazzani, and V. Murino. 2011. Custom pictorial structures for re-identification. In Proceedings of the BMVC, vol. 5. 6.Google Scholar
- M. Farenzena, L. Bazzani, A. Perina, V. Murino, and M. Cristani. 2010. Person re-identification by symmetry-driven accumulation of local features. In Proceedings of the IEEE CVPR. 2360--2367.Google Scholar
- C. Weinrich, M. Volkhardt, and H.-M. Gross. 2013. Appearance-based 3D upper-body pose estimation and person re-identification on mobile robots. In Proceedings of the IEEE SMC. 4384--4390. Google Scholar
Digital Library
- S. Bak, F. Martins, and F. Bremond. 2015. Person re-identification by pose priors. In Proceedings of the SPIE/IS8T Electronic Imaging, International Society for Optics and Photonics. 93990H--93990H.Google Scholar
- Y.-J. Cho and K.-J. Yoon. 2016. Improving person re-identification via pose-aware multi-shot matching. In Proceedings of the IEEE CVPR. 1354--1362.Google Scholar
Cross Ref
- R. Satta, F. Pala, G. Fumera, and F. Roli. 2013. Real-time appearance-based person re-identification over multiple KinectTM cameras. In Proceedings of the VISAPP, vol. 2. 407--410.Google Scholar
- I. B. Barbosa, M. Cristani, A. D. Bue, L. Bazzani, and V. Murino. 2012. Re-identification with RGB-D sensors. In Proceedings of the ECCV. 433--442. Google Scholar
Digital Library
- M. Munaro, S. Ghidoni, D. T. Dizmen, and E. Menegatti. 2014. A feature-based approach to people re-identification using skeleton keypoints. In Proceedings of the IEEE ICRA. 5644--5651.Google Scholar
- S. Yuan, Y. Tian, and A. Arditi. 2011. Clothing matching for visually impaired persons. Technol. Disabil. 23, 2, 75--85.Google Scholar
Cross Ref
- R. Layne, T. M. Hospedales, S. Gong, and Q. Mary. 2012. Person re-identification by attributes. In Proceedings of the BMVC, vol. 2(3), p. 8.Google Scholar
- E. Ahmed, M. Jones, and T. K. Marks. 2015. An improved deep learning architecture for person re-identification. In Proceedings of the IEEE CVPR. 3908--3916.Google Scholar
- D. Yi, Z. Lei, S. Liao, and S. Z. Li. 2014. Deep metric learning for person re-identification. In Proceedings of the IEEE ICPR. 34--39. Google Scholar
Digital Library
- L. Zheng, Y. Huang, H. Lu, and Y. Yang. 2017. Pose invariant embedding for deep person re-identification, arXiv preprint arXiv:1701.07732.Google Scholar
- H. Zhao, M. Tian, S. Sun, J. Shao, J. Yan, S. Yi, X. Wang, and X. Tang. 2017. Spindle Net: Person re-identification with human body region guided feature decomposition and fusion. In Proceedings of the CVPR.Google Scholar
- C. Su, J. Li, S. Zhang, J. Xing, W. Gao, and Q. Tian. 2017. Pose-driven Deep Convolutional Model for Person Re-identification. In Proceedings of the IEEE ICCV. 3980--3989.Google Scholar
- W. Li, R. Zhao, T. Xiao, and X. Wang. 2014. Deepreid: Deep filter pairing neural network for person re-identification. In Proceedings of the IEEE CVPR. 152--159. Google Scholar
Digital Library
- L. Zheng, L. Shen, L. Tian, S. Wang, J. Wang, and Q. Tian. 2015. Scalable person re-identification: A benchmark. In Proceedings of the IEEE ICCV. 1116--1124. Google Scholar
Digital Library
- S. Khamis, C.-H. Kuo, V. K. Singh, V. D. Shet, and Larry S. Davis. 2014. Joint learning for attribute-consistent person re-identification. In Proceedings of the ECCV. 134--146.Google Scholar
- F. Xiong, M. Gou, O. Camps, and M. Sznaier. 2014. Person re-identification using kernel-based metric learning methods. In Proceedings of the ECCV. 1--16.Google Scholar
- M. Koestinger, M. Hirzer, P. Wohlhart, P. Roth, and H. Bischof. 2012. Large scale metric learning from equivalence constraints. In Proceedings of theIEEE CVPR. 2288--2295. Google Scholar
Digital Library
- N. Martinel, C. Micheloni, and G. Feresti. 2014. Saliency weighted features for person re-identification. In Proceedings of the ECCV Workshop on Visual Surveillance and Re-identification.Google Scholar
- S. Pedagadi, J. Orwell, S. Velastin, and B. Boghossian. 2013. Local Fisher discriminant analysis for pedestrian re-identification. In Proceedings of the IEEE CVPR. 3318--3325. Google Scholar
Digital Library
- S. Yan, D. Xu, B. Zhang, H. J. Zhang, Q. Yang, and S. Lin. 2007. Graph embedding and extensions: A general framework for dimensionality reduction. IEEE TPAMI 29, 1, 40--51. Google Scholar
Digital Library
- K. Q. Weinberger, J. Blitzer, and L. K. Saul. 2006. Distance metric learning for large margin nearest-neighbor classification. In Proceedings of the NIPS, vol. 18. 1473. Google Scholar
Digital Library
- A. Bhattacharyya. 1943. On a measure of divergence between two statistical population defined by their population distributions. Bull. Calcutta Math. Soc. 35, 99--109.Google Scholar
- A. Toshev and C. Szegedy. 2014. Deeppose: Human pose estimation via deep neural networks. In Proceedings of the IEEE CVPR. 1653--1660. Google Scholar
Digital Library
- S.-E. Wei, V. Ramakrishna, T. Kanade, and Y. Sheikh. 2016. Convolutional pose machines. In Proceedings of the IEEE CVPR. 4724--4732.Google Scholar
- J. Zhu, H. Zeng, S. Liao, Z. Lei, C. Cai, and L. Zheng. 2017. Deep hybrid similarity learning for person re-identification. arXiv preprint arXiv:1702.04858.Google Scholar
- S. S. Negi and Y. S. Bhandari. 2014. A hybrid approach to image enhancement using contrast stretching on image sharpening and the analysis of various cases arising using histogram. In Proceedings of the IEEE ICRAIE. 1--6.Google Scholar
- B. Xu, Y. Zhuang, H. Tang, and L. Zhang. 2010. Object-based multilevel contrast stretching method for image enhancement. IEEE Trans. Consum. Electron. 56, 3. Google Scholar
Digital Library
- N. Dalal and B. Triggs. 2005. Histograms of oriented gradients for human detection. In Proceedings of the IEEE CVPR, vol. 1. 886--893. Google Scholar
Digital Library
- M. Andriluka, L. Pishchulin, P. Gehler, and B. Schiele. 2014. 2D human pose estimation: New benchmark and state of the art analysis. In Proceedings of the IEEE CVPR. 3686--3693. Google Scholar
Digital Library
- S. Johnson and M. Everingham. 2010. Clustered pose and nonlinear appearance models for human pose estimation. In Proceedings of the BMVC.Google Scholar
- J. Canny. 1986. A computational approach to edge detection. IEEE TPAMI 6, 679--698. Google Scholar
Digital Library
- R. M. Haralick, K. Shanmugam, and I. Dinstein. 1973. Textural features of image classification. IEEE Trans. Syst., Man Cybernetics. SMC-3, no. 6.Google Scholar
Cross Ref
- H. B. Kekre, S. D. Thepade, T. K. Sarode, and V. Suryawanshi. 2010. Image retrieval using texture features extracted from GLCM, LBG and KPE. IJCTE 2, 5, 695.Google Scholar
- D. G. Lowe. 1999. Object recognition from local scale-invariant features. In Proceedings of the IEEE ICCV, vol. 2. 1150--1157. Google Scholar
Digital Library
- D. Gray, S. Brennan, and H. Tao. 2007. Evaluating appearance models for recognition, reacquisition, and tracking, IEEE PETS 3, 5, 1--7.Google Scholar
- R. Zhao, W. Ouyang, and X. Wang. 2013. Unsupervised salience learning for person re-identification. In Proceedings of the IEEE CVPR. 3586--3593. Google Scholar
Digital Library
- S. Paisitkriangkrai, C. Shen, and A. van den Hengel. 2015. Learning to rank in person re-identification with metric ensembles. In Proceedings of the IEEE CVPR. 1846--1855.Google Scholar
- S. Liao, Y. Hu, X. Zhu, and S. Z. Li. 2015. Person re-identification by local maximal occurrence representation and metric learning. In Proceedings of the CVPR. 2197--2206.Google Scholar
- C. Jose and F. Fleuret. 2016. Scalable metric learning via weighted approximate rank component analysis. In Proceedings of the ECCV. 875--890.Google Scholar
- N. Martinel, A. Das, C. Micheloni, and A. K. RoyChowdhury. 2016. Temporal model adaptation for person re-identification. In Proceedings of the ECCV. 858--877.Google Scholar
- L. Zhang, T. Xiang, and S. Gong. 2016. Learning a discriminative null space for person re-identification. In Proceedings of the CVPR. 1239--1248.Google Scholar
- H. Wang, S. Gong, X. Zhu, and T. Xiang. 2016. Human-in-the-loop person re-identification. In Proceedings of the ECCV. 405--422.Google Scholar
- L. Wu, C. Shen, and A. V. D. Hengel. 2016. Personnet: Person re-identification with deep convolutional neural networks. arXiv preprint arXiv:1601.07255.Google Scholar
- T. Xiao, H. Li, W. Ouyang, and X. Wang. 2016. Learning deep feature representations with domain guided dropout for person re-identification. In Proceedings of the IEEE CVPR. 1249--1258.Google Scholar
- R. R. Varior, M. Haloi, and G. Wang. 2016. Gated siamese convolutional neural network architecture for human re-identification. In Proceedings of the ECCV. 791--808.Google Scholar
- R. R. Varior, B. Shuai, J. Lu, D. Xu, and G. Wang. 2016. A siamese long short-term memory architecture for human re-identification. In Proceedings of the ECCV. 135--153.Google Scholar
- S. Liao and S. Z. Li. 2015. Efficient PSD constrained asymmetric metric learning for person re-identification. In Proceedings of the ICCV. 3685--3693. Google Scholar
Digital Library
- F. Wang, W. Zuo, L. Lin, D. Zhang, and L. Zhang. 2016. Joint learning of single-image and cross-image representations for person re-identification. In Proceedings of the CVPR.Google Scholar
- C. Su, F. Yang, S. Zhang, Q. Tian, L. S. Davis, and W. Gao. 2017. Multi-task learning with low rank attribute embedding for multi-camera person re-identification. In Proceedings of the IEEE TPAMI.Google Scholar
- R. N. Rodrigues, G. N. Schroeder, J. J. Corso, and V. Govindaraju. 2009. Unconstrained face recognition using MRF priors and manifold traversing. In Proceedings of the IEEE BTAS. 1--6. Google Scholar
Digital Library
- X. He, S. Yan, Y. Hu, P. Niyogi, and H.-J. Zhang. 2005. Face recognition using Laplacian faces. IEEE TPAMI 27, 3, 328--340. Google Scholar
Digital Library
- X. Wang, Tony X. Han, and S. Yan. 2009. An HOG-LBP human detector with partial occlusion handling. In Proceedings of the IEEE ICCV. 32--39.Google Scholar
- W. Chen and J. J. Corso. 2015. Action detection by implicit intentional motion clustering. In Proceedings of the IEEE ICCV. 3298--3306. Google Scholar
Digital Library
- P. F. Felzenszwalb, R. B. Girshick, D. McAllester, and D. Ramanan. 2010. Object detection with discriminatively trained part-based models. IEEE TPAMI 32, 9, 1627--1645. Google Scholar
Digital Library
- D. Tao, X. Li, S. J. Maybank, and X. Wu. 2006. Human carrying status in visual surveillance. In Proceedings of the IEEE CVPR, vol. 2. 1670--1677. Google Scholar
Digital Library
- E. Zhang, Y. Zhao, and W. Xiong. 2010. Active energy image plus 2DLPP for gait recognition. Signal Process. 90, 7, 2295--2302. Google Scholar
Digital Library
- D. Damen and D. Hogg. 2012. Detecting carried objects from sequences of walking pedestrians. IEEE TPAMI 34, 6, 1056--1067. Google Scholar
Digital Library
- J. Man and B. Bhanu. 2006. Individual recognition using gait energy image. IEEE TPAMI 28, 2, 316--322. Google Scholar
Digital Library
- L. Lee and W. Eric L. Grimson. 2002. Gait analysis for recognition and classification. In Proceedings of the IEEE FG. 155--162. Google Scholar
Digital Library
Index Terms
SKEPRID: Pose and Illumination Change-Resistant Skeleton-Based Person Re-Identification
Recommendations
FingerTrak: Continuous 3D Hand Pose Tracking by Deep Learning Hand Silhouettes Captured by Miniature Thermal Cameras on Wrist
In this paper, we present FingerTrak, a minimal-obtrusive wristband that enables continuous 3D finger tracking and hand pose estimation with four miniature thermal cameras mounted closely on a form-fitting wristband. FingerTrak explores the feasibility ...
Multifactor feature extraction for human movement recognition
In this paper, we systematically examine multifactor approaches to human pose feature extraction and compare their performances in movement recognition. Two multifactor approaches have been used in pose feature extraction, including a deterministic ...
Fine-Grained Person Re-identification
AbstractPerson re-identification (re-id) plays a critical role in tracking people via surveillance systems by matching people across non-overlapping camera views at different locations. Although most re-id methods largely depend on the appearance features ...






Comments