Konstantinos K. Delibasis
ABSTRACT
In this paper, we present a methodology for labeling and tracking human silhouettes in indoor videos acquired by omnidirectional (fish-eye) cameras. The proposed methodology is based on a fisheye camera model that employs a spherical optical element and central projection, which has been calibrated to allow extraction of 3D geometry clues as described in [11]. The proposed algorithm requires input from a video segmentation algorithm, generating segmented human silhouettes. The history of a person's real position, as well as his appearance in the form of R, G, B color values are utilized in the described methodology. According to initial experimentation, the proposed algorithm is able to track efficiently multiple silhouettes with prolonged partial or full occlusions and it can calculate the trajectory of each silhouette. The algorithm can operate in the presence of imperfect segmentation, with the persons moving in any direction with respect to the camera, thus producing radically different shapes and color appearances.
- Wenkai L., Hongxun Y., Rongrong J., Tianqiang L., Debin Z., 3D Silhouette Tracking with Occlusion Inference, Visual Communications and Image Processing 2010, edited by Pascal Frossard, Houqiang Li, Feng Wu, Bernd Girod, Shipeng Li, Guo Wei, Proc. of SPIE Vol. 7744, 2010.Google Scholar
- B Benfold and I D Reid, Stable Multi-Target Tracking in Real-Time Surveillance Video, Proc Computer Vision and Pattern Recognition (CVPR), Colorado Springs, June 2011. Google ScholarDigital Library
- Songhwai Oh, Russell S., and Sastry S., Markov Chain Monte Carlo Data Association for Multiple-Target Tracking, ICDC, EEE Transactions on Automatic Control, vol. 54, no. 3, pp. 481--497, Mar. 2009.Google ScholarCross Ref
- Pan Pan, Fatih Porikli, Dan Schonfeld, Recurrent Tracking using Multifold Consistency, Proceedings 11th IEEE International Workshop on PETS, Miami, June 25, 2009Google Scholar
- Lucas, B. and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of the International Joint Conference on Artificial Intelligence, pp. 674--679 Google ScholarDigital Library
- Baker S., Mathews I., Lucas-Kanade 20 Years On: A Unifying Framework, International Journal of Computer Vision 56(3), 221--255, 2004 Google ScholarDigital Library
- Collins R.T., Mean-shift blob tracking through scale space, in: Proceedings of the 2003 IEEE Computer Society Conference on Computer Vision and Pattern Recognition, vol. 2, 2003, pp. 234--240.Google ScholarCross Ref
- Comaniciu D., Ramesh V., Meer P., Kernel-based object tracking, IEEE Transactions on Pattern Analysis and Machine Intelligence 25 (5) (2003) 564--577 Google ScholarDigital Library
- Leichter I., Lindenbaum M., Rivlin E., Mean Shift tracking with multiple reference color histograms, Computer Vision and Image Understanding 114 (2010) 400--408 Google ScholarDigital Library
- KK Delibasis, T Goudas, VP Plagianakos, I Maglogiannis, Fisheye camera modeling for human segmentation refinement in indoor videos, Proceedings of the 6th International Conference on PErvasive Technologies Related to Assistive Environments, Rhodos Island, 2013Bowman, M., Debray, S. K., and Peterson, L. L. 1993. Reasoning about naming systems. ACM Trans. Program. Lang. Syst. 15, 5 (Nov. 1993), 795--825. DOI= http://doi.acm.org/10.1145/161468.16147. Google ScholarDigital Library
- Delibasis, K. K., Plagianakos, V. P., & Maglogiannis, I. (2014). Refinement of human silhouette segmentation in omni-directional indoor videos. Computer Vision and Image Understanding, 128, 65--83Google Scholar
- Comaniciu, D., Ramesh, V., & Meer, P. (2000). Real-time tracking of non-rigid objects using mean shift. In Computer Vision and Pattern Recognition, 2000. Proceedings. IEEE Conference on (Vol. 2, pp. 142--149). IEEE.Google ScholarCross Ref
- Nummiaro, K., Koller-Meier, E., & Van Gool, L. (2003). An adaptive color-based particle filter. Image and vision computing, 21(1), 99--110.Google Scholar
- Okuma, K., Taleghani, A., De Freitas, N., Little, J. J., & Lowe, D. G. (2004). A boosted particle filter: Multitarget detection and tracking. In Computer Vision-ECCV 2004 (pp. 28--39). Springer Berlin Heidelberg.Google Scholar
- Medeiros, H., Park, J., & Kak, A. C. (2008). Distributed object tracking using a cluster-based kalman filter in wireless camera networks. Selected Topics in Signal Processing, IEEE Journal of, 2(4), 448--463.Google Scholar
- Kim, M., Kumar, S., Pavlovic, V., & Rowley, H. (2008, June). Face tracking and recognition with visual constraints in real-world videos. In Computer Vision and Pattern Recognition, 2008. CVPR 2008. IEEE Conference on (pp. 1--8). IEEE.Google Scholar
- Kalal, Z., Mikolajczyk, K., & Matas, J. (2010, September). Face-tld: Tracking-learning-detection applied to faces. In Image Processing (ICIP), 2010 17th IEEE International Conference on (pp. 3789--3792). IEEE.Google Scholar
- Kim, Z., & Malik, J. (2003, October). Fast vehicle detection with probabilistic feature grouping and its application to vehicle tracking. In Computer Vision, 2003. Proceedings. Ninth IEEE International Conference on (pp. 524--531). IEEE. Google ScholarDigital Library
- Shu, G., Dehghan, A., Oreifej, O., Hand, E., & Shah, M. (2012, June). Part-based multiple-person tracking with partial occlusion handling. In Computer Vision and Pattern Recognition (CVPR), 2012 IEEE Conference on (pp. 1815--1821). IEEE. Google ScholarDigital Library
Index Terms
(auto-classified)Silhouette labeling and tracking in calibrated omnidirectional video sequences
Recommendations
Easy Calibration of a Blind-Spot-Free Fisheye Camera System Using a Scene of a Parking Space
Mounting three fisheye cameras, on the sides and rear of a vehicle, can help a driver maneuver his/her vehicle in restricted environments by providing a top view that is generated from these three fisheye cameras. To generate the top view, the pose of ...
Silhouette lookup for monocular 3D pose tracking
Computers should be able to detect and track the articulated 3D pose of a human being moving through a video sequence. Incremental tracking methods often prove slow and unreliable, and many must be initialized by a human operator before they can track a ...
People tracking across two distant self-calibrated cameras
AVSS '07: Proceedings of the 2007 IEEE Conference on Advanced Video and Signal Based SurveillancePeople tracking is of fundamental importance in multicamera surveillance systems. In recent years, many approaches for multi-camera tracking have been discussed. Most methods use either various image features or the geometric relation between the ...
Comments