Abstract
Over the last decade, there has been an increasing emphasis on driver-assistance systems for the automotive domain. In this article, we report our work on designing a camera-based surveillance system embedded in a “smart” car door. Such a camera is used to monitor the ambient environment outside the car, for instance, the presence of obstacles such as approaching cars or cyclists who might collide with the car door if opened—and automatically control the car door operations. This is an enhancement to the currently available side-view mirrors that the driver/passenger checks before opening the car door. The focus of this article is on fast and robust image processing algorithms specifically targeting such a smart car door system. The requirement is to quickly detect traffic objects of interest from grayscale images captured by omnidirectional cameras. While known algorithms for object extraction from the image processing literature rely on color information and are sensitive to shadows and illumination changes, our proposed algorithms are highly robust, can operate on grayscale images (color images are not available in our setup), and output results in real time. We present a number of experimental results based on image sequences captured from real-life traffic scenarios to demonstrate the applicability of our algorithm.
- Achler, O. and Trivedi, M.-M. 2002. Real-time traffic flow analysis using omnidirectional video network and flatplane transformation. In Proceedings of the Conference on Intelligent Transportation Systems (ITS).Google Scholar
- Ardoe, H. and Berthilsson, R. 2006. Adaptive background estimation using intensity independent features. In Proceedings of the 17th British Machine Vision Conference (BMVC).Google Scholar
- Baker, S. and Nayar, S. K. 1999. A theory of single-viewpoint catadioptric image formation. Int. J. Computer Vision 35, 2, 175--196. Google Scholar
Digital Library
- Baker, S. and Nayar, S. K. 2001. Panoramic Vision. Springer-Verlag Berlin, 39--71.Google Scholar
- Bayer, B. E. 1976. Color imaging array. US Patent 3971065.Google Scholar
- Bhaskar, H., Mihaylova, L., and Maskell, S. 2007. Background modeling using adaptive cluster density estimation for automatic human detection. In Lecture Notes in Informatics 2, 130--134.Google Scholar
- Brunelli, R. 2009. Template Matching Techniques in Computer Vision: Theory and Practice. Wiley. Google Scholar
Digital Library
- Dinkar, B. and Nayar, S. 1996. Ordinal measures for visual correspondence. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR). Google Scholar
Digital Library
- Elgammal, A., Duraiswami, R., Harwood, D., and Davis, L. 2002. Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proc. IEEE 90, 7, 1151--1163.Google Scholar
Cross Ref
- Farin, D., de With, P., and Effelsberg, W. 2003. Robust background estimation for complex video sequences. In Proceedings of the Conference on Image Processing (ICIP).Google Scholar
- Friedman, N. and Russel, S. 1997. Image segmentation in video sequences: A probalistic approach. In Proceedings of the Conference on Uncertainity in Artificial Intelligence (UAI). Google Scholar
Digital Library
- Ghandi, T. and Trivedi, M. 2004. Motion based vehicle surround analysis using an omni-directional camera. In Proceedings of the IEEE Intelligent Vehicle Symposium (IV). 560--565.Google Scholar
- Haritaoglu, I., Harwood, D., and Davis, L. 1998. W4: Who? when? where? what? a real-time system for detecting and tracking people. In Proceedings of the Conference on Automatic Face and Gesture Recognition (FG). Google Scholar
Digital Library
- Jacques, J., Jung, C., and Musse, S. 2005. Background subtraction and shadow detection in grayscale video sequences. In Proceedings of the 18th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI). Google Scholar
Digital Library
- Karman, K.-P. and Brandt, A. v. 1990. Time-Varying Image Processing and Moving Object Recognition 2nd Ed. Elsevier Publishers B.V., 297--308.Google Scholar
- Massey, M. and Bender, W. 1996. Salients stills: Process and practice. IBM Sys. J. 35, 3.4, 557--573. Google Scholar
Digital Library
- Okutomi, M. and Kanade, T. 1993. A multiple-baseline stereo. Trans. Pattern Analy. Mach. Intell. 15, 4, 353--363. Google Scholar
Digital Library
- Rabiner, R. L. 1989. A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77, 2, 257--286.Google Scholar
Cross Ref
- Ridder, C., Munkelt, O., and Kirchner, H. 1995. Adaptive background estimation and foreground detection using kalman-filtering. In Proceedings of the International Conference on Recent Advances in Mechatronics (ICRAM).Google Scholar
- Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006a. A flexible technique for accurate omnidirectional omnidirectional camera calibration and structure from motion. In Proceedings of the IEEE Conference on Computer Vision Systems (ICVS). Google Scholar
Digital Library
- Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006b. A toolbox for easily calibration omnidirectional cameras. In Proceedings of the IEEE International Conference on Intelligent Systems (IROS).Google Scholar
- Scharfenberger, C., Boehm, F., and Faerber, G. 2009. Image rectification: Evaluation of various projections for omnidirectional vision sensors using the pixel density. In Proceedings of the Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP).Google Scholar
- Stenger, D., Ramesh, V., Paragios, N., Coetzec, F., and Buhmann, J. 2001. Topology free hidden markov models: application to background modeling. In Proceedings of the International Conference on Computer Vision (ICCV).Google Scholar
- Strolz, M., Mühlbauer, Q., Scharfenberger, C., Färber, G., and Buss, M. 2008. Towards a generic control system for actuated car doors with arbitrary degrees of freedom. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV).Google Scholar
- Suhr, J., Jung, H., Bae, K., and Kim, J. 2010. Vorrichtung und Verfahren zum monokularen Motion-Stereo-basierten Detektieren von freien Parkplätzen. German Patent DE102009012435A1.Google Scholar
- Zabih, R. and Woodfill, J. 1994. Non-parametric local trans-forms for computing visual correspondence. In Proceedings of the European Conference on Computer Vision (ECCV). Google Scholar
Digital Library
- Zhong, J. and Sclaroff, S. 2003. Segmenting foreground objects from a dynamic textured background via a robust kalman filter. In Proceedings of the International Conference on Computer Vision (ICCV). Google Scholar
Digital Library
- Zivkovic, Z. and Heijden, F. 2006. Efficient adaptive density estimation per image pixel for task of background subtraction. Pattern Reco. Lett. 27, 773--780. Google Scholar
Digital Library
Index Terms
Robust image processing for an omnidirectional camera-based smart car door
Recommendations
Omnidirectional Image Stabilization by Computing Camera Trajectory
PSIVT '09: Proceedings of the 3rd Pacific Rim Symposium on Advances in Image and Video TechnologyIn this paper we present a pipeline for camera pose and trajectory estimation, and image stabilization and rectification for dense as well as wide baseline omnidirectional images. The input is a set of images taken by a single hand-held camera. The ...
A unified rectification method for single viewpoint multi-camera system
AVSS '11: Proceedings of the 2011 8th IEEE International Conference on Advanced Video and Signal Based SurveillanceStereo matching and 3D reconstruction has been studied for decades as a fundamental problem in the field of computer vision. Recent years, stereo matching and 3D reconstruction with a large field of view, especially using omnidirectional vision and ...
Calibration and Correction for Omnidirectional Image with a Fisheye Lens
ICNC '08: Proceedings of the 2008 Fourth International Conference on Natural Computation - Volume 06Omnidirectional vision (omni-vision) with a fisheye lens holds promise of various applications such as global surveillance, robotic navigation and so on. The calibration for the vision system and correction for the distorted image are critical ...






Comments