skip to main content
research-article

Robust image processing for an omnidirectional camera-based smart car door

Published:01 January 2013Publication History
Skip Abstract Section

Abstract

Over the last decade, there has been an increasing emphasis on driver-assistance systems for the automotive domain. In this article, we report our work on designing a camera-based surveillance system embedded in a “smart” car door. Such a camera is used to monitor the ambient environment outside the car, for instance, the presence of obstacles such as approaching cars or cyclists who might collide with the car door if opened—and automatically control the car door operations. This is an enhancement to the currently available side-view mirrors that the driver/passenger checks before opening the car door. The focus of this article is on fast and robust image processing algorithms specifically targeting such a smart car door system. The requirement is to quickly detect traffic objects of interest from grayscale images captured by omnidirectional cameras. While known algorithms for object extraction from the image processing literature rely on color information and are sensitive to shadows and illumination changes, our proposed algorithms are highly robust, can operate on grayscale images (color images are not available in our setup), and output results in real time. We present a number of experimental results based on image sequences captured from real-life traffic scenarios to demonstrate the applicability of our algorithm.

References

  1. Achler, O. and Trivedi, M.-M. 2002. Real-time traffic flow analysis using omnidirectional video network and flatplane transformation. In Proceedings of the Conference on Intelligent Transportation Systems (ITS).Google ScholarGoogle Scholar
  2. Ardoe, H. and Berthilsson, R. 2006. Adaptive background estimation using intensity independent features. In Proceedings of the 17th British Machine Vision Conference (BMVC).Google ScholarGoogle Scholar
  3. Baker, S. and Nayar, S. K. 1999. A theory of single-viewpoint catadioptric image formation. Int. J. Computer Vision 35, 2, 175--196. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Baker, S. and Nayar, S. K. 2001. Panoramic Vision. Springer-Verlag Berlin, 39--71.Google ScholarGoogle Scholar
  5. Bayer, B. E. 1976. Color imaging array. US Patent 3971065.Google ScholarGoogle Scholar
  6. Bhaskar, H., Mihaylova, L., and Maskell, S. 2007. Background modeling using adaptive cluster density estimation for automatic human detection. In Lecture Notes in Informatics 2, 130--134.Google ScholarGoogle Scholar
  7. Brunelli, R. 2009. Template Matching Techniques in Computer Vision: Theory and Practice. Wiley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Dinkar, B. and Nayar, S. 1996. Ordinal measures for visual correspondence. In Proceedings of the Conference on Computer Vision and Pattern Recognition (CVPR). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Elgammal, A., Duraiswami, R., Harwood, D., and Davis, L. 2002. Background and foreground modeling using nonparametric kernel density estimation for visual surveillance. Proc. IEEE 90, 7, 1151--1163.Google ScholarGoogle ScholarCross RefCross Ref
  10. Farin, D., de With, P., and Effelsberg, W. 2003. Robust background estimation for complex video sequences. In Proceedings of the Conference on Image Processing (ICIP).Google ScholarGoogle Scholar
  11. Friedman, N. and Russel, S. 1997. Image segmentation in video sequences: A probalistic approach. In Proceedings of the Conference on Uncertainity in Artificial Intelligence (UAI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Ghandi, T. and Trivedi, M. 2004. Motion based vehicle surround analysis using an omni-directional camera. In Proceedings of the IEEE Intelligent Vehicle Symposium (IV). 560--565.Google ScholarGoogle Scholar
  13. Haritaoglu, I., Harwood, D., and Davis, L. 1998. W4: Who? when? where? what? a real-time system for detecting and tracking people. In Proceedings of the Conference on Automatic Face and Gesture Recognition (FG). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Jacques, J., Jung, C., and Musse, S. 2005. Background subtraction and shadow detection in grayscale video sequences. In Proceedings of the 18th Brazilian Symposium on Computer Graphics and Image Processing (SIBGRAPI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Karman, K.-P. and Brandt, A. v. 1990. Time-Varying Image Processing and Moving Object Recognition 2nd Ed. Elsevier Publishers B.V., 297--308.Google ScholarGoogle Scholar
  16. Massey, M. and Bender, W. 1996. Salients stills: Process and practice. IBM Sys. J. 35, 3.4, 557--573. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Okutomi, M. and Kanade, T. 1993. A multiple-baseline stereo. Trans. Pattern Analy. Mach. Intell. 15, 4, 353--363. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Rabiner, R. L. 1989. A tutorial on hidden markov models and selected applications in speech recognition. Proc. IEEE 77, 2, 257--286.Google ScholarGoogle ScholarCross RefCross Ref
  19. Ridder, C., Munkelt, O., and Kirchner, H. 1995. Adaptive background estimation and foreground detection using kalman-filtering. In Proceedings of the International Conference on Recent Advances in Mechatronics (ICRAM).Google ScholarGoogle Scholar
  20. Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006a. A flexible technique for accurate omnidirectional omnidirectional camera calibration and structure from motion. In Proceedings of the IEEE Conference on Computer Vision Systems (ICVS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Scaramuzza, D., Martinelli, A., and Siegwart, R. 2006b. A toolbox for easily calibration omnidirectional cameras. In Proceedings of the IEEE International Conference on Intelligent Systems (IROS).Google ScholarGoogle Scholar
  22. Scharfenberger, C., Boehm, F., and Faerber, G. 2009. Image rectification: Evaluation of various projections for omnidirectional vision sensors using the pixel density. In Proceedings of the Joint Conference on Computer Vision, Imaging and Computer Graphics Theory and Applications (VISAPP).Google ScholarGoogle Scholar
  23. Stenger, D., Ramesh, V., Paragios, N., Coetzec, F., and Buhmann, J. 2001. Topology free hidden markov models: application to background modeling. In Proceedings of the International Conference on Computer Vision (ICCV).Google ScholarGoogle Scholar
  24. Strolz, M., Mühlbauer, Q., Scharfenberger, C., Färber, G., and Buss, M. 2008. Towards a generic control system for actuated car doors with arbitrary degrees of freedom. In Proceedings of the IEEE Intelligent Vehicles Symposium (IV).Google ScholarGoogle Scholar
  25. Suhr, J., Jung, H., Bae, K., and Kim, J. 2010. Vorrichtung und Verfahren zum monokularen Motion-Stereo-basierten Detektieren von freien Parkplätzen. German Patent DE102009012435A1.Google ScholarGoogle Scholar
  26. Zabih, R. and Woodfill, J. 1994. Non-parametric local trans-forms for computing visual correspondence. In Proceedings of the European Conference on Computer Vision (ECCV). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Zhong, J. and Sclaroff, S. 2003. Segmenting foreground objects from a dynamic textured background via a robust kalman filter. In Proceedings of the International Conference on Computer Vision (ICCV). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Zivkovic, Z. and Heijden, F. 2006. Efficient adaptive density estimation per image pixel for task of background subtraction. Pattern Reco. Lett. 27, 773--780. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Robust image processing for an omnidirectional camera-based smart car door

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!