skip to main content
research-article

Fusing multiple video sensors for surveillance

Published:03 February 2012Publication History
Skip Abstract Section

Abstract

Real-time detection, tracking, recognition, and activity understanding of moving objects from multiple sensors represent fundamental issues to be solved in order to develop surveillance systems that are able to autonomously monitor wide and complex environments. The algorithms that are needed span therefore from image processing to event detection and behaviour understanding, and each of them requires dedicated study and research. In this context, sensor fusion plays a pivotal role in managing the information and improving system performance. Here we present a novel fusion framework for combining the data coming from multiple and possibly heterogeneous sensors observing a surveillance area.

References

  1. Aghajan, H. and Cavallaro, A., Eds. 2009. Multi-Camera Networks. Elsevier.Google ScholarGoogle Scholar
  2. Avidan, S. 2004. Support vector tracking. IEEE Trans. Patt. Anal. Mach. Intell. 26, 8, 1064--1072. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Avidan, S. 2007. Ensemble tracking. IEEE Trans. Pattern Anal. Mach. Intell. 29, 2, 261--271. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Baker, K., Harris, P., and O'Brien, J. 1989. Data fusion: An appraisal and experimental evaluation. J. Market Resear. Soc. 31, 2, 152--212.Google ScholarGoogle Scholar
  5. Blum, R. S. and Liu, Z., Eds. 2005. Multi-sensor image fusion and its applications. In Signal Processing and Communications. CRC Press.Google ScholarGoogle Scholar
  6. Chateau:, T., Gay-Belille, V., Chausse, F., and Laprest, J.-T. 2006. Real-time tracking with classifiers. In Proceedings of the European Conference on Computer Vision. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Collins, R. T., Lipton, A. J., Fujiyoshi, H., and Kanade, T. 2001. Algorithms for cooperative multisensor surveillance. Proc. IEEE 89, 10, 1456--1477.Google ScholarGoogle ScholarCross RefCross Ref
  8. Comanicic, D., Ramesh, V., and Meer, P. 2003. Kernel-based object tracking. IEEE Trans. Patt. Anal. Mach. Intell. 25, 5, 564--575. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Durrant-Whyte, H. F. 1988. Sensor models and multisensor integration. Int. J. Robot. Resear. 1, 6, 97--113. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Grabser, H. and Bischof, H. 2006. On-line boosting and vision. In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR). 260--267. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Grabser, H. Grabser, M., and Bischof, H. 2006. Real-time tracking via on-line boosting. In Proceedings of the British Machine Vision Conference (BMVC). 4756.Google ScholarGoogle Scholar
  12. Grabser, H., Sochman, J., Bischof, H., and Matas, J. 2008. Training sequential on-line boosting classifier for visual tracking. In Proceedings of the International Conference on Pattern Recognition.Google ScholarGoogle Scholar
  13. Grossmann, P. 1998. :Multisensor data fusion. GEC J. Techn. 15, 27--37.Google ScholarGoogle Scholar
  14. Hall, D. L. and Linn, R. J. 1993. Survey of commercial software for multisensor data fusion. In Proceedings of the Society of Photo-Optical Instrumentation Engineers (SPIE) Conference. J. K. Aggarwal and N. Nandhakumar, Ed., 98--109.Google ScholarGoogle Scholar
  15. Hall, D. L. and Llinas, J. 1997. An introduction to multisensor data fusion. Proc. IEEE 85, 1, 6--23.Google ScholarGoogle Scholar
  16. Hartley, R. and Zisserman, A. 2004. Multiple View Geometry in Computer Vision 2nd ed. Cambridge University Press, Cambridge, UK. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jain, A., Hong, L., and Kulkarny, Y. 1999. A multimodal biometric system using fingerprints, face and speech. In Proceedings of the 2nd International Conference on Audio- and Video-Based Biometric Person Authentication. 182--187.Google ScholarGoogle Scholar
  18. Jephcott, J. and Bock, T. 1998. The application and validation of data fusion. J. Market Resear. Soc. 40, 3, 185--205.Google ScholarGoogle Scholar
  19. Nguyen, H. T. and Smeulders, A. W. 2006. Robust tracking using foreground-background texture discrimination. Int. J. Comput. Vis. 69, 3, 277--293. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Oza, N. C. 2005. Online bagging and boosting. In Proceedings of the IEEE International Conference on Systems, Man and Cybernetics. 2340--2345.Google ScholarGoogle ScholarCross RefCross Ref
  21. Perez, P., Vermaak, J., and Blake, A. 2004. Data fusion for visual tracking with particles. Proc. IEEE 92, 3, 495--513.Google ScholarGoogle ScholarCross RefCross Ref
  22. Petrović, N., Jovanov, L., Pižurica, A., and Philips, W. 2008. Object tracking using naive bayesian classifiers. In Proceedings of the 10th International Conference on Advanced Concepts for Intelligent Vision Systems (ACIVS '08). 775--784. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Ross, A. and Jain, A. 2004. Multimodal biometrics: An overview. In Proceedings of the 12th European Signal Processing Conference. 1221--1224.Google ScholarGoogle Scholar
  24. Snidaro, L., Niu, R., Foresti, G., and Varshney, P. 2007. Quality-based fusion of multiple video sensors for video surveillance. IEEE Trans. Syst., Man, Cybern. B 31, 4, 1044--1051. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Snidaro, L. and Visentini, L. 2008. Fusion of heterogeneous features via cascaded on-line boosting. InProceedings of the 11th International Conference on Information Fusion. 1340--1345.Google ScholarGoogle Scholar
  26. Snidaro, L., Visentini, L., and Foresti, G. 2009a. Intelligent Video Surveillance: Systems and Technology. CRC Press, 363--388.Google ScholarGoogle Scholar
  27. Snidaro, L., Visentini, L., and Foresti, G. L. 2009b. Multi-sensor multi-cue fusion for object detection in video surveillance. In Proceedings of the International Conference on Advanced Video and Signal-Based Surveillance. 364--369. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Tomasi, C., Petrov, S., and Sastry, A. 2003. 3d tracking = classification + interpolation. In Proceedings of the 9th IEEE International Conference on Computer Vision (ICCV '03). 1441. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Yilmaz, A., Javed, O., and Shah, M. 2006. Object tracking: A survey. ACM Comput. Surv. 38, 4, 13. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Yin, Z., Porikli, F., and Collins, R. 2008. Likelihood map fusion for visual object tracking. In Proceedings of the IEEE Workshop on Applications of Computer Vision. 1--7. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Fusing multiple video sensors for surveillance

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Multimedia Computing, Communications, and Applications
          ACM Transactions on Multimedia Computing, Communications, and Applications  Volume 8, Issue 1
          January 2012
          149 pages
          ISSN:1551-6857
          EISSN:1551-6865
          DOI:10.1145/2071396
          Issue’s Table of Contents

          Copyright © 2012 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 3 February 2012
          • Accepted: 1 October 2010
          • Revised: 1 July 2010
          • Received: 1 January 2010
          Published in tomm Volume 8, Issue 1

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!