skip to main content
research-article

System and software architectures of distributed smart cameras

Published:06 April 2010Publication History
Skip Abstract Section

Abstract

In this article, we describe a distributed, peer-to-peer gesture recognition system along with a software architecture modeling technique and authority control protocol for ubiquitous cameras. This system performs gesture recognition in real time by combining imagery from multiple cameras without using a central server. We propose a system architecture that uses a network of inexpensive cameras to perform in-network video processing. A methodology for transforming well-designed single-node algorithm to distributed system is also proposed. Applications for ubiquitous cameras can be modeled as the composition of a finite-state machine of the system, functional services, and middleware. A service-oriented software architecture is proposed to dynamically reconfigure services when system state changes. By exchanging data and control messages between neighboring sensors, each node can maintain broader view of the environment with integrated video-processing results. Our prototype system is built on Windows machines, and uses standard video cameras as sensors and local network as a communication channel.

References

  1. Ballard, D. H. and Brown, C. M. 1982. Computer Vision. Prentice-Hall, Englewood Cliffs, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Bove, V. M. and Mallet, J. 2004. Collaborative knowledge building by smart sensors. BT Tech. J. 22, 4. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bramberger, M., Doblander, A., Maier, A., Rinner, B., and Schwabach, H. 2006. Distributed embedded smart cameras for surveillance applications. IEEE Comput. Mag. 39, 2, 68--75. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Bramberger, M., Quaritsch, M., Winkler, T., Rinner, B., and Schwabach, H. 2005. Integrating multi-camera tracking into a dynamic task allocation system for smart cameras. In Proceedings of the International Conference on Advanced Video and Signal-Based Surveillance. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar
  5. Caelli, T. and Bischof, W. F. 1997. Machine Learning and Image Interpretation. Plenum Press, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Cai, Q. and Aggarwal, J. K. 1998. Automatic tracking of human motion in indoor scenes across multiple synchronized video streams. In Proceedings of the International Conference on Computer Vision. IEEE, Los Alamitos, CA, 356--362. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Cheong, E., Liebman, J., Liu, J., and Zhao, F. 2003. Tingals: A programming model for event driven embedded systems. In Proceedings of the ACM Symposium on Applied Computing. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Collins, R. T., Lipton, A., and Kanade, T. 1999. A system for video surveillance and monitoring. In Proceedings of the International Topical Meeting of Robotics and Remote Systems. American Nuclear Society, La Grange Park, IL.Google ScholarGoogle Scholar
  9. Collins, R. T., Lipton, A. J., Fujiyoshi, H., and Kanade, T. 2001. Algorithms for cooperative multi-sensor surveillance. Proceedings of the IEEE 89, 10, 1456--1477.Google ScholarGoogle ScholarCross RefCross Ref
  10. Davis, L. S., Borovikov, E., Cutler, R., and Horprasert, T. 1999. Multi-perspective analysis of human action. In Proceedings of the International Workshop on Cooperative Distributed Vision.Google ScholarGoogle Scholar
  11. de Niz, D. and Rajkumar, R. 2003. Time weaver: A software-through-models framework for real-time systems. In Proceedings of the Languages, Compilers and Tools for Embedded Systems. ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Fleck, S. and Strasser, W. 2005. Adaptive probabilistic tracking embedded in a smart camera. In Proceedings of the Conference Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA, 134--141. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Grieffenhagen, M., Comaniciu, D., Neimann, H., and Ramesh, V. 2001. Design, analysis, and engineering of video monitoring systems: an approach and a case study. In Proceedings of the IEEE, 10, 1498--1517.Google ScholarGoogle ScholarCross RefCross Ref
  14. Guibas, L. J. 2002. Sensing, tracking, and reasoning with relations. IEEE Signal Process. Mag. 19, 2, 73--85.Google ScholarGoogle ScholarCross RefCross Ref
  15. Hatcliff, J., Deng, X., Dwyer, M. B., Jung, G., and Ranganath, V. P. 2003. Cadena: An integrated development, analysis, and verification environment for component-based systems. In Proceedings of the International Conference Software Engineering. IEEE, Los Alamitos, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Hengstler, S. and Aghajan, H. 2007. Application-oriented design of smart camera networks. In Proceedings of the International Conference Distributed Smart Cameras. ACM, New York, 12--19.Google ScholarGoogle Scholar
  17. Holzmann, G. J. 2004. The Spin Model Checker - Primer and Reference Manual. Addison Wesley, Boston, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Holzmann, G. J. and Joshi, R. 2004. Model-driven software verification. In Proceedings of the 11th Spin Workshop on Model Checking Software. Springer, Berlin, 77--92.Google ScholarGoogle Scholar
  19. Karsai, G., Sztipanovits, J., Ledeczi, A., and Bapty, T. 2003. Model-integrated development of embedded software. Proceedings of the IEEE 91, 1, 145--164.Google ScholarGoogle ScholarCross RefCross Ref
  20. Kushwaha, M., Amundson, I., Lin, C. H., Koutsoukos, X., Neema, S., Sztipanovits, J., and Wolf, W. 2006. An object-centric programming framework for ambient-aware, service-oriented sensor networks. In Proceedings of the Information Processing in Sensor Networks. ACM, New York.Google ScholarGoogle Scholar
  21. Lin, C. H., Lv, T., Ozer, I. B., and Wolf, W. 2004. A peer-to-peer architecture for distributed real-time gesture recognition. In Proceedings of the International Conference Multi-Media and Exhibition. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar
  22. Lin, C. H. and Wolf, W. 2005. A case study in clock synchronization for distributed camera systems. Proceedings of SPIE 5683. SPIE, Bellingham, WA.Google ScholarGoogle Scholar
  23. Lin, C. H., Wolf, W., Dixon, A., Koutsoukos, X., and Sztipanovits, J. 2006. Design and implementation of ubiquitous smart cameras. In Proceedings of the International Conference Sensor Networks, Ubiquitous, and Trustworthy Computing. IEEE, Los Alamitos, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Matsuyama, T. and Ukita, N. 2002. Real-time multi-target tracking by a cooperative distributed vision system. Proceedings of the IEEE 90, 7, 1136--1150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Mittal, A. and Davis, L. 2001. Unified multi-camera detection and tracking using region matching. In Proceedings of the Workshop on Multi-Object Tracking. IEEE, Los Alamitos, CA, 3--10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Ozer, I. B., Lv, T., and Wolf, W. 2005. Design of a real-time gesture recognition system. IEEE Signal Process. Mag. 22, 3, 57--64.Google ScholarGoogle ScholarCross RefCross Ref
  27. Ozer, I. B. and Wolf, W. 2001. Video analysis for smart rooms. In Proceedings of the Internet Multimedia Management Systems II. SPIE.Google ScholarGoogle Scholar
  28. Ozer, I. B.,Wolf, W., and Akansu, A. N. 2000. Relational graph matching for human detection and posture recognition. In Proceedings of the Internet Multimedia Management Systems. SPIE, Boston, MA.Google ScholarGoogle ScholarCross RefCross Ref
  29. Pentland, A. 2000. Looking at people: Sensing for ubiquitous and wearable computing. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Rinner, B., Jovanovic, M., and Quaritsch, M. 2007. Embedded middleware on distributed smart cameras. In Proceedings of the International Conference Acoustics, Speech, and Signal Processing. IEEE, Los Alamitos, CA, 15--20.Google ScholarGoogle Scholar
  31. Stankovic, J. A., Zhu, R., Poornalinghm, R., Lu, C., Yu, Z., Humphrey, M., and Ellis, B. 2003. Vest: An aspect-based composition tool for real-time systems. In Proceedings of the IEEE Real-time Applications Symposium. IEEE, Los Alamitos, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Svoboda, T., Martinec, D., and Pajdla, T. 2005. A convenient multi-camera self-calibration for virtual environments. Teleoperators Virtual Environ. 14. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Sztipanovits, J. and Karsai, G. 1997. Model-integrated computing. IEEE Comput. Mag. 30, 4, 110--112. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Velipasalar, S., Lin, C. H., Schlessman, J., and Wolf, W. 2006. Design and verification of communication protocols for peer-to-peer multimedia systems. In Proceedings of the International Conference Multimedia and Exhibition. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar
  35. Velipasalar, S., Schlessman, J., Chen, C.-Y., Wolf, W., and Singh, J. P. 2006. Sccs: A scalable clustered camera system for multiple object tracking communicating via message passing interface. In Proceedings of the International Conference Multi-Media and Exhibition. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar
  36. Velipasalar, S. and Wolf, W. 2004. Recovering field of view lines by using projective invariants. In Proceedings of the International Conference Image Processing. IEEE, Los Alamitos, CA.Google ScholarGoogle Scholar
  37. Watlington, J. and Bove, V. M. 1997. A system for parallel media processing. Parallel Comput. 23, 12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Wilburn, B., Joshi, N., Vaish, V., Levoy, M., and Horowitz, M. 2004. High speed video using a dense camera array. In Proceedings of the Conference Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Wolf, W., Ozer, I. B., and Lv, T. 2002. Smart cameras as embedded systems. IEEE Comput. Mag. 35, 9, 48--53. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Wren, C. R., Azarbayejani, A., Darrell, T., and Pentland, A. P. 1997. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. System and software architectures of distributed smart cameras

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!