Abstract
In this article, we describe a distributed, peer-to-peer gesture recognition system along with a software architecture modeling technique and authority control protocol for ubiquitous cameras. This system performs gesture recognition in real time by combining imagery from multiple cameras without using a central server. We propose a system architecture that uses a network of inexpensive cameras to perform in-network video processing. A methodology for transforming well-designed single-node algorithm to distributed system is also proposed. Applications for ubiquitous cameras can be modeled as the composition of a finite-state machine of the system, functional services, and middleware. A service-oriented software architecture is proposed to dynamically reconfigure services when system state changes. By exchanging data and control messages between neighboring sensors, each node can maintain broader view of the environment with integrated video-processing results. Our prototype system is built on Windows machines, and uses standard video cameras as sensors and local network as a communication channel.
- Ballard, D. H. and Brown, C. M. 1982. Computer Vision. Prentice-Hall, Englewood Cliffs, NJ. Google Scholar
Digital Library
- Bove, V. M. and Mallet, J. 2004. Collaborative knowledge building by smart sensors. BT Tech. J. 22, 4. Google Scholar
Digital Library
- Bramberger, M., Doblander, A., Maier, A., Rinner, B., and Schwabach, H. 2006. Distributed embedded smart cameras for surveillance applications. IEEE Comput. Mag. 39, 2, 68--75. Google Scholar
Digital Library
- Bramberger, M., Quaritsch, M., Winkler, T., Rinner, B., and Schwabach, H. 2005. Integrating multi-camera tracking into a dynamic task allocation system for smart cameras. In Proceedings of the International Conference on Advanced Video and Signal-Based Surveillance. IEEE, Los Alamitos, CA.Google Scholar
- Caelli, T. and Bischof, W. F. 1997. Machine Learning and Image Interpretation. Plenum Press, New York. Google Scholar
Digital Library
- Cai, Q. and Aggarwal, J. K. 1998. Automatic tracking of human motion in indoor scenes across multiple synchronized video streams. In Proceedings of the International Conference on Computer Vision. IEEE, Los Alamitos, CA, 356--362. Google Scholar
Digital Library
- Cheong, E., Liebman, J., Liu, J., and Zhao, F. 2003. Tingals: A programming model for event driven embedded systems. In Proceedings of the ACM Symposium on Applied Computing. ACM, New York. Google Scholar
Digital Library
- Collins, R. T., Lipton, A., and Kanade, T. 1999. A system for video surveillance and monitoring. In Proceedings of the International Topical Meeting of Robotics and Remote Systems. American Nuclear Society, La Grange Park, IL.Google Scholar
- Collins, R. T., Lipton, A. J., Fujiyoshi, H., and Kanade, T. 2001. Algorithms for cooperative multi-sensor surveillance. Proceedings of the IEEE 89, 10, 1456--1477.Google Scholar
Cross Ref
- Davis, L. S., Borovikov, E., Cutler, R., and Horprasert, T. 1999. Multi-perspective analysis of human action. In Proceedings of the International Workshop on Cooperative Distributed Vision.Google Scholar
- de Niz, D. and Rajkumar, R. 2003. Time weaver: A software-through-models framework for real-time systems. In Proceedings of the Languages, Compilers and Tools for Embedded Systems. ACM, New York. Google Scholar
Digital Library
- Fleck, S. and Strasser, W. 2005. Adaptive probabilistic tracking embedded in a smart camera. In Proceedings of the Conference Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA, 134--141. Google Scholar
Digital Library
- Grieffenhagen, M., Comaniciu, D., Neimann, H., and Ramesh, V. 2001. Design, analysis, and engineering of video monitoring systems: an approach and a case study. In Proceedings of the IEEE, 10, 1498--1517.Google Scholar
Cross Ref
- Guibas, L. J. 2002. Sensing, tracking, and reasoning with relations. IEEE Signal Process. Mag. 19, 2, 73--85.Google Scholar
Cross Ref
- Hatcliff, J., Deng, X., Dwyer, M. B., Jung, G., and Ranganath, V. P. 2003. Cadena: An integrated development, analysis, and verification environment for component-based systems. In Proceedings of the International Conference Software Engineering. IEEE, Los Alamitos, CA. Google Scholar
Digital Library
- Hengstler, S. and Aghajan, H. 2007. Application-oriented design of smart camera networks. In Proceedings of the International Conference Distributed Smart Cameras. ACM, New York, 12--19.Google Scholar
- Holzmann, G. J. 2004. The Spin Model Checker - Primer and Reference Manual. Addison Wesley, Boston, MA. Google Scholar
Digital Library
- Holzmann, G. J. and Joshi, R. 2004. Model-driven software verification. In Proceedings of the 11th Spin Workshop on Model Checking Software. Springer, Berlin, 77--92.Google Scholar
- Karsai, G., Sztipanovits, J., Ledeczi, A., and Bapty, T. 2003. Model-integrated development of embedded software. Proceedings of the IEEE 91, 1, 145--164.Google Scholar
Cross Ref
- Kushwaha, M., Amundson, I., Lin, C. H., Koutsoukos, X., Neema, S., Sztipanovits, J., and Wolf, W. 2006. An object-centric programming framework for ambient-aware, service-oriented sensor networks. In Proceedings of the Information Processing in Sensor Networks. ACM, New York.Google Scholar
- Lin, C. H., Lv, T., Ozer, I. B., and Wolf, W. 2004. A peer-to-peer architecture for distributed real-time gesture recognition. In Proceedings of the International Conference Multi-Media and Exhibition. IEEE, Los Alamitos, CA.Google Scholar
- Lin, C. H. and Wolf, W. 2005. A case study in clock synchronization for distributed camera systems. Proceedings of SPIE 5683. SPIE, Bellingham, WA.Google Scholar
- Lin, C. H., Wolf, W., Dixon, A., Koutsoukos, X., and Sztipanovits, J. 2006. Design and implementation of ubiquitous smart cameras. In Proceedings of the International Conference Sensor Networks, Ubiquitous, and Trustworthy Computing. IEEE, Los Alamitos, CA. Google Scholar
Digital Library
- Matsuyama, T. and Ukita, N. 2002. Real-time multi-target tracking by a cooperative distributed vision system. Proceedings of the IEEE 90, 7, 1136--1150. Google Scholar
Digital Library
- Mittal, A. and Davis, L. 2001. Unified multi-camera detection and tracking using region matching. In Proceedings of the Workshop on Multi-Object Tracking. IEEE, Los Alamitos, CA, 3--10. Google Scholar
Digital Library
- Ozer, I. B., Lv, T., and Wolf, W. 2005. Design of a real-time gesture recognition system. IEEE Signal Process. Mag. 22, 3, 57--64.Google Scholar
Cross Ref
- Ozer, I. B. and Wolf, W. 2001. Video analysis for smart rooms. In Proceedings of the Internet Multimedia Management Systems II. SPIE.Google Scholar
- Ozer, I. B.,Wolf, W., and Akansu, A. N. 2000. Relational graph matching for human detection and posture recognition. In Proceedings of the Internet Multimedia Management Systems. SPIE, Boston, MA.Google Scholar
Cross Ref
- Pentland, A. 2000. Looking at people: Sensing for ubiquitous and wearable computing. IEEE Trans. Pattern Anal. Mach. Intell. 22, 1. Google Scholar
Digital Library
- Rinner, B., Jovanovic, M., and Quaritsch, M. 2007. Embedded middleware on distributed smart cameras. In Proceedings of the International Conference Acoustics, Speech, and Signal Processing. IEEE, Los Alamitos, CA, 15--20.Google Scholar
- Stankovic, J. A., Zhu, R., Poornalinghm, R., Lu, C., Yu, Z., Humphrey, M., and Ellis, B. 2003. Vest: An aspect-based composition tool for real-time systems. In Proceedings of the IEEE Real-time Applications Symposium. IEEE, Los Alamitos, CA. Google Scholar
Digital Library
- Svoboda, T., Martinec, D., and Pajdla, T. 2005. A convenient multi-camera self-calibration for virtual environments. Teleoperators Virtual Environ. 14. Google Scholar
Digital Library
- Sztipanovits, J. and Karsai, G. 1997. Model-integrated computing. IEEE Comput. Mag. 30, 4, 110--112. Google Scholar
Digital Library
- Velipasalar, S., Lin, C. H., Schlessman, J., and Wolf, W. 2006. Design and verification of communication protocols for peer-to-peer multimedia systems. In Proceedings of the International Conference Multimedia and Exhibition. IEEE, Los Alamitos, CA.Google Scholar
- Velipasalar, S., Schlessman, J., Chen, C.-Y., Wolf, W., and Singh, J. P. 2006. Sccs: A scalable clustered camera system for multiple object tracking communicating via message passing interface. In Proceedings of the International Conference Multi-Media and Exhibition. IEEE, Los Alamitos, CA.Google Scholar
- Velipasalar, S. and Wolf, W. 2004. Recovering field of view lines by using projective invariants. In Proceedings of the International Conference Image Processing. IEEE, Los Alamitos, CA.Google Scholar
- Watlington, J. and Bove, V. M. 1997. A system for parallel media processing. Parallel Comput. 23, 12. Google Scholar
Digital Library
- Wilburn, B., Joshi, N., Vaish, V., Levoy, M., and Horowitz, M. 2004. High speed video using a dense camera array. In Proceedings of the Conference Computer Vision and Pattern Recognition. IEEE, Los Alamitos, CA. Google Scholar
Digital Library
- Wolf, W., Ozer, I. B., and Lv, T. 2002. Smart cameras as embedded systems. IEEE Comput. Mag. 35, 9, 48--53. Google Scholar
Digital Library
- Wren, C. R., Azarbayejani, A., Darrell, T., and Pentland, A. P. 1997. Pfinder: Real-time tracking of the human body. IEEE Trans. Pattern Anal. Mach. Intell. 19, 7. Google Scholar
Digital Library
Index Terms
System and software architectures of distributed smart cameras
Recommendations
A Real Time 3D Sensor for Smart Cameras
ICDSC '14: Proceedings of the International Conference on Distributed Smart CamerasThank to the widespread diffusion of RGBD sensing devices based on active technologies, in recent years, many research and industrial applications have taken advantage of reliable cues computed from dense depth data. However, although these sensors can ...
Cooperative Object Tracking and Event Detection with Wireless Smart Cameras
AVSS '09: Proceedings of the 2009 Sixth IEEE International Conference on Advanced Video and Signal Based SurveillanceWireless embedded smart cameras not only capture images, but also can perform processing and communication. However,many system- and algorithm-wise challenges remain to be addressed to have operational, battery-powered wireless smart-camera networks, ...
Cooperative object tracking and composite event detection with wireless embedded smart cameras
Special section on distributed camera networks: sensing, processing, communication, and implementationEmbedded smart cameras have limited processing power, memory, energy, and bandwidth. Thus, many system-and algorithm-wise challenges remain to be addressed to have operational, battery-powered wireless smart-camera networks. We present a wireless ...






Comments