Abstract
Distributed smart cameras (DSC) are an emerging technology for a broad range of important applications including smart rooms, surveillance, entertainment, tracking, and motion analysis. By having access to many views and through cooperation among the individual cameras, these DSCs have the potential to realize many more complex and challenging applications than single-camera systems.
This article focuses on the system-level software required for efficient streaming applications on single smart cameras as well as on networks of DSCs. Embedded platforms with limited resources do not provide middleware services well known on general-purpose platforms. Our software framework supports transparent intra- and interprocessor communication while keeping the memory and computation overhead very low. The software framework is based on a publisher--subscriber architecture and provides mechanisms for dynamically loading and unloading software components as well as for graceful degradation in case of software- and hardware-related faults. The software framework has been completely implemented and tested on our embedded smart cameras consisting of an ARM-based network processor and several digital signal processors. Two case studies demonstrate the feasibility of our approach.
- Aghajan, H. and Kleihorst, R., Eds. 2007. Proceedings of the ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC'07). ACM, New York.Google Scholar
- Akyildiz, I. F., Su, W., Sankarasubramaniam, Y., and Cayirci, E. 2002. Wireless sensor networks: a survey. Comput. Netw. 38, 4, 393--422. Google Scholar
Digital Library
- Balasubramanian, K., Wang, N., Gill, C., and Schmidt, D. C. 2003. Towards composable distributed real-time and embedded software. In Proceedings of the 8th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems. IEEE, Los Almitos, CA, 226--233.Google Scholar
- Becker, C., Schiele, G., Gubbles, H., and Rothermel, K. 2003. BASE—a micro-brokerbased middleware for pervasive computing. In Proceedings of the 1st IEEE International Conference on Pervasive Computing and Communications. IEEE, Los Alamitos, CA, 443--451. Google Scholar
Digital Library
- Bramberger, M. 2005. Distributed dynamic task allocation in clusters of embedded smart cameras. Ph.D. thesis, Institute for Technical Informatics, Graz University of Technology, Graz, Austria.Google Scholar
- Bramberger, M., Brunner, J., Rinner, B., and Schwabach, H. 2004. Real-Time video analysis on an embedded smart camera for traffic surveillance. In Proceedings of the 10th IEEE Real-Time and Embedded Technology and Applications Symposium. IEEE, Los Alamitos, CA, 174--181. Google Scholar
Digital Library
- Bramberger, M., Doblander, A., Maier, A., Rinner, B., and Schwabach, H. 2006. Distributed smart cameras for surveillance applications. Computer 39, 2, 68--75. Google Scholar
Digital Library
- Bramberger, M., Rinner, B., and Schwabach, H. 2004. An embedded smart Camera on a scalable heterogeneous multi-DSP system. In Proceedings of the European DSP Education and Research Symposium.Google Scholar
- Bramberger, M., Rinner, B., and Schwabach, H. 2005. A method for dynamic allocation of tasks in clusters of embedded smart cameras. In Proceedings of the International Conference on Systems, Man and Cybernetics. IEEE, Los Alamitos, CA, 2595--2600.Google Scholar
- Clarke, M., Blair, G. S., Coulson, G., and Parlavantzas, N. 2001. An efficient component model for the construction of adaptive middleware. In Proceedings of the IFIP/ACM International Conference on Distributed Systems Platforms, R. Guerraoui, Ed. Lecture Notes in Computer Science. Vol. 2218. Springer, 160--178. Google Scholar
Digital Library
- DeMichiel, L. G. 1995. The component object model specification. Tech. rep., Microsoft Corporation.Google Scholar
- DeMichiel, L. G. 2002. Enterprise JavaBeans specification version 2.1. Tech. rep., SUN Microsystems.Google Scholar
- Doblander, A., Rinner, B., Trenkwalder, N., and Zoufal, A. 2006a. A light-weight publisher-subscriber middleware for dynamic reconfiguration in networks of embedded smart cameras. In Proceedings of the 5th World Scientific and Engineering Academy and Society International Conference on Software Engineering, Parallel and Distributed Systems. ACM, New York. Google Scholar
Digital Library
- Doblander, A., Rinner, B., Trenkwalder, N., and Zoufal, A. 2006b. A middleware framework for dynamic reconfiguration and component composition in embedded smart cmeras. WSEAS Trans. Comput. 5, 3, 574--581.Google Scholar
- Fraga, J., Siqueira, F., and Favarim, F. 2003. An adaptive fault-tolerant component model. In Proceedings of the 9th IEEE International Workshop on Object-Oriented Real-Time Dependable Systems. IEEE, Los Alamitos, CA, 179--186.Google Scholar
- Hansson, H., Åkerholm, M., Crnkovic, I., and Törngren, M. 2004. SaveCCM—a component model for safety-critical real-time systems. In Proceedings of the 30th EUROMICRO Conference. IEEE, Los Alamitos, CA, 627--635. Google Scholar
Digital Library
- Karsai, G., Sztipanovits, J., Ledeczi, A., and Bapty, T. 2003. Model-integrated development of embedded software. Proc. IEEE 91, 1, 145--164.Google Scholar
Cross Ref
- Lin, C. H., Wolf, W., Dixon, A., Koutsoukos, X., and Sztipanovits, J. 2006. Design and implementation of ubiquitous smart cameras. In Proceedings of the IEEE International Conference on Sensor Networks, Ubiquitous, and Trustworthy Computing. IEEE, Los Alamitos, CA, 32--39. Google Scholar
Digital Library
- Maier, A. 2006. Dynamic power-aware camera configuration in distributed embedded surveillance clusters. Ph.D. thesis, Institute for Technical Informatics, Graz University of Technology, Graz, Austria.Google Scholar
- Maier, A., Rinner, B., and Schwabach, H. 2005. A hierarchical approach for energy-aware distributed embedded intelligent video surveillance. In Proceedings of the IEEE/IFIP International Workshop on Parallel and Distributed Embedded Systems. IEEE, Los Alamitos, CA, 12--16. Google Scholar
Digital Library
- Mascolo, C., Capra, L., and Emmerich, W. 2002. Mobile computing middleware. In Advanced Lectures on Networking: NETWORKING 2002 Tutorials, E. Gregori, G. Anastasi, and S. Basagni, Eds. Lecture Notes in Computer Science, vol. 2497. Springer, Berlin, Germany, 20--52. Google Scholar
Digital Library
- Microsoft. 2005. .Net Home Page. http://www.microsoft.com/net.Google Scholar
- Mody, M. 2006. XDAIS-DM (XDM): A step towards the “plug and play” architecture for multimedia codecs. TI Developer Conference. http://www.s.ti.com/sc/techlit/sprp496.pdf.Google Scholar
- Molla, M. M. and Ahamed, S. I. 2006. A survey of middleware for sensor Networks and Challenges. In Proceedings of the International Conference on Parallel Processing Workshops (ICPPW'06). IEEE, Los Alamitos, CA, 223--228. Google Scholar
Digital Library
- Object Management Group. 2001. Real-Time CORBA 2.0. http://www.omg.org.Google Scholar
- Object Management Group. 2002. Minimum CORBA 1.0. http://www.omg.org.Google Scholar
- Object Management Group. 2005. http://www.omg.org/technology/documents/formal/components. htm.Google Scholar
- Pitt, E. and McNiff, K. 2001. Java.rmi: The Remote Method Invocation Guide. Addison Wesley, Upper Saddle River, NJ. Google Scholar
Digital Library
- Pope, A. 1998. The CORBA Reference Guide: Understanding the Common Oject Request Broker Architecture. Addison Wesley, Upper Saddle River, NJ. Google Scholar
Digital Library
- Rinner, B., Jovanovic, M., and Quaritsch, M. 2007. Embedded middleware on distributed smart cameras. In Proceedings of the IEEE International Conference on Acoustics, Speech, Signal Processing (ICASSP'07). IEEE, Los Alamitos, CA, 1381--1384.Google Scholar
- Rinner, B., Schriebl, W., Winkler, T., Quaritsch, M., and Wolf, W. 2008. The evolution from single to pervasive smart sameras. In Proceedings of the ACM/IEEE International Conference on Distributed Smart Cameras (ICDSC'08). ACM, New York.Google Scholar
- Rinner, B. and Wolf, W. 2008a. A bright future for distributed smart cameras (guest editor's introduction). Proc. IEEE 96, 10, 1562--1564.Google Scholar
Cross Ref
- Rinner, B. and Wolf, W. 2008b. An introduction to distributed smart cameras. Proc. IEEE 96, 10, 1565--1575.Google Scholar
Cross Ref
- Schmidt, D. C. 2002. Middleware for real-time and embedded systems. Comm. ACM 45, 6, 43--48. Google Scholar
Digital Library
- Sessions, R. 1997. COM and DCOM: Microsoft's Vision for Distributed Objects. John Wiley & Sons, New York, NY. Google Scholar
Digital Library
- Systems, M. C. and Thales. 2003. Light Weight CORBA Component Model. Tech. rep., Object Management Group.Google Scholar
- Texas Instruments. 2002. TMS320 Algorithm Standard—Rules and Guidelines. Literature Number: SPRU352E.Google Scholar
- Wolf, W., Ozer, B., and Lv, T. 2002. Smart cameras as embedded systems. Computer 35, 9, 48--53. Google Scholar
Digital Library
Index Terms
A novel software framework for embedded multiprocessor smart cameras
Recommendations
A Real-Time Distributed Intelligent Traffic Video-Surveillance System on Embedded Smart Cameras
ICNDC '13: Proceedings of the 2013 Fourth International Conference on Networking and Distributed ComputingA real-time video-surveillance system on embedded smart cameras is presented aiming at a wide range of traffic surveillance and monitoring scenarios, in which event detection, vehicle identification and tracking are implemented in front-end cameras. In ...
Reliable multi-object tracking dealing with occlusions for a smart camera
ICDSC '15: Proceedings of the 9th International Conference on Distributed Smart CamerasIn this paper, a multi-object tracking system designed for a low cost embedded smart camera is proposed. Objects tracking constitutes a main step in video-surveillance applications. Because of the number of cameras used to cover a large area, ...
Autonomous multicamera tracking on embedded smart cameras
There is currently a strong trend towards the deployment of advanced computer vision methods on embedded systems. This deployment is very challenging since embedded platforms often provide limited resources such as computing performance, memory, and ...






Comments