Abstract
One very important challenge in the field of multimedia is the implementation of fast and detailed Object Detection and Recognition systems. In particular, in the current state-of-the-art mobile multimedia systems, it is highly desirable to detect and locate certain objects within a video frame in real time. Although a significant number of Object Detection and Recognition schemes have been developed and implemented, triggering very accurate results, the vast majority of them cannot be applied in state-of-the-art mobile multimedia devices; this is mainly due to the fact that they are highly complex schemes that require a significant amount of processing power, while they are also time consuming and very power hungry. In this article, we present a novel FPGA-based embedded implementation of a very efficient object recognition algorithm called Receptive Field Cooccurrence Histograms Algorithm (RFCH). Our main focus was to increase its performance so as to be able to handle the object recognition task of today's highly sophisticated embedded multimedia systems while keeping its energy consumption at very low levels. Our low-power embedded reconfigurable system is at least 15 times faster than the software implementation on a low-voltage high-end CPU, while consuming at least 60 times less energy. Our novel system is also 88 times more energy efficient than the recently introduced low-power multi-core Intel devices which are optimized for embedded systems. This is, to the best of our knowledge, the first system presented that can execute the complete complex object recognition task at a multi frame per second rate while consuming minimal amounts of energy, making it an ideal candidate for future embedded multimedia systems.
- Bhowmik, D., Amavasai, B. P., and Mulroy, T. J. 2006. Real-time object classification on FPGA using moment invariants and Kohonen neural networks, In Proceedings of the IEEE SMC UK-RI 5th Chapter Conference on Advances in Cybernetic Systems. 43--48.Google Scholar
- Ekvall S. and Kragic, D. 2995. Receptive field coocurrence histograms for object detection. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. 84--89.Google Scholar
- Gao, C. and Lu, S.-L. 2008. Novel FPGA based HAAR classier face detection algorithm acceleration, In Proceedings of the International Conference on Field Programmable Logic and Applications. 373--378.Google Scholar
- Gentsos, C., Sotiropoulou, C.-L., Nikolaidis, S., and Vassiliadis, N. 2010. Real-time canny edge detection parallel implementation for FPGAs, In Proceedings of the International Conference on Electronics, Circuits, and Systems. 499--502. Google Scholar
Cross Ref
- Goshorn D., Cho, J., Kastner, R., and Mirzaei, R. S. 2010. Field programmable gate array implementation of parts-based object detection for real time video applications. In Proceedings of the International Conference on Field Programmable Logic and Applications. 582--587 Google Scholar
Digital Library
- Hadjitheophanous, S. Ttofis, C. Georghiades, A. S.; and Theocharides, T. Towards hardware stereoscopic 3D reconstruction a real-time FPGA computation of the disparity map. In Proceedings of the Design, Automation and Test in Europe Conference and Exhibition. 1743--1748. Google Scholar
Digital Library
- He, W. and Yuan, K. 2008. An improved canny edge detector and its realization on FPGA. In Proceedings of the 7th World Congress on Intelligent Control and Automation.Google Scholar
- Jag, B. 2012. Intel, ARM Battle for Microservers. Processor Watch, May 17.Google Scholar
- Kyrkou, C. and Theocharides, T. 2011. A flexible parallel hardware architecture for Ada Boost-based real-time object detection. IEEE Trans. VLSI Syst. 19, 6. 1034--1037. Google Scholar
Digital Library
- MacQueen, J. B. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, 281--297.Google Scholar
- Nair, V. Laprise, P. O. and Clark, J. J. An FPGA-based people detection system. EURASIP J. Appl. Signal Process. 7, 1--15. Google Scholar
Digital Library
- Saravanan, S., Chandran, S. K., Punnekkat, S., and Kothari, D. P. 2011. A study on factors influencing power consumption in multithreaded and multicore CPUs, WSEAS Trans. Comput. 10, 3, 93--103. Google Scholar
Digital Library
- Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. 2011. Real-time human pose recognition in parts from a single depth image. In Proceedings of the Computer Vision and Pattern Recognition Conference. Google Scholar
Digital Library
- Youssef, A., Zahran, M., Anis, M., and Elmasry, M. 2010. On the power management of simultaneous multithreading processors. IEEE Trans. VLSI Syst. 18, 8 Google Scholar
Digital Library
Index Terms
A novel low-power embedded object recognition system working at multi-frames per second
Recommendations
FPGA-based accelerator for object detection: a comprehensive survey
AbstractObject detection is one of the most challenging tasks in computer vision. With the advances in semiconductor devices and chip technology, hardware accelerators have been widely used. Field-programmable gate arrays (FPGAs) are a highly flexible ...
A 90nm low-power FPGA for battery-powered applications
FPGA '06: Proceedings of the 2006 ACM/SIGDA 14th international symposium on Field programmable gate arraysProgrammable logic devices such as FPGAs are useful for a wide range of applications. However, FPGAs are not commonly used in battery-powered applications because they consume more power than ASICs and lack power management features. In this paper, we ...
Real-Time Object Detection for Multi-Camera on Heterogeneous Parallel Processing Systems
CISIS '13: Proceedings of the 2013 Seventh International Conference on Complex, Intelligent, and Software Intensive SystemsIn recent years, the need for object detection has significantly increased for multi-camera systems. However, the detection methods in such systems incur high computational cost, which leads to a major challenge in real-time applications. In this work, ...






Comments