skip to main content
research-article

A novel low-power embedded object recognition system working at multi-frames per second

Published:21 March 2013Publication History
Skip Abstract Section

Abstract

One very important challenge in the field of multimedia is the implementation of fast and detailed Object Detection and Recognition systems. In particular, in the current state-of-the-art mobile multimedia systems, it is highly desirable to detect and locate certain objects within a video frame in real time. Although a significant number of Object Detection and Recognition schemes have been developed and implemented, triggering very accurate results, the vast majority of them cannot be applied in state-of-the-art mobile multimedia devices; this is mainly due to the fact that they are highly complex schemes that require a significant amount of processing power, while they are also time consuming and very power hungry. In this article, we present a novel FPGA-based embedded implementation of a very efficient object recognition algorithm called Receptive Field Cooccurrence Histograms Algorithm (RFCH). Our main focus was to increase its performance so as to be able to handle the object recognition task of today's highly sophisticated embedded multimedia systems while keeping its energy consumption at very low levels. Our low-power embedded reconfigurable system is at least 15 times faster than the software implementation on a low-voltage high-end CPU, while consuming at least 60 times less energy. Our novel system is also 88 times more energy efficient than the recently introduced low-power multi-core Intel devices which are optimized for embedded systems. This is, to the best of our knowledge, the first system presented that can execute the complete complex object recognition task at a multi frame per second rate while consuming minimal amounts of energy, making it an ideal candidate for future embedded multimedia systems.

References

  1. Bhowmik, D., Amavasai, B. P., and Mulroy, T. J. 2006. Real-time object classification on FPGA using moment invariants and Kohonen neural networks, In Proceedings of the IEEE SMC UK-RI 5th Chapter Conference on Advances in Cybernetic Systems. 43--48.Google ScholarGoogle Scholar
  2. Ekvall S. and Kragic, D. 2995. Receptive field coocurrence histograms for object detection. In Proceedings of the IEEE/RSJ International Conference on Intelligent Robots and Systems. 84--89.Google ScholarGoogle Scholar
  3. Gao, C. and Lu, S.-L. 2008. Novel FPGA based HAAR classier face detection algorithm acceleration, In Proceedings of the International Conference on Field Programmable Logic and Applications. 373--378.Google ScholarGoogle Scholar
  4. Gentsos, C., Sotiropoulou, C.-L., Nikolaidis, S., and Vassiliadis, N. 2010. Real-time canny edge detection parallel implementation for FPGAs, In Proceedings of the International Conference on Electronics, Circuits, and Systems. 499--502. Google ScholarGoogle ScholarCross RefCross Ref
  5. Goshorn D., Cho, J., Kastner, R., and Mirzaei, R. S. 2010. Field programmable gate array implementation of parts-based object detection for real time video applications. In Proceedings of the International Conference on Field Programmable Logic and Applications. 582--587 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Hadjitheophanous, S. Ttofis, C. Georghiades, A. S.; and Theocharides, T. Towards hardware stereoscopic 3D reconstruction a real-time FPGA computation of the disparity map. In Proceedings of the Design, Automation and Test in Europe Conference and Exhibition. 1743--1748. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. He, W. and Yuan, K. 2008. An improved canny edge detector and its realization on FPGA. In Proceedings of the 7th World Congress on Intelligent Control and Automation.Google ScholarGoogle Scholar
  8. Jag, B. 2012. Intel, ARM Battle for Microservers. Processor Watch, May 17.Google ScholarGoogle Scholar
  9. Kyrkou, C. and Theocharides, T. 2011. A flexible parallel hardware architecture for Ada Boost-based real-time object detection. IEEE Trans. VLSI Syst. 19, 6. 1034--1037. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. MacQueen, J. B. 1967. Some methods for classification and analysis of multivariate observations. In Proceedings of 5th Berkeley Symposium on Mathematical Statistics and Probability. University of California Press, 281--297.Google ScholarGoogle Scholar
  11. Nair, V. Laprise, P. O. and Clark, J. J. An FPGA-based people detection system. EURASIP J. Appl. Signal Process. 7, 1--15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Saravanan, S., Chandran, S. K., Punnekkat, S., and Kothari, D. P. 2011. A study on factors influencing power consumption in multithreaded and multicore CPUs, WSEAS Trans. Comput. 10, 3, 93--103. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Shotton, J., Fitzgibbon, A., Cook, M., Sharp, T., Finocchio, M., Moore, R., Kipman, A., and Blake, A. 2011. Real-time human pose recognition in parts from a single depth image. In Proceedings of the Computer Vision and Pattern Recognition Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Youssef, A., Zahran, M., Anis, M., and Elmasry, M. 2010. On the power management of simultaneous multithreading processors. IEEE Trans. VLSI Syst. 18, 8 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. A novel low-power embedded object recognition system working at multi-frames per second

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!