Eulerian video magnification for revealing subtle changes in the world

Abstract

Our goal is to reveal temporal variations in videos that are difficult or impossible to see with the naked eye and display them in an indicative manner. Our method, which we call Eulerian Video Magnification, takes a standard video sequence as input, and applies spatial decomposition, followed by temporal filtering to the frames. The resulting signal is then amplified to reveal hidden information. Using our method, we are able to visualize the flow of blood as it fills the face and also to amplify and reveal small motions. Our technique can run in real time to show phenomena occurring at the temporal frequencies selected by the user.

References

1. Burt, P., and Adelson, E. 1983. The laplacian pyramid as a compact image code. IEEE Trans. Comm. 31, 4, 532--540.
2. Freeman, W. T., Adelson, E. H., and Heeger, D. J. 1991. Motion without movement. ACM Comp. Graph. 25, 27--30.
3. Fuchs, M., Chen, T., Wang, O., Raskar, R., Seidel, H.-P., and Lensch, H. P. 2010. Real-time temporal shaping of highspeed video streams. Computers & Graphics 34, 5, 575--584.
4. Horn, B., and Schunck, B. 1981. Determining optical flow. Artificial intelligence 17, 1-3, 185--203.
5. Liu, C., Torralba, A., Freeman, W. T., Durand, F., and Adelson, E. H. 2005. Motion magnification. ACM Trans. Graph. 24, 519--526.
6. Liu, C., Freeman, W., Szeliski, R., and Kang, S. B. 2006. Noise estimation from a single image. In IEEE CVPR, vol. 1, 901--908.
7. Lucas, B. D., and Kanade, T. 1981. An iterative image registration technique with an application to stereo vision. In Proceedings of IJCAI, 674--679.
8. Philips, 2011. Philips Vitals Signs Camera. http://www.vitalsignscamera.com.
9. Poh, M.-Z., McDuff, D. J., and Picard, R. W. 2010. Non-contact, automated cardiac pulse measurements using video imaging and blind source separation. Opt. Express 18, 10, 10762--10774.
10. Verkruysse, W., Svaasand, L. O., and Nelson, J. S. 2008. Remote plethysmographic imaging using ambient light. Opt. Express 16, 26, 21434--21445.
11. Wang, J., Drucker, S. M., Agrawala, M., and Cohen, M. F. 2006. The cartoon animation filter. ACM Trans. Graph. 25, 1169--1173.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Scene understanding