Ramesh Raskar
Abstract
In a conventional single-exposure photograph, moving objects or moving cameras cause motion blur. The exposure time defines a temporal box filter that smears the moving object across the image by convolution. This box filter destroys important high-frequency spatial details so that deblurring via deconvolution becomes an ill-posed problem.Rather than leaving the shutter open for the entire exposure duration, we "flutter" the camera's shutter open and closed during the chosen exposure time with a binary pseudo-random sequence. The flutter changes the box filter to a broad-band filter that preserves high-frequency spatial details in the blurred image and the corresponding deconvolution becomes a well-posed problem. We demonstrate that manually-specified point spread functions are sufficient for several challenging cases of motion-blur removal including extremely large motions, textured backgrounds and partial occluders.
Supplemental Material
- Bascle, B., Blake, A., and Zisserman, A. 1996. Motion deblurring and super-resolution from an image sequence. In ECCV, vol. 2, 573--582. Google Scholar
Digital Library
- Ben-Ezra, M., and Nayar, S. 2004. Motion-based Motion Deblurring. IEEE Trans. on Pattern Analysis and Machine Intelligence 26, 6 (Jun), 689--698. Google ScholarDigital Library
- Black, M. J., and Anandan, P. 1996. The robust estimation of multiple motions: Parametric and piecewise-smooth flow fields. In Computer Vision and Image Understanding (CVIU), vol. 63, 75--104. Google ScholarDigital Library
- Canon, 2006. What is optical image stabilizer? http://www.canon.com/bctv/faq/optis.html.Google Scholar
- Edgerton, H., 1951-1963. Rapatronic Photographs. http://simplethinking.com/home/rapatronic_photographs.htm.Google Scholar
- Gottesman, S. R., and Fenimore, E. E. 1989. New family of binary arrays for coded aperture imaging. Applied Optics 28, 20 (Oct), 4344--4352.Google ScholarCross Ref
- Hadamard, J. 1923. Lectures on the Cauchy Problem in Linear Partial Differential Equations. Yale University Press, New Haven, CT.Google Scholar
- Jansson, P. 1997. Deconvolution of Image and Spectra, 2nd ed. Academic Press. Google ScholarDigital Library
- Jia, J., Sun, J., Tang, C.-K., and Shum, H.-Y. 2004. Bayesian correction of image intensity with spatial consideration. In ECCV, vol. 3, 342--354.Google Scholar
- Kundur, D., and Hatzinakos, D. 1998. A novel blind deconvolution scheme for image restoration using recursive filtering. IEEE Trans. on Signal Processing 46, 2 (Feb), 375--39. Google ScholarDigital Library
- Liu, X., and Gamal, A. 2001. Simultaneous image formation and motion blur restoration via multiple capture. In Proc. Int. Conf. Acoustics, Speech, Signal Processing. Google ScholarDigital Library
- Lucy, L. 1974. An iterative technique for the rectification of observed distributions. Journal of Astronomy 79, 745--754.Google ScholarCross Ref
- Nikon, 2005. Precise camera-shake compensation at every angle. www.nikon.co.jp/main/eng/portfolio/about/technology/nikon_technology/vr_e.Google Scholar
- Pointgrey Research, 2006. PGR IEEE-1394 Digital Camera Register Reference. http://www.ptgrey.com.Google Scholar
- Rat, 2006. Coded-exposure datasets. http://www.merl.com/people/raskar/deblur/.Google Scholar
- Richardson, W. 1972. Bayesian-based iterative method of image restoration. J. Opt. Soc. of Am. 62, 1 (January), 55--59.Google ScholarCross Ref
- Schultz, R. R., and Stevenson, R. L. 1996. Extraction of high-resolution frames from video sequences. In IEEE Trans. on Image Processing, vol. 5, IEEE, 996--1011. Google ScholarDigital Library
- Shechtman, E., Caspi, Y., and Irani, M. 2002. Increasing space-time resolution in video. In ECCV, Springer-Verlag, London, UK, 753--768. Google ScholarDigital Library
- Tikhonov, A. N., and Arsenin, V. I. 1977. Solutions of ill-posed problems {Metody resheniia nekorrektnykh zadach}. Halsted Press, New York.Google Scholar
- Trevor J. Cox, P. D. 2003. Engineering art: the science of concert hall acoustics. Interdisciplinary Science Reviews 28, 2, 119--129.Google ScholarCross Ref
- Tull, D. T., and Katsaggelos, A. K. 1996. Iterative restoration of fast-moving objects in dynamic image sequences. Optical Engineering 35, 12 (Dec), 3460--3469.Google ScholarCross Ref
- Wang, J., and Adelson, E. 1994. Representing moving images with layers. IEEE Trans. Image Processing 3, 5 (Sept), 625--638.Google ScholarDigital Library
- Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Trans. Graph. 24, 3, 765--776. Google ScholarDigital Library
- Yitzhaky, Y., Mor, I., Lantzman, A., and Kopeika, N. 1998. Direct method for restoration of motion-blurred images. J. Optical Society of America A (Optics, Image Science and Vision) 15, 6 (June), 1512--1519.Google Scholar
Index Terms
Coded exposure photography: motion deblurring using fluttered shutter
Recommendations
Motion-invariant photography
Object motion during camera exposure often leads to noticeable blurring artifacts. Proper elimination of this blur is challenging because the blur kernel is unknown, varies over the image as a function of object velocity, and destroys high frequencies. ...
Coded exposure photography: motion deblurring using fluttered shutter
SIGGRAPH '06: ACM SIGGRAPH 2006 PapersIn a conventional single-exposure photograph, moving objects or moving cameras cause motion blur. The exposure time defines a temporal box filter that smears the moving object across the image by convolution. This box filter destroys important high-...
Computational Long Exposure Mobile Photography
Long exposure photography produces stunning imagery, representing moving elements in a scene with motion-blur. It is generally employed in two modalities, producing either a foreground or a background blur effect. Foreground blur images are ...
Comments