Multiview radial catadioptric imaging for scene capture

Abstract

In this paper, we present a class of imaging systems, called radial imaging systems, that capture a scene from a large number of view-points within a single image, using a camera and a curved mirror. These systems can recover scene properties such as geometry, reflectance, and texture. We derive analytic expressions that describe the properties of a complete family of radial imaging systems, including their loci of viewpoints, fields of view, and resolution characteristics. We have built radial imaging systems that, from a single image, recover the frontal 3D structure of an object, generate the complete texture map of a convex object, and estimate the parameters of an analytic BRDF model for an isotropic material. In addition, one of our systems can recover the complete geometry of a convex object by capturing only two images. These results show that radial imaging systems are simple, effective, and convenient devices for a wide range of applications in computer graphics and computer vision.

References

1. Dana, K. J. 2001. BRDF/BTF Measurement Device. In Proc. of ICCV, 460--466.
2. Davidhazy, A. 1987. Peripheral Photography: Shooting full circle. Industrial Photography 36, 28--31.
3. Efros, A. A., and Freeman, W. T. 2001. Image Quilting for Texture Synthesis and Transfer. In Proc. of SIGGRAPH, 341--346.
4. Efros, A. A., and Leung, T. K. 1999. Texture Synthesis by Non-parametric Sampling. In Proc. of ICCV, 1033--1038.
5. Gluckman, J., and Nayar, S. K. 1999. Planar Catadioptric Stereo: Geometry and Calibration. In Proc. of CVPR, 1022--1028.
6. Gluckman, J., Thorek, K., and Nayar, S. K. 1998. Real time panoramic stereo. In Proc. of Image Understanding Workshop.
7. Gortler, S., Grzeszczuk, R., Szeliski, R., and Cohen, M. 1996. The Lumigraph. In Proc. SIGGRAPH, 43--54.
8. Han, J. Y., and Perlin, K. 2003. Measuring bidirectional texture reflectance with a kaleidoscope. In Proc. of SIGGRAPH, 741--748.
9. Hawkins, T., Einarsson, P., and Debevec, P. 2005. Acquisition of time-varying participating media. In Proc. of SIGGRAPH, 812--815.
10. Kanade, T., Yoshida, A., Oda, K., Kano, H., and Tanaka, M. 1996. A Stereo Machine for Video-rate Dense Depth Mapping and its New Applications. In Proc. of CVPR, 196--202.
11. Kanade, T., Rander, P., and Narayanan, P. 1997. Virtualized Reality: Constructing Virtual Worlds from Real Scenes. In IEEE Multimedia, 34--47.
12. Kwatra, V., Schdl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut Textures: Image and Video Synthesis Using Graph Cuts. In Proc. of SIGGRAPH, 277--286.
13. Levoy, M., and Hanrahan, P. 1996. Light Field Rendering. In Proc. of SIGGRAPH, 31--42.
14. Levoy, M., Chen, B., Vaish, V., Horowitz, M., Mcdowall, I., and Bolas, M. 2004. Synthetic aperture confocal imaging. In Proc. of SIGGRAPH, 825--834.
15. Lin, S.-S., and Bajcsy, R. 2003. High Resolution Catadioptric Omni-Directional Stereo Sensor for Robot Vision. In Proc. of ICRA, 1694--1699.
16. Liu, X., Yu, Y., and Shum, H.-Y. 2001. Synthesizing Bidirectional Texture Functions for Real-World Surfaces. In Proc. of SIGGRAPH, 97--106.
17. Nene, S., and Nayar, S. K. 1998. Stereo with Mirrors. In Proc. of ICCV, 1087--1094.
18. Peleg, S., and Herman, J. 1997. Panoramic Mosaics by Manifold Projection. In Proc. of CVPR, 338--343.
19. Scharstein, D., and Szeliski, R. 2002. A Taxonomy and Evaluation of Dense Two-Frame Stereo Correspondence Algorithms. IJCV 47, 7--42.
20. Seitz, S. M., and Kim, J. 2002. The Space of All Stereo Images. IJCV 48, 21--38.
21. Shum, H.-Y., and He, L.-W. 1999. Rendering with Concentric Mosaics. In Proc. of SIGGRAPH, 299 -- 306.
22. Southwell, D., Basu, A., Fiala, M., and Reyda, J. 1996. Panoramic Stereo. In Proc. of ICPR, 378--382.
23. Unger, J., Wenger, A., Hawkins, T., Gardner, A., and Debevec, P. 2003. Capturing and Rendering with Incident Light Fields. In Proc. of EGSR, 141--149.
24. Ward, G. J. 1992. Measuring and Modeling Anisotropic Reflection. In Proc. of SIGGRAPH, 265--272.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition