Steven M. Seitz
Abstract
A theory of stereo image formation is presented that enables a complete classification of all possible stereo views, including non-perspective varieties. Towards this end, the notion of epipolar geometry is generalized to apply to multiperspective images. It is shown that any stereo pair must consist of rays lying on one of three varieties of quadric surfaces. A unified representation is developed to model all classes of stereo views, based on the concept of a quadric view. The benefits include a unified treatment of projection and triangulation operations for all stereo views. The framework is applied to derive new types of stereo image representations with unusual and useful properties. Experimental examples of these images are constructed and used to obtain 3D binocular object reconstructions.
- Adelson, E.H. and Bergen, J.R. 1991. The Plenoptic Function and the Elements of Early Vision. MIT Press: Cambridge, MA.Google Scholar
- Baker, S. and Nayar, S. 1999. A theory of single-viewpoint catadioptric image formation. Int. J. of Computer Vision, 35(2):175-196. Google ScholarDigital Library
- Bolles, R.C., Baker, H.H., and Marimont, D.H. 1987. Epipolar-plane image analysis: An approach to determining structure from motion. Int. J. of Computer Vision, 1(1):7-55.Google ScholarCross Ref
- Davidhazy, A. 1987. Principles of peripheral photography. Industrial Photography. Available at http://www.rit.edu/~andpph/text-peripheral-basics.html.Google Scholar
- Gupta, R. and Hartley, R.I. 1997. Linear pushbroom cameras. IEEE Trans. Pattern Analysis and Machine Intell., 19(9):963-975. Google ScholarDigital Library
- Hilbert, D. and Cohn-Vossen, S. 1991. Geometry and the Imagination . AMS Chelsea: Providence, RI.Google Scholar
- Ishiguro, H., Yamamoto, M., and Tsuji, S. 1992. Omni-directional stereo. PAMI, 14:257-262. Google ScholarDigital Library
- Koenderink, J.J. and van Doorn, A.J. 1991. Affine structure from motion. J. Opt. Soc. Am. A, 8:377-385.Google ScholarCross Ref
- Loop, C. and Zhang, Z. 1999. Computing rectifying homographies for stereo vision. In Proc. Computer Vision and Pattern Recognition Conf.Google Scholar
- McMillan, L. and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. In Proc. SIGGRAPH 95, pp. 39-46. Google ScholarDigital Library
- Nayar, S.K. and Karmarkar, A. 2000. 360 × 360 mosaics. In Proc. Computer Vision and Pattern Recognition Conf., pp. 388-395.Google Scholar
- Pajdla, T. 2001. Epipolar geometry of some non-classical cameras. In Proceedings of Computer Vision Winter Workshop. Slovenian Pattern Recognition Society, pp. 223-233.Google Scholar
- Peleg, S. and Ben-Ezra, M. 1999. Stereo panorama with a single camera. In Proc. Computer Vision and Pattern Recognition Conf., pp. 395-401.Google Scholar
- Peleg, S. and Herman, J. 1997. Panoramic mosaics by manifold projection. In Proc. Computer Vision and Pattern Recognition Conf., pp. 338-343. Google ScholarDigital Library
- Peleg, S., Pritch, Y., and Ben-Ezra, M. 2000. Cameras for stereo panoramic imaging. In Proc. Computer Vision and Pattern Recognition Conf., pp. 208-214.Google Scholar
- Rademacher, P. and Bishop, G. 1998. Multiple-center-of-projection images. In Proceedings of SIGGRAPH 98, pp. 199-206. Google ScholarDigital Library
- Roy, S., Meunier, J., and Cox, I. 1997. Cylindrical rectification to minimize epipolar distortion. In Proc. Computer Vision and Pattern Recognition Conf, pp. 393-399. Google ScholarDigital Library
- Shum, H.-Y. and He, L.-W. 1999. Rendering with concentric mosaics. In Proceedings of SIGGRAPH 99, pp. 299-306. Google ScholarDigital Library
- Shum, H.-Y., Kalai, A., and Seitz, S.M. 1999. Omnivergent stereo. In Proc. 7th Int. Conf. on Computer Vision, pp. 22- 29.Google Scholar
- Shum, H.-Y. and Szeliski, R. 1999. Stereo reconstruction from multiperspective panoramas. In Proc. Seventh Int. Conf. on Computer Vision, pp. 14-21.Google Scholar
- Svoboda, T., Pajdla, T., and Hlavac, V. 1998. Epipolar geometry for panoramic cameras. In Proc. 5th Eur. Conf. on Computer Vision, pp. 218-232. Google ScholarDigital Library
- Wood, D.N., Finkelstein, A., Hughes, J.F., Thayer, C.E., and Salesin, D.H. 1997. Multiperspective panoramas for cel animation. In Proc. SIGGRAPH 97, pp. 243-250. Google ScholarDigital Library
- Zitnick, C.L. and Kanade, T. 2000. A cooperative algorithm for stereo matching and occlusion detection. IEEE Trans. on Pattern Analysis and Machine Intelligence, 22(7). Google ScholarDigital Library
Index Terms
The Space of All Stereo Images
Recommendations
Catadioptric Stereo Using Planar Mirrors
By using mirror reflections of a scene, stereo images can be captured with a single camera (catadioptric stereo). In addition to simplifying data acquisition single camera stereo provides both geometric and radiometric advantages over traditional two ...
Stereo fusion
A stereo fusion system that combines binocular and refractive stereo is presented.Our stereo fusion outperforms traditional binocular and refractive stereo.An efficient calibration method for refractive stereo is proposed. Display Omitted The ...
Omnivergent Stereo
The notion of a virtual camera for optimal 3D reconstruction is introduced. Instead of planar perspective images that collect many rays at a fixed viewpoint, omnivergent cameras collect a small number of rays at many different viewpoints. The resulting ...
Comments