Richard Szeliski
Heung-Yeung Shum
ABSTRACT
This paper presents a novel approach to creating full view panoramic mosaics from image sequences. Unlike current panoramic stitching methods, which usually require pure horizontal camera panning, our system does not require any controlled motions or constraints on how the images are taken (as long as there is no strong motion parallax). For example, images taken from a hand-held digital camera can be stitched seamlessly into panoramic mosaics. Because we represent our image mosaics using a set of transforms, there are no singularity problems such as those existing at the top and bottom of cylindrical or spherical maps. Our algorithm is fast and robust because it directly recovers 3D rotations instead of general 8 parameter planar perspective transforms. Methods to recover camera focal length are also presented. We also present an algorithm for efficiently extracting environment maps from our image mosaics. By mapping the mosaic onto an artibrary texture-mapped polyhedron surrounding the origin, we can explore the virtual environment using standard 3D graphics viewers and hardware without requiring special-purpose players.
- 1.N. Ayache. Vision St~r~oscopique et Perception Multisensorielle. InterEditions., Paris, 1989.Google Scholar
- 2.J.R. Bergen, P. Anandan, K. J. Hanna, and R. Hingorani. Hierarchical model-based motion estimation. In Second European Conference on Computer Vision (ECCV'92), pages 237-252, Santa Margherita Liguere, Italy, May 1992. Springer-Verlag. Google ScholarDigital Library
- 3.S. Chen and L. Williams. View interpolation for image synthesis. Computer Graphics (SIGGRAPH'93), pages 279-288, August 1993. Google ScholarDigital Library
- 4.S. E. Chen. QuickTime VR- an image-based approach to virtual environment navigation. Computer Graphics (SIG- GRAPH'95), pages 29-38, August 1995. Google ScholarDigital Library
- 5.O. Faugeras. Three-dimensional computervision: A geometric viewpoint. MIT Press, Cambridge, Massachusetts, 1993. Google ScholarDigital Library
- 6.S. J. Gortler, R. Grzeszczuk, R. Szeliski, and M. F. Cohen. The lumigraph. In Computer Graphics Proceedings, Annual Conference Series, pages 43-54, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH. Google ScholarDigital Library
- 7.N. Greene. Environment mapping and other applications of world projections. IEEE Computer Graphics and Applications, 6(11):21-29, November 1986. Google ScholarDigital Library
- 8.R.I. Hartley. Self-calibration from multiple views of a rotating camera. In Third European Conference on Computer Vision (ECCV'94), volume 1, pages 471-478, Stockholm, Sweden, May 1994. Springer-Veflag. Google ScholarDigital Library
- 9.M. Irani, P. Anandan, and S. Hsu. Mosaic based representations of video sequences and their applications. In Fifth International Conference on Computer Vision (ICCV' 95), pages 605-611, Cambridge, Massachusetts, June 1995. Google ScholarDigital Library
- 10.S. B. Kang and R Weiss. Characterization of errors in cornpositing panoramic images. Technical Report 96/2, Digital Equipment Corporation, Cambridge Research Lab, June 1996.Google Scholar
- 11.M. Levoy and E Hanrahan. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, pages 31- 42, Proc. SIGGRAPH'96 (New Orleans), August 1996. ACM SIGGRAPH. Google ScholarDigital Library
- 12.S. Mann and R. W. Picard. Virtual bellows: Constructing high-quality images from video. In First IEEE International Conference on Image Processing (ICIP-94), volume I, pages 363-367, Austin, Texas, November 1994.Google ScholarCross Ref
- 13.L. McMillan and G. Bishop. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIG- GRAPH'95), pages 39-46, August 1995. Google ScholarDigital Library
- 14.J. Meehan. Panoramic Photography. Watson-Guptill, 1990.Google Scholar
- 15.H.-Y. Shum and R. Szeliski. Construction and refinement of panoramic mosaics with global and local alignment. Submitted for review, April 1997. Google ScholarDigital Library
- 16.G. Stein. Accurate internal camera calibration using rotation, with analysis of sources of error. In Fifth International Conference on Computer Vision (ICCV'95), pages 230-236, Cambridge, Massachusetts, June 1995. Google ScholarDigital Library
- 17.R. Szeliski. Image mosaicing for tele-reality applications. In IEEE Workshop on Applications of Computer Vision (WACV'94), pages 44-53, Sarasota, Florida, December 1994. IEEE Computer Society.Google ScholarCross Ref
- 18.R. Szeliski. Video mosaics for virtual environments. IEEE Computer Graphics and Applications, pages 22-30, March 1996. Google ScholarDigital Library
- 19.R. Y. Tsai. A versatile camera calibration technique for highaccuracy 3D machine vision metrology using off-the-shelf TV cameras and lenses. IEEE Journal of Robotics and Automation, RA-3(4):323-344, August 1987.Google ScholarCross Ref
- 20.H. Weghorst, G. Hooper, and D. E Greenberg. Improved computational methods for ray tracing. ACM Transactions on Graphics, 3(1):52069, January 1984. Google ScholarDigital Library
- 21.L. Williams. Pyramidal parametrics. Computer Graphics, 17(3):1-11, July 1983. Google ScholarDigital Library
- 22.http://qtvr.quicktime.apple.com.Google Scholar
- 23.http://www.bdiamon.com.Google Scholar
- 24.http://www.omniview.com.Google Scholar
- 25.http://www, smoothmove.com.Google Scholar
- 26.http://www.rlspace.com.Google Scholar
- 27.http://www.behere.com.Google Scholar
- 28.http://www.cs.columbia.edu/cave/omnicam.Google Scholar
Index Terms
Creating full view panoramic image mosaics and environment maps
Recommendations
Creating Full View Panoramic Image Mosaics and Environment Maps
Seminal Graphics Papers: Pushing the Boundaries, Volume 2This paper presents a novel approach to creating full viewpanoramic mosaics from image sequences. Unlike current panoramic stitching methods, which usually require pure horizontal camera panning, our system does not require any controlled motions or ...
Panoramic mosaicing optimization
ICIAP '07: Proceedings of the 14th International Conference on Image Analysis and ProcessingMotorized dome-type cameras, also called PTZ camera, allow the creation of panoramas. These panoramas represent the whole of the scene seen by the camera. In the case of a PTZ camera and with certain constraints, the scene seen by the camera can be ...
Plane-based multi-view inpainting for image-based rendering in large scenes
I3D '18: Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and GamesImage-Based Rendering (IBR) allows high-fidelity free-viewpoint navigation using only a set of photographs and 3D reconstruction as input. It is often necessary or convenient to remove objects from the captured scenes, allowing a form of scene editing ...
Comments