Tobias Bertel
Christian Richardt
ABSTRACT
Capturing 360° panoramas has become straightforward now that this functionality is implemented on every phone. However, it remains difficult to capture immersive 360° panoramas with motion parallax, which provide different views for different viewpoints. Alternatives such as omnidirectional stereo panoramas provide different views for each eye (binocular disparity), but do not support motion parallax, while Casual 3D Photography [Hedman et al. 2017] reconstructs textured 3D geometry that provides motion parallax but suffers from reconstruction artefacts. We propose a new image-based approach for capturing and rendering high-quality 360° panoramas with motion parallax. We use novel-view synthesis with flow-based blending to turn a standard monoscopic video into an enriched 360° panoramic experience that can be explored in real time. Our approach makes it possible for casual consumers to capture and view high-quality 360° panoramas with motion parallax.
Supplemental Material
- Chris Buehler, Michael Bosse, Leonard McMillan, Steven Gortler, and Michael Cohen. 2001. Unstructured Lumigraph Rendering. In Proceedings of the Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH). 425--432. Google Scholar
Digital Library
- Abe Davis, Marc Levoy, and Fredo Durand. 2012. Unstructured Light Fields. Computer Graphics Forum (Proceedings of Eurographics) 31, 2 (May 2012), 305--314. Google ScholarDigital Library
- Peter Hedman, Suhib Alsisan, Richard Szeliski, and Johannes Kopf. 2017. Casual 3D Photography. ACM Transactions on Graphics (Proceedings of SIGGRAPH Asia) 36, 6 (November 2017), 234:1--15. Google ScholarDigital Library
- Bicheng Luo, Feng Xu, Christian Richardt, and Jun-Hai Yong. 2018. Parallax360: Stereoscopic 360° Scene Representation for Head-Motion Parallax. IEEE Transactions on Visualization and Computer Graphics 24, 4 (April 2018), 1545--1553. Google ScholarDigital Library
- Christian Richardt, Yael Pritch, Henning Zimmer, and Alexander Sorkine-Hornung. 2013. Megastereo: Constructing High-Resolution Stereo Panoramas. In Proceedings of the International Conference on Computer Vision and Pattern Recognition (CVPR). 1256--1263. Google ScholarDigital Library
Index Terms
MegaParallax: 360° panoramas with motion parallax
Recommendations
OmniPhotos: casual 360° VR photography
Virtual reality headsets are becoming increasingly popular, yet it remains difficult for casual users to capture immersive 360° VR panoramas. State-of-the-art approaches require capture times of usually far more than a minute and are often limited in ...
Visual Modeling with a Hand-Held Camera
In this paper a complete system to build visual models from camera images is presented. The system can deal with uncalibrated image sequences acquired with a hand-held camera. Based on tracked or matched features the relations between multiple views are ...
Stereo panorama acquisition and automatic image disparity adjustment for stereoscopic visualization
Image-based visualization is popular for various virtual tour applications, due to high-quality photorealism or simplicity for rendering. Stereo panorama representations of the virtual world are already a common part of this, either in small (computer ...
Comments