skip to main content
research-article
Open Access

Stereo-consistent screen-space ambient occlusion

Authors Info & Claims
Published:04 May 2022Publication History
Skip Abstract Section

Abstract

Screen-space ambient occlusion (SSAO) shows high efficiency and is widely used in real-time 3D applications. However, using SSAO algorithms in stereo rendering can lead to inconsistencies due to the differences in the screen-space information captured by the left and right eye. This will affect the perception of the scene and may be a source of viewer discomfort. In this paper, we show that the raw obscurance estimation part and subsequent filtering are both sources of inconsistencies. We developed a screen-space method involving both views in conjunction, leading to a stereo-aware raw obscurance estimation method and a stereo-aware bilateral filter. The results show that our method reduces stereo inconsistencies to a level comparable to geometry-based AO solutions, while maintaining the performance benefits of a screen-space approach.

Skip Supplemental Material Section

Supplemental Material

References

  1. Tomas Akenine-Möller, Eric Haines, and Naty Hoffman. 2018. Real-time rendering. AK Peters/CRC Press.Google ScholarGoogle Scholar
  2. Louis Bavoil and Johan Andersson. 2012. Stable SSAO in Battlefield 3 with selective temporal filtering. In Game Developers Conference, Vol. 12. https://www.gdcvault.com/play/1015538/Stable-SSAO-in-Battlefield-3Google ScholarGoogle Scholar
  3. Louis Bavoil, Miguel Sainz, and Rouslan Dimitrov. 2008. Image-Space Horizon-Based Ambient Occlusion. In ACM SIGGRAPH 2008 Talks. Association for Computing Machinery. https://doi.org/10.1145/1401032.1401061Google ScholarGoogle Scholar
  4. Alexandre Bléron, Romain Vergne, Thomas Hurtut, and Joëlle Thollot. 2018. Motion-Coherent Stylization with Screen-Space Image Filters. In Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (Expressive '18). Association for Computing Machinery, Article 10. https://doi.org/10.1145/3229147.3229163Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Dennis R. Bukenberger, Katharina Schwarz, and Hendrik P. A. Lensch. 2018. Stereo-Consistent Contours in Object Space. Computer Graphics Forum 37, 1 (2018), 301--312. https://doi.org/10.1111/cgf.13291Google ScholarGoogle ScholarCross RefCross Ref
  6. Franklin C. Crow. 1977. Shadow Algorithms for Computer Graphics. In Proceedings of the 4th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '77). Association for Computing Machinery, 242--248. https://doi.org/10.1145/563858.563901Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Elmar Eisemann and Frédo Durand. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics (TOG) 23, 3 (2004), 673--678. https://doi.org/10.1145/1015706.1015778Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Laura Fink, Nora Hensel, Daniela Markov-Vetter, Christoph Weber, Oliver Staadt, and Marc Stamminger. 2019. Hybrid Mono-Stereo Rendering in Virtual Reality. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 88--96. https://doi.org/10.1109/VR.2019.8798283Google ScholarGoogle Scholar
  9. Pascal Gautron. 2020. Real-Time Ray-Traced Ambient Occlusion of Complex Scenes Using Spatial Hashing. In ACM SIGGRAPH 2020 Talks (SIGGRAPH '20). Association for Computing Machinery, Article 5. https://doi.org/10.1145/3388767.3407375Google ScholarGoogle Scholar
  10. Xinyu Gong, Haozhi Huang, Lin Ma, Fumin Shen, Wei Liu, and Tong Zhang. 2018. Neural stereoscopic image style transfer. In Proceedings of the European Conference on Computer Vision (ECCV). 54--69. https://doi.org/10.1007/978-3-030-01228-1_4Google ScholarGoogle ScholarCross RefCross Ref
  11. Dejing He, Rui Wang, and Hujun Bao. 2019. Real-Time Rendering of Stereo-Consistent Contours. In 2019 IEEE Conference on Virtual Reality and 3D User Interfaces (VR). 81--87. https://doi.org/10.1109/VR.2019.8797990Google ScholarGoogle Scholar
  12. Jing Huang, Tamy Boubekeur, Tobias Ritschel, Matthias Hollaender, and Elmar Eisemann. 2011. Separable Approximation of Ambient Occlusion. In Short paper at Eurographics. 1--4. http://graphics.tudelft.nl/Publications-new/2011/HBRHE11Google ScholarGoogle Scholar
  13. Jorge Jiménez, Xianchun Wu, Angelo Pesce, and Adrian Jarabo. 2016. Practical real-time strategies for accurate indirect occlusion. SIGGRAPH 2016 Courses: Physically Based Shading in Theory and Practice (2016).Google ScholarGoogle Scholar
  14. Khronos Group. 2014. smoothstep - OpenGL 4 Reference Pages. https://www.khronos.org/registry/OpenGL-Refpages/gl4/html/smoothstep.xhtml Accessed: 2021-12-21.Google ScholarGoogle Scholar
  15. Frank L. Kooi and Alexander Toet. 2004. Visual comfort of binocular and 3D displays. Displays 25, 2 (2004), 99--108. https://doi.org/10.1016/j.displa.2004.07.004Google ScholarGoogle ScholarCross RefCross Ref
  16. Bradford James Loos and Peter-Pike Sloan. 2010. Volumetric Obscurance. In Proceedings of the 2010 ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '10). Association for Computing Machinery, 151--156. https://doi.org/10.1145/1730804.1730829Google ScholarGoogle Scholar
  17. Michael Mara, Morgan McGuire, Derek Nowrouzezahrai, and David Luebke. 2016. Deep G-Buffers for Stable Global Illumination Approximation. In Eurographics/ ACM SIGGRAPH Symposium on High Performance Graphics. The Eurographics Association. https://doi.org/10.2312/hpg.20161195Google ScholarGoogle Scholar
  18. Oliver Mattausch, Daniel Scherzer, and Michael Wimmer. 2010. High-Quality Screen-Space Ambient Occlusion using Temporal Coherence. Computer Graphics Forum. https://doi.org/10.1111/j.1467-8659.2010.01784.xGoogle ScholarGoogle Scholar
  19. Morgan McGuire. 2010. Ambient Occlusion Volumes (HPG '10). Eurographics Association, 47--56. https://doi.org/10.5555/1921479.1921488Google ScholarGoogle Scholar
  20. Morgan McGuire. 2017. Computer Graphics Archive. https://casual-effects.com/dataGoogle ScholarGoogle Scholar
  21. Morgan McGuire, Brian Osman, Michael Bukowski, and Padraic Hennessy. 2011. The alchemy screen-space ambient obscurance algorithm. In Proceedings of the ACM SIGGRAPH Symposium on High Performance Graphics. 25--32. https://doi.org/10.1145/2018323.2018327Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Martin Mittring. 2007. Finding Next Gen: CryEngine 2. In ACM SIGGRAPH 2007 Courses. Association for Computing Machinery, 97--121. https://doi.org/10.1145/1281500.1281671Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Diego Nehab, Pedro V. Sander, Jason Lawrence, Natalya Tatarchuk, and John R. Isidoro. 2007. Accelerating Real-Time Shading with Reverse Reprojection Caching. In Proceedings of the 22nd ACM SIGGRAPH/EUROGRAPHICS Symposium on Graphics Hardware (GH '07). Eurographics Association, 25--35. https://doi.org/10.5555/1280094.1280098Google ScholarGoogle Scholar
  24. Lesley Northam, Paul Asente, and Craig S. Kaplan. 2012. Consistent Stylization and Painterly Rendering of Stereoscopic 3D Images. In Proceedings of the Symposium on Non-Photorealistic Animation and Rendering (NPAR '12). Eurographics Association, 47--56. https://doi.org/10.5555/2330147.2330158Google ScholarGoogle Scholar
  25. NVIDIA. 2016. ShadowWorks. https://developer.nvidia.com/shadowworks Accessed: 2021-10-20.Google ScholarGoogle Scholar
  26. Perumaal Shanmugam and Okan Arikan. 2007. Hardware Accelerated Ambient Occlusion Techniques on GPUs. In Proceedings of the 2007 Symposium on Interactive 3D Graphics and Games (I3D '07). Association for Computing Machinery, 73--80. https://doi.org/10.1145/1230100.1230113Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Peiteng Shi, Markus Billeter, and Elmar Eisemann. 2020. SalientGaze: Saliency-based gaze correction in virtual reality. Computers & Graphics 91 (2020), 83--94. https://doi.org/10.1016/j.cag.2020.06.007Google ScholarGoogle ScholarCross RefCross Ref
  28. Vincent Sitzmann, Ana Serrano, Amy Pavel, Maneesh Agrawala, Diego Gutierrez, Belen Masia, and Gordon Wetzstein. 2018. Saliency in VR: How Do People Explore Virtual Environments? IEEE Transactions on Visualization and Computer Graphics 24, 4 (2018), 1633--1642. https://doi.org/10.1109/TVCG.2018.2793599Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kostas Vardis, Georgios Papaioannou, and Athanasios Gaitatzes. 2013. Multi-View Ambient Occlusion with Importance Sampling. In Proceedings of the ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games (I3D '13). Association for Computing Machinery, 111--118. https://doi.org/10.1145/2448196.2448214Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Luiz Velho and Jonas Gomes. 1995. Stochastic Screening Dithering with Adaptive Clustering. In Proceedings of the 22nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). Association for Computing Machinery, 273--276. https://doi.org/10.1145/218380.218452Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jop Vermeer, Leonardo Scandolo, and Elmar Eisemann. 2021. Stochastic-Depth Ambient Occlusion. Proc. ACM Comput. Graph. Interact. Tech. 4, 1, Article 3 (April 2021), 15 pages. https://doi.org/10.1145/3451268Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Martin Weier, Michael Stengel, Thorsten Roth, Piotr Didyk, Elmar Eisemann, Martin Eisemann, Steve Grogorick, André Hinkenjann, Ernst Kruijff, Marcus Magnor, Karol Myszkowski, and Philipp Slusallek. 2017. Perception-driven Accelerated Rendering. Computer Graphics Forum (2017). https://doi.org/10.1111/cgf.13150Google ScholarGoogle Scholar
  33. Sergey Zhukov, Andrei Iones, and Grigorij Kronin. 1998. An ambient light illumination model. In Eurographics Workshop on Rendering Techniques. Springer, 45--55. https://doi.org/10.1007/978-3-7091-6453-2_5Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Stereo-consistent screen-space ambient occlusion

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image Proceedings of the ACM on Computer Graphics and Interactive Techniques
      Proceedings of the ACM on Computer Graphics and Interactive Techniques  Volume 5, Issue 1
      May 2022
      252 pages
      EISSN:2577-6193
      DOI:10.1145/3535313
      Issue’s Table of Contents

      Copyright © 2022 Owner/Author

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 4 May 2022
      Published in pacmcgit Volume 5, Issue 1

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed
    • Article Metrics

      • Downloads (Last 12 months)98
      • Downloads (Last 6 weeks)6

      Other Metrics

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!