skip to main content
research-article

Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling

Authors Info & Claims
Published:28 April 2021Publication History
Skip Abstract Section

Abstract

Real-time adaptive sampling is a new technique recently proposed for efficient importance sampling in realtime Monte Carlo sampling in subsurface scattering. It adaptively places samples based on variance tracking to help escape the uncanny valley of subsurface rendering. However, the occasional performance drop due to temporal lighting dynamics (e.g., guns or lights turning on and off) could hinder adoption in games or other applications where smooth high frame rate is preferred. In this paper we propose a novel usage of Control Variates (CV) in the sample domain instead of shading domain to maintain a consistent low pass time. Our algorithm seamlessly reduces to diffuse with zero scattering samples for sub-pixel scattering. We propose a novel joint-optimization algorithm for sample count and CV coefficient estimation. The main enabler is our novel time-variant covariance updating method that helps remove the effect of recent temporal dynamics from variance tracking. Since bandwidth is critical in real-time rendering, a solution without adding any extra textures is also provided.

Skip Supplemental Material Section

Supplemental Material

References

  1. Carol Alexander. 1999. Risk Management and Analysis. Volume 1: Measuring and Modelling Financial Risk.Google ScholarGoogle Scholar
  2. Brent Burley. 2015. Extending the Disney BRDF to a BSDF with integrated subsurface scattering. In SIGGRAPH Course: Physically Based Shading in Theory and Practice. ACM, New York, NY, 19 pages.Google ScholarGoogle Scholar
  3. Per H. Christensen and Brent Burley. 2015. Approximate Reflectance Profiles for Efficient Subsurface Scattering. Technical Report. Pixar.Google ScholarGoogle Scholar
  4. Holger Dammertz, Johannes Hanika, Alexander Keller, and Hendrik Lensch. 2010. A hierarchical automatic stopping condition for Monte Carlo global illumination. In Eurographics WSCG 2010: Full Paper Proceedings. Václav Skala-UNION Agency, 159--164.Google ScholarGoogle Scholar
  5. Eugene d'Eon and David Luebke. 2007. Advanced techniques for realistic real-time skin rendering. GPU Gems 3, 3 (2007), 293--347.Google ScholarGoogle Scholar
  6. Shaohua Fan, Stephen Chenney, Bo Hu, Kam-Wah Tsui, and Yu-chi Lai. 2006. Optimizing control variate estimators for rendering. Computer Graphics Forum 25, 3 (2006), 351--357.Google ScholarGoogle ScholarCross RefCross Ref
  7. Tony Finch. 2009. Incremental calculation of weighted mean and variance. University of Cambridge 4, 11--5 (2009), 41--42.Google ScholarGoogle Scholar
  8. Evgenii Golubev. 2018. Efficient screen-space subsurface scattering using Burley's normalized diffusion in real-time. In SIGGRAPH 2018 Courses: Advances in Real-Time Rendering.Google ScholarGoogle Scholar
  9. Till Guldimann, Peter Zangari, Jacques Longerstaey, John Matero, and Scott Howard. 1995. RiskMetrics Technical Document. Technical Report. Morgan Guaranty Trust Company.Google ScholarGoogle Scholar
  10. Timothy C Hesterberg and Barry L Nelson. 1998. Control variates for probability and quantile estimation. Management Science 44, 9 (1998), 1295--1312.Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Henrik Wann Jensen, Stephen R Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, 511--518.Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Jorge Jimenez, Veronica Sundstedt, and Diego Gutierrez. 2009. Screen-space perceptual rendering of human skin. ACM Transactions on Applied Perception (TAP) 6, 4 (2009), 23.Google ScholarGoogle Scholar
  13. Jorge Jimenez, Károly Zsolnai, Adrian Jarabo, Christian Freude, Thomas Auzinger, Xian-Chun Wu, Javier von der Pahlen, Michael Wimmer, and Diego Gutierrez. 2015. Separable Subsurface Scattering. Computer Graphics Forum 34, 6 (Sept. 2015), 188--197.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. David Kirk and James Arvo. 1991. Unbiased sampling techniques for image synthesis. ACM SIGGRAPH Computer Graphics 25, 4 (1991), 153--156.Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Ivo Kondapaneni, Petr Vévoda, Pascal Grittmann, Tomáš Skřivan, Philipp Slusallek, and Jaroslav Křivánek. 2019. Optimal multiple importance sampling. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Stephen S Lavenberg, Thomas L Moeller, and Peter D Welch. 1982. Statistical results on control variables with application to queueing network simulation. Operations Research 30, 1 (1982), 182--202.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Bochang Moon, Nathan Carr, and Sung-Eui Yoon. 2014. Adaptive rendering based on weighted local regression. ACM Transactions on Graphics (TOG) 33, 5 (2014), 1--14.Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Thomas Müller, Fabrice Rousselle, Alexander Keller, and Jan Novák. 2020. Neural Control Variates. ACM Trans. Graph. 39, 6, Article 243 (Dec. 2020), 19 pages. https://doi.org/10.1145/3414685.3417804Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Barry L Nelson. 1990. Control variate remedies. Operations Research 38, 6 (1990), 974--992.Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Jan Novák, Andrew Selle, and Wojciech Jarosz. 2014. Residual ratio tracking for estimating attenuation in participating media. ACM Trans. Graph. 33, 6 (2014), 179--1.Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Eric Penner and George Borshukov. 2011. Pre-integrated skin shading. GPU Pro 2 (2011), 41--55.Google ScholarGoogle ScholarCross RefCross Ref
  22. Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically based rendering: From theory to implementation. Morgan Kaufmann, Cambridge, MA.Google ScholarGoogle Scholar
  23. Brian D Ripley. 2009. Stochastic simulation. Vol. 316. John Wiley & Sons, New Jersey.Google ScholarGoogle Scholar
  24. Fabrice Rousselle, Wojciech Jarosz, and Jan Novák. 2016. Image-space control variates for rendering. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1--12.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. László Szécsi, Mateu Sbert, and László Szirmay-Kalos. 2004. Combined correlated and importance sampling in direct light source computation and environment mapping. Computer Graphics Forum 23, 3 (2004), 585--593.Google ScholarGoogle ScholarCross RefCross Ref
  26. Ruey S Tsay. 2005. Analysis of financial time series. Vol. 543. John Wiley & Sons, New Jersey.Google ScholarGoogle Scholar
  27. Greg Welch, Gary Bishop, et al. 1995. An introduction to the Kalman filter.Google ScholarGoogle Scholar
  28. BP Welford. 1962. Note on a method for calculating corrected sums of squares and products. Technometrics 4, 3 (1962), 419--420.Google ScholarGoogle ScholarCross RefCross Ref
  29. Tiantian Xie, Marc Olano, Brian Karis, and Krzysztof Narkowicz. 2020. Real-time subsurface scattering with single pass variance-guided adaptive importance sampling. Proceedings of the ACM on Computer Graphics and Interactive Techniques 3, 1 (2020), 1--21.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Article Metrics

          • Downloads (Last 12 months)9
          • Downloads (Last 6 weeks)1

          Other Metrics

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!