Abstract
Real-time adaptive sampling is a new technique recently proposed for efficient importance sampling in realtime Monte Carlo sampling in subsurface scattering. It adaptively places samples based on variance tracking to help escape the uncanny valley of subsurface rendering. However, the occasional performance drop due to temporal lighting dynamics (e.g., guns or lights turning on and off) could hinder adoption in games or other applications where smooth high frame rate is preferred. In this paper we propose a novel usage of Control Variates (CV) in the sample domain instead of shading domain to maintain a consistent low pass time. Our algorithm seamlessly reduces to diffuse with zero scattering samples for sub-pixel scattering. We propose a novel joint-optimization algorithm for sample count and CV coefficient estimation. The main enabler is our novel time-variant covariance updating method that helps remove the effect of recent temporal dynamics from variance tracking. Since bandwidth is critical in real-time rendering, a solution without adding any extra textures is also provided.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling
- Carol Alexander. 1999. Risk Management and Analysis. Volume 1: Measuring and Modelling Financial Risk.Google Scholar
- Brent Burley. 2015. Extending the Disney BRDF to a BSDF with integrated subsurface scattering. In SIGGRAPH Course: Physically Based Shading in Theory and Practice. ACM, New York, NY, 19 pages.Google Scholar
- Per H. Christensen and Brent Burley. 2015. Approximate Reflectance Profiles for Efficient Subsurface Scattering. Technical Report. Pixar.Google Scholar
- Holger Dammertz, Johannes Hanika, Alexander Keller, and Hendrik Lensch. 2010. A hierarchical automatic stopping condition for Monte Carlo global illumination. In Eurographics WSCG 2010: Full Paper Proceedings. Václav Skala-UNION Agency, 159--164.Google Scholar
- Eugene d'Eon and David Luebke. 2007. Advanced techniques for realistic real-time skin rendering. GPU Gems 3, 3 (2007), 293--347.Google Scholar
- Shaohua Fan, Stephen Chenney, Bo Hu, Kam-Wah Tsui, and Yu-chi Lai. 2006. Optimizing control variate estimators for rendering. Computer Graphics Forum 25, 3 (2006), 351--357.Google Scholar
Cross Ref
- Tony Finch. 2009. Incremental calculation of weighted mean and variance. University of Cambridge 4, 11--5 (2009), 41--42.Google Scholar
- Evgenii Golubev. 2018. Efficient screen-space subsurface scattering using Burley's normalized diffusion in real-time. In SIGGRAPH 2018 Courses: Advances in Real-Time Rendering.Google Scholar
- Till Guldimann, Peter Zangari, Jacques Longerstaey, John Matero, and Scott Howard. 1995. RiskMetrics Technical Document. Technical Report. Morgan Guaranty Trust Company.Google Scholar
- Timothy C Hesterberg and Barry L Nelson. 1998. Control variates for probability and quantile estimation. Management Science 44, 9 (1998), 1295--1312.Google Scholar
Digital Library
- Henrik Wann Jensen, Stephen R Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. In Proceedings of the 28th annual conference on Computer graphics and interactive techniques. ACM, New York, NY, 511--518.Google Scholar
Digital Library
- Jorge Jimenez, Veronica Sundstedt, and Diego Gutierrez. 2009. Screen-space perceptual rendering of human skin. ACM Transactions on Applied Perception (TAP) 6, 4 (2009), 23.Google Scholar
- Jorge Jimenez, Károly Zsolnai, Adrian Jarabo, Christian Freude, Thomas Auzinger, Xian-Chun Wu, Javier von der Pahlen, Michael Wimmer, and Diego Gutierrez. 2015. Separable Subsurface Scattering. Computer Graphics Forum 34, 6 (Sept. 2015), 188--197.Google Scholar
Digital Library
- David Kirk and James Arvo. 1991. Unbiased sampling techniques for image synthesis. ACM SIGGRAPH Computer Graphics 25, 4 (1991), 153--156.Google Scholar
Digital Library
- Ivo Kondapaneni, Petr Vévoda, Pascal Grittmann, Tomáš Skřivan, Philipp Slusallek, and Jaroslav Křivánek. 2019. Optimal multiple importance sampling. ACM Transactions on Graphics (TOG) 38, 4 (2019), 1--14.Google Scholar
Digital Library
- Stephen S Lavenberg, Thomas L Moeller, and Peter D Welch. 1982. Statistical results on control variables with application to queueing network simulation. Operations Research 30, 1 (1982), 182--202.Google Scholar
Digital Library
- Bochang Moon, Nathan Carr, and Sung-Eui Yoon. 2014. Adaptive rendering based on weighted local regression. ACM Transactions on Graphics (TOG) 33, 5 (2014), 1--14.Google Scholar
Digital Library
- Thomas Müller, Fabrice Rousselle, Alexander Keller, and Jan Novák. 2020. Neural Control Variates. ACM Trans. Graph. 39, 6, Article 243 (Dec. 2020), 19 pages. https://doi.org/10.1145/3414685.3417804Google Scholar
Digital Library
- Barry L Nelson. 1990. Control variate remedies. Operations Research 38, 6 (1990), 974--992.Google Scholar
Digital Library
- Jan Novák, Andrew Selle, and Wojciech Jarosz. 2014. Residual ratio tracking for estimating attenuation in participating media. ACM Trans. Graph. 33, 6 (2014), 179--1.Google Scholar
Digital Library
- Eric Penner and George Borshukov. 2011. Pre-integrated skin shading. GPU Pro 2 (2011), 41--55.Google Scholar
Cross Ref
- Matt Pharr, Wenzel Jakob, and Greg Humphreys. 2016. Physically based rendering: From theory to implementation. Morgan Kaufmann, Cambridge, MA.Google Scholar
- Brian D Ripley. 2009. Stochastic simulation. Vol. 316. John Wiley & Sons, New Jersey.Google Scholar
- Fabrice Rousselle, Wojciech Jarosz, and Jan Novák. 2016. Image-space control variates for rendering. ACM Transactions on Graphics (TOG) 35, 6 (2016), 1--12.Google Scholar
Digital Library
- László Szécsi, Mateu Sbert, and László Szirmay-Kalos. 2004. Combined correlated and importance sampling in direct light source computation and environment mapping. Computer Graphics Forum 23, 3 (2004), 585--593.Google Scholar
Cross Ref
- Ruey S Tsay. 2005. Analysis of financial time series. Vol. 543. John Wiley & Sons, New Jersey.Google Scholar
- Greg Welch, Gary Bishop, et al. 1995. An introduction to the Kalman filter.Google Scholar
- BP Welford. 1962. Note on a method for calculating corrected sums of squares and products. Technometrics 4, 3 (1962), 419--420.Google Scholar
Cross Ref
- Tiantian Xie, Marc Olano, Brian Karis, and Krzysztof Narkowicz. 2020. Real-time subsurface scattering with single pass variance-guided adaptive importance sampling. Proceedings of the ACM on Computer Graphics and Interactive Techniques 3, 1 (2020), 1--21.Google Scholar
Digital Library
Index Terms
Real-time Subsurface Control Variates: Temporally Stable Adaptive Sampling
Recommendations
Real-time subsurface scattering with single pass variance-guided adaptive importance sampling
In real-time applications, it is difficult to simulate realistic subsurface scattering with differing degrees translucency. Burley's reflectance approximation by empirically fitting the diffusion profile as a whole makes it possible to achieve realistic ...
Real-Time Realistic Rendering of Tissue Surface with Mucous Layer
IWCSE '09: Proceedings of the 2009 Second International Workshop on Computer Science and Engineering - Volume 01This paper deals with the rendering issues of producing a realistic surgery simulation in real-time. In general, the visual fidelity of the simulator determines the degree of realism experienced by users. On top of the tissue, there is a mucous layer ...
A fast translucency appearance model for real-time applications
SCCG '06: Proceedings of the 22nd Spring Conference on Computer GraphicsRealistic rendering of natural materials such as marble, jade, human skin, etc. requires the simulation of subsurface scattering of light. Such high-fidelity rendering, however, takes a significant amount of computation time, precluding its use in real-...






Comments