Accurate appearance preserving prefiltering for rendering displacement-mapped surfaces

Abstract

Prefiltering the reflectance of a displacement-mapped surface while preserving its overall appearance is challenging, as smoothing a displacement map causes complex changes of illumination effects such as shadowing-masking and interreflection. In this paper, we introduce a new method that prefilters displacement maps and BRDFs jointly and constructs SVBRDFs at reduced resolutions. These SVBRDFs preserve the appearance of the input models by capturing both shadowing-masking and interreflection effects. To express our appearance-preserving SVBRDFs efficiently, we leverage a new representation that involves spatially varying NDFs and a novel scaling function that accurately captures micro-scale changes of shadowing, masking, and interreflection effects. Further, we show that the 6D scaling function can be factorized into a 2D function of surface location and a 4D function of direction. By exploiting the smoothness of these functions, we develop a simple and efficient factorization method that does not require computing the full scaling function. The resulting functions can be represented at low resolutions (e.g., 4² for the spatial function and 15⁴ for the angular function), leading to minimal additional storage. Our method generalizes well to different types of geometries beyond Gaussian surfaces. Models prefiltered using our approach at different scales can be combined to form mipmaps, allowing accurate and anti-aliased level-of-detail (LoD) rendering.

References

1. Michael Ashikmin, Simon Premože, and Peter Shirley. 2000. A microfacet-based BRDF generator. SIGGRAPH (2000), 65--74.
2. Eric Bruneton and Fabrice Neyret. 2012. A survey of nonlinear prefiltering methods for efficient and accurate surface shading. IEEE Transactions on Visualization and Computer Graphics 18, 2 (2012), 242--260.
3. Brian Cabral, Nelson Max, and Rebecca Springmeyer. 1987. Bidirectional reflection functions from surface bump maps. SIGGRAPH (1987), 273--281.
4. Xavier Chermain, Frédéric Claux, and Stéphane Mérillou. 2018. A microfacet-based BRDF for the accurate and efficient rendering of high-definition specular normal maps. The Visual Computer (2018).
5. Petrik Clarberg, Wojciech Jarosz, Tomas Akenine-Möller, and Henrik Wann Jensen. 2005. Wavelet Importance Sampling: Efficiently Evaluating Products of Complex Functions. ACM Trans. Graph. 24, 3 (2005), 1166--1175.
6. Robert L Cook and Kenneth E. Torrance. 1982. A reflectance model for computer graphics. SIGGRAPH (1982), 7--24.
7. Kristin J Dana, Bram Van Ginneken, Shree K Nayar, and Jan J Koenderink. 1999. Reflectance and texture of real-world surfaces. ACM Trans. Graph. 18, 1 (1999), 1--34.
8. Jonathan Dupuy, Eric Heitz, Jean-Claude Iehl, Pierre Poulin, Fabrice Neyret, and Victor Ostromoukhov. 2013. Linear efficient antialiased displacement and reflectance mapping. ACM Trans. Graph. 32, 6 (2013), 211:1--211:11.
9. Alain Fournier. 1992. Normal Distribution Functions and Multiple Surfaces. (1992).
10. Ioannis Gkioulekas, Anat Levin, and Todd Zickler. 2016. An evaluation of computational imaging techniques for heterogeneous inverse scattering. In European Conference on Computer Vision. 685--701.
11. Ioannis Gkioulekas, Shuang Zhao, Kavita Bala, Todd Zickler, and Anat Levin. 2013. Inverse Volume Rendering with Material Dictionaries. ACM Trans. Graph. 32, 6 (2013), 162:1--162:13.
12. Charles Han, Bo Sun, Ravi Ramamoorthi, and Eitan Grinspun. 2007. Frequency Domain Normal Map Filtering. ACM Trans. Graph. 26, 3 (2007), 28:1--28:12.
13. Milovš Hašan and Ravi Ramamoorthi. 2013. Interactive Albedo Editing in Path-traced Volumetric Materials. ACM Trans. Graph. 32, 2 (2013), 11:1--11:11.
14. Wolfgang Heidrich, Katja Daubert, Jan Kautz, and Hans-Peter Seidel. 2000. Illuminating micro geometry based on precomputed visibility. SIGGRAPH (2000), 455--464.
15. Eric Heitz. 2014. Understanding the masking-shadowing function in microfacet-based BRDFs. Journal of Computer Graphics Techniques 3, 2 (2014), 32--91.
16. Eric Heitz, Jonathan Dupuy, Cyril Crassin, and Carsten Dachsbacher. 2015. The SGGX Microflake Distribution. ACM Trans. Graph. 34, 4 (2015), 48:1--48:11.
17. Eric Heitz, Johannes Hanika, Eugene d'Eon, and Carsten Dachsbacher. 2016. Multiple-scattering microfacet BSDFs with the Smith model. ACM Trans. Graph. 35, 4 (2016), 58:1--58:14.
18. Sebastian Herholz, Oskar Elek, Jiří Vorba, Hendrik Lensch, and Jaroslav Křivánek. 2016. Product importance sampling for light transport path guiding. Computer Graphics Forum 35, 4 (2016), 67--77.
19. Homan Igehy. 1999. Tracing Ray Differentials. SIGGRAPH (1999), 179--186.
20. Kei Iwasaki, Yoshinori Dobashi, and Tomoyuki Nishita. 2012. Interactive bi-scale editing of highly glossy materials. ACM Trans. Graph. 31, 6 (2012), 144:1--144:7.
21. Wenzel Jakob. 2010. Mitsuba renderer. http://www.mitsuba-renderer.org.
22. Wenzel Jakob, Miloš Hašan, Ling-Qi Yan, Jason Lawrence, Ravi Ramamoorthi, and Steve Marschner. 2014. Discrete Stochastic Microfacet Models. ACM Trans. Graph. 33, 4 (2014), 115:1--115:10.
23. Adrian Jarabo, Hongzhi Wu, Julie Dorsey, Holly Rushmeier, and Diego Gutierrez. 2014. Effects of Approximate Filtering on the Appearance of Bidirectional Texture Functions. IEEE Transactions on Visualization and Computer Graphics (2014), 880--892.
24. Anton S Kaplanyan, Stephen Hill, Anjul Patney, and Aaron E Lefohn. 2016. Filtering distributions of normals for shading antialiasing.. In High Performance Graphics. 151--162.
25. Pramook Khungurn, Daniel Schroeder, Shuang Zhao, Kavita Bala, and Steve Marschner. 2015. Matching Real Fabrics with Micro-Appearance Models. ACM Trans. Graph. 35, 1 (2015), 1:1--1:26.
26. Joo Ho Lee, Adrian Jarabo, Daniel S. Jeon, Diego Gutierrez, and Min H. Kim. 2018. Practical Multiple Scattering for Rough Surfaces. ACM Trans. Graph. 37, 6 (2018), 275:1--275:12.
27. Xinhao Liu, Mitsuru Tanaka, and Masatoshi Okutomi. 2012. Noise level estimation using weak textured patches of a single noisy image. In IEEE International Conference on Image Processing (ICIP) 2012. 665--668.
28. Guillaume Loubet and Fabrice Neyret. 2017. Hybrid mesh-volume LoDs for all-scale pre-filtering of complex 3D assets. Computer Graphics Forum 36, 2 (2017), 431--442.
29. Wan-Chun Ma, Sung-Hsiang Chao, Yu-Ting Tseng, Yung-Yu Chuang, Chun-Fa Chang, Bing-Yu Chen, and Ming Ouhyoung. 2005. Level-of-detail representation of bidirectional texture functions for real-time rendering. Proceedings of the 2005 symposium on Interactive 3D graphics and games (2005), 187--194.
30. Derek Nowrouzezahrai and John Snyder. 2009. Fast global illumination on dynamic height fields. Computer Graphics Forum 28, 4 (2009), 1131--1139.
31. Marc Olano and Dan Baker. 2010. LEAN mapping. Proceedings of the 2010 ACM SIGGRAPH symposium on Interactive 3D Graphics and Games (2010), 181--188.
32. Michael Oren and Shree K Nayar. 1994. Generalization of Lambert's reflectance model. SIGGRAPH (1994), 239--246.
33. Serban D Porumbescu, Brian Budge, Louis Feng, and Kenneth I Joy. 2005. Shell maps. ACM Trans. Graph. 24, 3 (2005), 626--633.
34. Peter Shirley and Kenneth Chiu. 1997. A low distortion map between disk and square. Journal of Graphics Tools 2, 3 (1997), 45--52.
35. B Smith. 1967. Geometrical shadowing of a random rough surface. IEEE transactions on antennas and propagation 15, 5 (1967), 668--671.
36. John Snyder and Derek Nowrouzezahrai. 2008. Fast Soft Self-Shadowing on Dynamic Height Fields. Computer Graphics Forum 27, 4 (2008), 1275--1283.
37. Ping Tan, Stephen Lin, Long Quan, Baining Guo, and Harry Shum. 2008. Filtering and rendering of resolution-dependent reflectance models. IEEE Transactions on Visualization and Computer Graphics 14, 2 (2008), 412--425.
38. Ping Tan, Stephen Lin, Long Quan, Baining Guo, and Heung-Yeung Shum. 2005. Multiresolution Reflectance Filtering. Rendering Techniques (2005), 111--116.
39. Ville Timonen and Jan Westerholm. 2010. Scalable Height Field Self-Shadowing. Computer Graphics Forum 29, 2 (2010), 723--731.
40. Michael Toksvig. 2005. Mipmapping normal maps. Journal of Graphics Tools 10, 3 (2005), 65--71.
41. Eric Veach. 1997. Robust monte carlo methods for light transport simulation. Stanford University PhD thesis (1997).
42. Bruce Walter, Stephen R Marschner, Hongsong Li, and Kenneth E Torrance. 2007. Microfacet models for refraction through rough surfaces. Proceedings of the 18th Eurographics conference on Rendering Techniques, 195--206.
43. Stephen H. Westin, James R. Arvo, and Kenneth E. Torrance. 1992. Predicting Reflectance Functions from Complex Surfaces. SIGGRAPH (1992), 255--264.
44. Hongzhi Wu, Julie Dorsey, and Holly Rushmeier. 2009. Characteristic point maps. Computer Graphics Forum 28, 4 (2009), 1227--1236.
45. Hongzhi Wu, Julie Dorsey, and Holly Rushmeier. 2011. Physically-based interactive bi-scale material design. ACM Trans. Graph. 30, 6 (2011), 145:1--145:10.
46. Feng Xie and Pat Hanrahan. 2018. Multiple Scattering from Distributions of Specular V-grooves. ACM Trans. Graph. 37, 6 (2018), 276:1--276:14.
47. Chao Xu, Rui Wang, Shuang Zhao, and Hujun Bao. 2017. Real-Time Linear BRDF MIP-Mapping. Computer Graphics Forum 36, 4 (2017), 27--34.
48. Kun Xu, Wei-Lun Sun, Zhao Dong, Dan-Yong Zhao, Run-Dong Wu, and Shi-Min Hu. 2013. Anisotropic spherical gaussians. ACM Trans. Graph. 32, 6 (2013), 209:1--209:11.
49. Ling-Qi Yan, Miloš Hašan, Wenzel Jakob, Jason Lawrence, Steve Marschner, and Ravi Ramamoorthi. 2014. Rendering Glints on High-Resolution Normal-Mapped Specular Surfaces. ACM Trans. Graph. 33, 4 (2014), 116:1--116:9.
50. Ling-Qi Yan, Miloš Hašan, Steve Marschner, and Ravi Ramamoorthi. 2016. Position-Normal Distributions for Efficient Rendering of Specular Microstructure. ACM Trans. Graph. 35, 4 (2016), 56:1--56:9.
51. Shuang Zhao, Wenzel Jakob, Steve Marschner, and Kavita Bala. 2011. Building Volumetric Appearance Models of Fabric Using Micro CT Imaging. ACM Trans. Graph. 30, 4 (2011), 44:1--44:10.
52. Shuang Zhao, Lifan Wu, Frédo Durand, and Ravi Ramamoorthi. 2016. Downsampling scattering parameters for rendering anisotropic media. ACM Trans. Graph. 35, 6 (2016), 116:1--116:9.
53. Tobias Zirr and Anton S Kaplanyan. 2016. Real-time rendering of procedural multiscale materials. In Proceedings of the 20th ACM SIGGRAPH Symposium on Interactive 3D Graphics and Games. 139--148.

Index Terms

• Computing methodologies

  • Computer graphics

    • Rendering