skip to main content
research-article
Open Access

Efficiency-aware multiple importance sampling for bidirectional rendering algorithms

Published:22 July 2022Publication History
Skip Abstract Section

Abstract

Multiple importance sampling (MIS) is an indispensable tool in light-transport simulation. It enables robust Monte Carlo integration by combining samples from several techniques. However, it is well understood that such a combination is not always more efficient than using a single sampling technique. Thus a major criticism of complex combined estimators, such as bidirectional path tracing, is that they can be significantly less efficient on common scenes than simpler algorithms like forward path tracing. We propose a general method to improve MIS efficiency: By cheaply estimating the efficiencies of various technique and sample-count combinations, we can pick the best one. The key ingredient is a numerically robust and efficient scheme that uses the samples of one MIS combination to compute the efficiency of multiple other combinations. For example, we can run forward path tracing and use its samples to decide which subset of VCM to enable, and at what sampling rates. The sample count for each technique can be controlled per-pixel or globally. Applied to VCM, our approach enables robust rendering of complex scenes with caustics, without compromising efficiency on simpler scenes.

Skip Supplemental Material Section

Supplemental Material

3528223.3530126.mp4

References

  1. Attila T. Áfra. 2019. Intel® Open Image Denoise. https://www.openimagedenoise.org/.Google ScholarGoogle Scholar
  2. Iliyan Georgiev, Jaroslav Křivánek, Tomáš Davidovič, and Philipp Slusallek. 2012. Light transport simulation with vertex connection and merging. ACM Trans. Graph. 31, 6 (2012), 10 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Pascal Grittmann, Iliyan Georgiev, and Philipp Slusallek. 2021. Correlation-Aware Multiple Importance Sampling for Bidirectional Rendering Algorithms. Comput. Graph. Forum (EG 2021) 40, 2 (2021), 231--238.Google ScholarGoogle Scholar
  4. Pascal Grittmann, Iliyan Georgiev, Philipp Slusallek, and Jaroslav Křivánek. 2019. Variance-Aware Multiple Importance Sampling. ACM Trans. Graph. (SIGGRAPH Asia 2019) 38, 6 (Nov. 2019), 9 pages.Google ScholarGoogle Scholar
  5. Pascal Grittmann, Arsène Pérard-Gayot, Philipp Slusallek, and Jaroslav Křivánek. 2018. Efficient Caustic Rendering with Lightweight Photon Mapping. Comput. Graph. Forum (EGSR '18) 37, 4 (2018), 133--142.Google ScholarGoogle Scholar
  6. Pascal Grittmann, Ömercan Yazici, Iliyan Georgiev, and Philipp Slusallek. 2022. Implementation of Efficiency-Aware Multiple Importance Sampling for Bidirectional Rendering Algorithms. Google ScholarGoogle ScholarCross RefCross Ref
  7. Toshiya Hachisuka, Anton S Kaplanyan, and Carsten Dachsbacher. 2014. Multiplexed metropolis light transport. ACM Transactions on Graphics (TOG) 33, 4 (2014), 1--10.Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Toshiya Hachisuka, Jacopo Pantaleoni, and Henrik Wann Jensen. 2012. A path space extension for robust light transport simulation. ACM Trans. Graph. (TOG) 31, 6 (2012), 10 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Vlastimil Havran and Mateu Sbert. 2014. Optimal Combination of Techniques in Multiple Importance Sampling. In Proc. VRCAI '14 (Shenzhen, China). ACM, New York, NY, 141--150.Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hera Y. He and Art B. Owen. 2014. Optimal mixture weights in multiple importance sampling. Google ScholarGoogle ScholarCross RefCross Ref
  11. Henrik Wann Jensen. 1995. Importance driven path tracing using the photon map. In Eurographics Workshop on Rendering Techniques. Springer, 326--335.Google ScholarGoogle ScholarCross RefCross Ref
  12. Henrik Wann Jensen. 1996. Global illumination using photon maps. In Eurographics workshop on Rendering techniques. Springer, 21--30.Google ScholarGoogle ScholarCross RefCross Ref
  13. Ondřej Karlík, Martin Šik, Petr Vévoda, Tomáš Skřivan, and Jaroslav Křivánek. 2019. MIS Compensation: Optimizing Sampling Techniques in Multiple Importance Sampling. ACM Trans. Graph. (SIGGRAPH Asia '19) 38, 6 (2019), 12 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Csaba Kelemen, László Szirmay-Kalos, György Antal, and Ferenc Csonka. 2002. A simple and robust mutation strategy for the metropolis light transport algorithm. Comput. Graph. Forum 21, 3 (2002), 531--540.Google ScholarGoogle ScholarCross RefCross Ref
  15. Ivo Kondapaneni, Petr Vévoda, Pascal Grittmann, Tomáš Skřivan, Philipp Slusallek, and Jaroslav Křivánek. 2019. Optimal Multiple Importance Sampling. ACM Trans. Graph. (SIGGRAPH 2019) 38, 4 (July 2019), 14 pages.Google ScholarGoogle Scholar
  16. Jaroslav Křivánek, Christophe Chevallier, Vladimir Koylazov, Ondřej Karlíik, Henrik Wann Jensen, and Thomas Ludwig. 2018. Realistic Rendering in Architecture and Product Visualization. In ACM SIGGRAPH 2018 Courses. Article 10, 5 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Eric P. Lafortune and Yves D. Willems. 1993. Bi-Directional Path Tracing. 93 (Dec. 1993), 145--153.Google ScholarGoogle Scholar
  18. Heqi Lu, Romain Pacanowski, and Xavier Granier. 2013. Second-Order Approximation for Variance Reduction in Multiple Importance Sampling. Comput. Graph. Forum 32, 7 (2013), 131--136.Google ScholarGoogle ScholarCross RefCross Ref
  19. Thomas Müller. 2019. "Practical Path Guiding" in Production. In ACM SIGGRAPH Courses: Path Guiding in Production, Chapter 10 (Los Angeles, California). ACM, New York, NY, USA, 18:35--18:48. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. David Murray, Sofiane Benzait, Romain Pacanowski, and Xavier Granier. 2020. On Learning the Best Balancing Strategy. In Eurographics 2020, Vol. 20. 1--4.Google ScholarGoogle Scholar
  21. Kosuke Nabata, Kei Iwasaki, and Yoshinori Dobashi. 2020. Resampling-aware Weighting Functions for Bidirectional Path Tracing Using Multiple Light Sub-Paths. ACM Trans. Graph. (SIGGRAPH 2020) 39, 2 (2020), 1--11.Google ScholarGoogle Scholar
  22. Art Owen and Yi Zhou. 2000. Safe and Effective Importance Sampling. J. Amer. Statist. Assoc. 95, 449 (2000), 135--143.Google ScholarGoogle ScholarCross RefCross Ref
  23. Anthony Pajot, Loic Barthe, Mathias Paulin, and Pierre Poulin. 2010. Representativity for robust and adaptive multiple importance sampling. IEEE transactions on visualization and computer graphics 17, 8 (2010), 1108--1121.Google ScholarGoogle Scholar
  24. Stefan Popov, Ravi Ramamoorthi, Fredo Durand, and George Drettakis. 2015. Probabilistic connections for bidirectional path tracing. Comput. Graph. Forum 34, 4 (2015), 75--86.Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Alexander Rath, Pascal Grittmann, Sebastian Herholz, Petr Vévoda, Philipp Slusallek, and Jaroslav Křivánek. 2020. Variance-Aware Path Guiding. ACM Transactions on Graphics (Proceedings of SIGGRAPH 2020) 39, 4 (July 2020), 12 pages.Google ScholarGoogle Scholar
  26. Lukas Ruppert, Sebastian Herholz, and Hendrik PA Lensch. 2020. Robust fitting of parallax-aware mixtures for path guiding. ACM Transactions on Graphics (TOG) 39, 4 (2020), 15 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Mateu Sbert and Víctor Elvira. 2022. Generalizing the balance heuristic estimator in multiple importance sampling. Entropy 24, 2 (2022), 191.Google ScholarGoogle ScholarCross RefCross Ref
  28. Mateu Sbert and Vlastimil Havran. 2017. Adaptive multiple importance sampling for general functions. The Visual Computer 33, 6 (2017), 845--855.Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Mateu Sbert, Vlastimil Havran, and László Szirmay-Kalos. 2016. Variance Analysis of Multi-sample and One-sample Multiple Importance Sampling. In Computer Graphics Forum, Vol. 35. Wiley Online Library, 451--460.Google ScholarGoogle Scholar
  30. Mateu Sbert, Vlastimil Havran, and Laszlo Szirmay-Kalos. 2018a. Multiple importance sampling revisited: breaking the bounds. EURASIP Journal on Advances in Signal Processing 2018, 1 (2018), 1--15.Google ScholarGoogle ScholarCross RefCross Ref
  31. Mateu Sbert, Vlastimil Havran, and László Szirmay-Kalos. 2019. Optimal Deterministic Mixture Sampling.. In Eurographics (Short Papers). 73--76.Google ScholarGoogle Scholar
  32. Mateu Sbert, Vlastimil Havran, László Szirmay-Kalos, and Víctor Elvira. 2018b. Multiple importance sampling characterization by weighted mean invariance. The Visual Computer 34, 6 (2018), 843--852.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Martin Šik and Jaroslav Křivánek. 2018. Survey of Markov Chain Monte Carlo Methods in Light Transport Simulation. IEEE Transactions on Visualization and Computer Graphics 26, 4 (2018), 1821--1840.Google ScholarGoogle ScholarCross RefCross Ref
  34. Martin Šik and Jaroslav Křivánek. 2019. Implementing One-Click Caustics in Corona Renderer. (2019).Google ScholarGoogle Scholar
  35. Martin Šik, Hisanari Otsu, Toshiya Hachisuka, and Jaroslav Křivánek. 2016. Robust light transport simulation via metropolised bidirectional estimators. ACM Trans. Graph. (TOG) 35, 6 (2016), 245.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Eric Veach. 1997. Robust Monte Carlo methods for light transport simulation. Stanford University PhD thesis.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Eric Veach and Leonidas Guibas. 1995a. Bidirectional estimators for light transport. In Photorealistic Rendering Techniques. Springer, 145--167.Google ScholarGoogle Scholar
  38. Eric Veach and Leonidas J Guibas. 1995b. Optimally Combining Sampling Techniques for Monte Carlo Rendering. In SIGGRAPH '95. ACM, 419--428.Google ScholarGoogle Scholar
  39. Eric Veach and Leonidas J Guibas. 1997. Metropolis light transport. In Proceedings of the 24th annual conference on Computer graphics and interactive techniques. ACM Press/Addison-Wesley Publishing Co., 65--76.Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Jiří Vorba, Ondřej Karlík, Martin Šik, Tobias Ritschel, and Jaroslav Křivánek. 2014. On-line Learning of Parametric Mixture Models for Light Transport Simulation. ACM Trans. Graph. (Proceedings of SIGGRAPH 2014) 33, 4 (2014), 11 pages.Google ScholarGoogle Scholar
  41. Matthias Zwicker, Wojciech Jarosz, Jaakko Lehtinen, Bochang Moon, Ravi Ramamoorthi, Fabrice Rousselle, Pradeep Sen, Cyril Soler, and S-E Yoon. 2015. Recent advances in adaptive sampling and reconstruction for Monte Carlo rendering. Comput. Graph. Forum 34, 2 (2015), 667--681.Google ScholarGoogle ScholarCross RefCross Ref

Index Terms

  1. Efficiency-aware multiple importance sampling for bidirectional rendering algorithms

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Graphics
      ACM Transactions on Graphics  Volume 41, Issue 4
      July 2022
      1978 pages
      ISSN:0730-0301
      EISSN:1557-7368
      DOI:10.1145/3528223
      Issue’s Table of Contents

      Copyright © 2022 Owner/Author

      This work is licensed under a Creative Commons Attribution International 4.0 License.

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 22 July 2022
      Published in tog Volume 41, Issue 4

      Check for updates

      Qualifiers

      • research-article

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader