Geometry-aware scattering compensation for 3D printing

Abstract

Commercially available full-color 3D printing allows for detailed control of material deposition in a volume, but an exact reproduction of a target surface appearance is hampered by the strong subsurface scattering that causes nontrivial volumetric cross-talk at the print surface. Previous work showed how an iterative optimization scheme based on accumulating absorptive materials at the surface can be used to find a volumetric distribution of print materials that closely approximates a given target appearance.

In this work, we first revisit the assumption that pushing the absorptive materials to the surface results in minimal volumetric cross-talk. We design a full-fledged optimization on a small domain for this task and confirm this previously reported heuristic. Then, we extend the above approach that is critically limited to color reproduction on planar surfaces, to arbitrary 3D shapes. Our method enables high-fidelity color texture reproduction on 3D prints by effectively compensating for internal light scattering within arbitrarily shaped objects. In addition, we propose a content-aware gamut mapping that significantly improves color reproduction for the pathological case of thin geometric features. Using a wide range of sample objects with complex textures and geometries, we demonstrate color reproduction whose fidelity is superior to state-of-the-art drivers for color 3D printers.

References

1. Vahid Babaei, Kiril Vidimče, Michael Foshey, Alexandre Kaspar, Piotr Didyk, and Wojciech Matusik. 2017. Color Contoning for 3D Printing. ACM Trans. Graph. 36, 4, Article 124 (July 2017), 15 pages.
2. Mary Ann Branch, Thomas F Coleman, and Yuying Li. 1999. A subspace, interior, and conjugate gradient method for large-scale bound-constrained minimization problems. SIAM Journal on Scientific Computing 21, 1 (1999), 1--23.
3. Alan Brunton, Can Ates Arikan, Tejas Madan Tanksale, and Philipp Urban. 2018. 3D Printing Spatially Varying Color and Translucency. ACM Trans. Graph. 37, 4, Article 157 (July 2018), 13 pages.
4. Alan Brunton, Can Ates Arikan, and Philipp Urban. 2015. Pushing the Limits of 3D Color Printing: Error Diffusion with Translucent Materials. ACM Trans. Graph. 35, 1, Article 4 (Dec. 2015), 13 pages.
5. Brent Burley, David Adler, Matt Jen-Yuan Chiang, Hank Driskill, Ralf Habel, Patrick Kelly, Peter Kutz, Yining Karl Li, and Daniel Teece. 2018. The Design and Evolution of Disney's Hyperion Renderer. ACM Trans. Graph. 37, 3, Article 33 (July 2018), 22 pages.
6. Desai Chen, David I. W. Levin, Piotr Didyk, Pitchaya Sitthi-Amorn, and Wojciech Matusik. 2013. Spec2Fab: A Reducer-tuner Model for Translating Specifications to 3D Prints. ACM Trans. Graph. 32, 4, Article 135 (July 2013), 10 pages.
7. Per H. Christensen. 2015. An Approximate Reflectance Profile for Efficient Subsurface Scattering. In ACM SIGGRAPH 2015 Talks (SIGGRAPH '15). ACM, New York, NY, USA, Article 25, 1 pages.
8. Paolo Cignoni, Enrico Gobbetti, Ruggero Pintus, and Roberto Scopigno. 2008. Color Enhancement for Rapid Prototyping. In VAST: International Symposium on Virtual Reality, Archaeology and Intelligent Cultural Heritage.
9. Eugene D'Eon and Geoffrey Irving. 2011. A Quantized-diffusion Model for Rendering Translucent Materials. ACM Trans. Graph. 30, 4, Article 56, 14 pages.
10. Yue Dong, Jiaping Wang, Fabio Pellacini, Xin Tong, and Baining Guo. 2010. Fabricating Spatially-varying Subsurface Scattering. ACM Trans. Graph. 29, 4, Article 62 (July 2010), 10 pages.
11. Craig Donner, Tim Weyrich, Eugene d'Eon, Ravi Ramamoorthi, and Szymon Rusinkiewicz. 2008. A Layered, Heterogeneous Reflectance Model for Acquiring and Rendering Human Skin. ACM Trans. Graph. 27, 5, Article 140, 12 pages.
12. Oskar Elek, Denis Sumin, Ran Zhang, Tim Weyrich, Karol Myszkowski, Bernd Bickel, Alexander Wilkie, and Jaroslav Křivánek. 2017. Scattering-aware Texture Reproduction for 3D Printing. ACM Trans. Graph. 36, 6, Article 241 (Nov. 2017), 15 pages.
13. Robert W. Floyd and Louis Steinberg. 1976. An Adaptive Algorithm for Spatial Greyscale. In Proceedings of Society for Information Displays, Vol. 17. 75--77.
14. I. Gkioulekas, A. Levin, and T. Zickler. 2016. An evaluation of computational imaging techniques for heterogeneous inverse scattering. In European Conference on Computer Vision (ECCV '16).
15. Ioannis Gkioulekas, Shuang Zhao, Kavita Bala, Todd Zickler, and Anat Levin. 2013. Inverse Volume Rendering with Material Dictionaries. ACM Trans. Graph. 32, 6, Article 162 (Nov. 2013), 13 pages.
16. Miloš Hašan, Martin Fuchs, Wojciech Matusik, Hanspeter Pfister, and Szymon Rusinkiewicz. 2010. Physical Reproduction of Materials with Specified Subsurface Scattering. ACM Trans. Graph. 29, 4, Article 61 (July 2010), 10 pages.
17. Milovš Hašan and Ravi Ramamoorthi. 2013. Interactive Albedo Editing in Path-traced Volumetric Materials. ACM Trans. Graph. 32, 2, Article 11 (April 2013), 11 pages.
18. Philipp Herholz, Sebastian Koch, Tamy Boubekeur, and Marc Alexa. 2017. Unsharp masking geometry improves 3D prints. Computers & Graphics 66 (2017), 135--142.
19. Roger David Hersch and Frédérique Crété. 2005. Improving the Yule-Nielsen modified Neugebauer model by dot surface coverages depending on the ink superposition conditions. In Electronic Imaging 2005. International Society for Optics and Photonics, 434--447.
20. Wenzel Jakob. 2010. Mitsuba renderer. http://www.mitsuba-renderer.org.
21. Henrik Wann Jensen, Stephen R Marschner, Marc Levoy, and Pat Hanrahan. 2001. A practical model for subsurface light transport. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques. ACM, 511--518.
22. Yanxiang Lan, Yue Dong, Fabio Pellacini, and Xin Tong. 2013. Bi-scale Appearance Fabrication. ACM Trans. Graph. 32, 4, Article 145 (July 2013), 12 pages.
23. Wojciech Matusik, Boris Ajdin, Jinwei Gu, Jason Lawrence, Hendrik P. A. Lensch, Fabio Pellacini, and Szymon Rusinkiewicz. 2009. Printing Spatially-varying Reflectance. ACM Trans. Graph. 28, 5, Article 128 (Dec. 2009), 9 pages.
24. Mimaki. 2017. Mimaki 3D printer. https://mimaki.com/special/3d_print/. {Online; Accessed 2019-04-25}.
25. Ján Morovic and M Ronnier Luo. 2001. The fundamentals of gamut mapping: A survey. Journal of Imaging Science and Technology 45, 3 (2001), 283--290.
26. Ken Museth. 2013. VDB: High-resolution Sparse Volumes with Dynamic Topology. ACM Trans. Graph. 32, 3, Article 27 (July 2013), 22 pages.
27. Marios Papas, Christian Regg, Wojciech Jarosz, Bernd Bickel, Philip Jackson, Wojciech Matusik, Steve Marschner, and Markus Gross. 2013. Fabricating Translucent Materials Using Continuous Pigment Mixtures. ACM Trans. Graph. 32, 4, Article 146 (July 2013), 12 pages.
28. Ruggero Pintus, Enrico Gobbetti, Paolo Cignoni, and Roberto Scopigno. 2010. Shape enhancement for rapid prototyping. The Visual Computer 26, 6--8 (2010), 831--840.
29. Geoffrey L Rogers. 1997. Optical dot gain in a halftone print. Journal of Imaging Science and Technology 41, 6 (1997), 643--656.
30. Romain Rossier. 2013. Framework for printing with daylight fluorescent inks. (2013).
31. FR Ruckdeschel and OG Hauser. 1978. Yule-Nielsen effect in printing: a physical analysis. Applied Optics 17, 21 (1978), 3376--3383.
32. SciPy. 2008. scipy.optimize.least_squares SciPy Reference Guide. https://docs.scipy.org/doc/scipy/reference/generated/scipy.optimize.least_squares.html. {Online; Accessed 2019-01-10}.
33. Liang Shi, Vahid Babaei, Changil Kim, Michael Foshey, Yuanming Hu, Pitchaya Sitthi-Amorn, Szymon Rusinkiewicz, and Wojciech Matusik. 2018. Deep Multispectral Painting Reproduction via Multi-layer, Custom-ink Printing. ACM Trans. Graph. 37, 6, Article 271 (Dec. 2018), 15 pages.
34. Pitchaya Sitthi-Amorn, Javier E. Ramos, Yuwang Wangy, Joyce Kwan, Justin Lan, Wenshou Wang, and Wojciech Matusik. 2015. MultiFab: A Machine Vision Assisted Platform for Multi-material 3D Printing. ACM Trans. Graph. 34, 4, Article 129 (July 2015), 11 pages.
35. Stratasys. 2016. Stratasys J750 the ultimate full-color multi-material 3D printer. https://www.stratasys.com/3d-printers/j735-j750. {Online; Accessed 2019-04-25}.
36. Jiaping Wang, Shuang Zhao, Xin Tong, Stephen Lin, Zhouchen Lin, Yue Dong, Baining Guo, and Heung-Yeung Shum. 2008. Modeling and Rendering of Heterogeneous Translucent Materials Using the Diffusion Equation. ACM Trans. Graph. 27, 1, Article 9 (March 2008), 18 pages.
37. Tim Weyrich, Pieter Peers, Wojciech Matusik, and Szymon Rusinkiewicz. 2009. Fabricating Microgeometry for Custom Surface Reflectance. ACM Trans. Graph. 28, 3, Article 32 (July 2009), 6 pages.
38. Günter Wyszecki and Walter Stanley Stiles. 1982. Color science: concepts and methods, quantitative data and formulae. Wiley. 168--169 pages.
39. Shuang Zhao, Lifan Wu, Frédo Durand, and Ravi Ramamoorthi. 2016. Downsampling Scattering Parameters for Rendering Anisotropic Media. ACM Trans. Graph. 35, 6, Article 166 (Nov. 2016), 11 pages.

Index Terms

• Applied computing

  • Operations research

    • Computer-aided manufacturing

• Computing methodologies

  • Computer graphics

    • Rendering

      • Reflectance modeling

    • Shape modeling

      • Volumetric models