Abstract
We present a method for example-based texturing of triangular 3D meshes. Our algorithm maps a small 2D texture sample onto objects of arbitrary size in a seamless fashion, with no visible repetitions and low overall distortion. It requires minimal user interaction and can be applied to complex, multi-layered input materials that are not required to be tileable. Our framework integrates a patch-based approach with per-pixel compositing. To minimize visual artifacts, we run a three-level optimization that starts with a rigid alignment of texture patches (macro scale), then continues with non-rigid adjustments (meso scale) and finally performs pixel-level texture blending (micro scale). We demonstrate that the relevance of the three levels depends on the texture content and type (stochastic, structured, or anisotropic textures).
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
- Paul J. Besl and Neil D. McKay. 1992. A Method for Registration of 3-D Shapes. IEEE Trans. Pattern Anal. Mach. Intell. 14, 2 (Feb. 1992), 239--256.Google Scholar
Digital Library
- David Bommes, Marcel Campen, Hans-Christian Ebke, Pierre Alliez, and Leif Kobbelt. 2013. Integer-grid maps for reliable quad meshing. ACM Transactions on Graphics (TOG) 32, 4 (2013), 98.Google Scholar
Digital Library
- David Bommes, Henrik Zimmer, and Leif Kobbelt. 2009. Mixed-integer Quadrangulation. ACM Trans. Graph. 28, 3, Article 77 (July 2009), 10 pages.Google Scholar
Digital Library
- David Bommes, Henrik Zimmer, and Leif Kobbelt. 2010. Practical mixed-integer optimization for geometry processing. In International Conference on Curves and Surfaces. Springer, 193--206.Google Scholar
- Brent Burley. 2019. On Histogram-Preserving Blending for Randomized Texture Tiling. Journal of Computer Graphics Techniques (JCGT) 8, 4 (8 November 2019), 31--53.Google Scholar
- Marcel Campen, David Bommes, and Leif Kobbelt. 2015. Quantized global parametrization. ACM Transactions on Graphics (TOG) 34, 6 (2015), 192.Google Scholar
Digital Library
- Thomas Deliot and Eric Heitz. 2019. Procedural Stochastic Textures by Tiling and Blending. In GPU Zen 2: Advanced Rendering Techniques, W. Engel (Ed.). Black Cat Publishing Inc., 144 West D Street Suite 204, Encinitas, CA 92009, Chapter 2 in Part IV, 177--200.Google Scholar
- Yue Dong, Sylvain Lefebvre, Xin Tong, and George Drettakis. 2008. Lazy Solid Texture Synthesis. In Proceedings of the Nineteenth Eurographics Conference on Rendering (EGSR '08). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 1165--1174.Google Scholar
Digital Library
- Qiang. Du, Vance. Faber, and Max. Gunzburger. 1999. Centroidal Voronoi Tessellations: Applications and Algorithms. SIAM Rev. 41, 4 (1999), 637--676.Google Scholar
- Jérémie Dumas, An Lu, Sylvain Lefebvre, Jun Wu, and Christian Dick. 2015. By-example Synthesis of Structurally Sound Patterns. ACM Trans. Graph. 34, 4, Article 137 (July 2015), 12 pages.Google Scholar
Digital Library
- Alexei A. Efros and William T. Freeman. 2001. Image Quilting for Texture Synthesis and Transfer. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 341--346.Google Scholar
- Alexei A. Efros and Thomas K. Leung. 1999. Texture Synthesis by Non-Parametric Sampling. In Proceedings of the International Conference on Computer Vision-Volume 2 - Volume 2 (ICCV '99). IEEE Computer Society, Washington, DC, USA, 1033-.Google Scholar
Digital Library
- Martin A. Fischler and Robert C. Bolles. 1981. Random Sample Consensus: A Paradigm for Model Fitting with Applications to Image Analysis and Automated Cartography. Commun. ACM 24, 6 (June 1981), 381--395.Google Scholar
Digital Library
- Bruno Galerne, Ares Lagae, Sylvain Lefebvre, and George Drettakis. 2012. Gabor noise by example. ACM Transactions on Graphics (TOG) 31, 4 (2012), 73.Google Scholar
Digital Library
- Leon Gatys, Alexander S Ecker, and Matthias Bethge. 2015. Texture synthesis using convolutional neural networks. In Advances in neural information processing systems. 262--270.Google Scholar
- Guillaume Gilet, Basile Sauvage, Kenneth Vanhoey, Jean-Michel Dischler, and Djamchid Ghazanfarpour. 2014. Local random-phase noise for procedural texturing. ACM Transactions on Graphics (TOG) 33, 6 (2014), 195.Google Scholar
Digital Library
- Gabriele Gorla, Victoria Interrante, and Guillermo Sapiro. 2001. Growing fitted textures. SIGGRAPH 2001 Sketches and Applications (2001), 191.Google Scholar
- Gael Guennebaud, Benoît Jacob, et al. 2010. Eigen v3. http://eigen.tuxfamily.org.Google Scholar
- Jianwei Han, Kun Zhou, Li-Yi Wei, Minmin Gong, Hujun Bao, Xinming Zhang, and Baining Guo. 2006. Fast example-based surface texture synthesis via discrete optimization. The Visual Computer 22, 9-11 (2006), 918--925.Google Scholar
Digital Library
- Christopher G Harris, Mike Stephens, et al. 1988. A combined corner and edge detector.. In Alvey vision conference, Vol. 15. Citeseer, 10--5244.Google Scholar
- David J. Heeger and James R. Bergen. 1995. Pyramid-based Texture Analysis/Synthesis. In Proceedings of the 22Nd Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '95). ACM, New York, NY, USA, 229--238.Google Scholar
- Eric Heitz and Fabrice Neyret. 2018. High-Performance By-Example Noise Using a Histogram-Preserving Blending Operator. Proc. ACM Comput. Graph. Interact. Tech. 1, 2, Article 31 (Aug. 2018), 25 pages.Google Scholar
Digital Library
- Alec Jacobson, Daniele Panozzo, et al. 2018. libigl: A simple C++ geometry processing library. https://libigl.github.io/.Google Scholar
- Nikolay Jetchev, Urs Bergmann, and Roland Vollgraf. 2016. Texture synthesis with spatial generative adversarial networks. arXiv preprint arXiv:1611.08207 (2016).Google Scholar
- Jiaya Jia, Jian Sun, Chi-Keung Tang, and Heung-Yeung Shum. 2006. Drag-and-drop Pasting. ACM Trans. Graph. 25, 3 (July 2006), 631--637.Google Scholar
Digital Library
- Johannes Kopf, Chi-Wing Fu, Daniel Cohen-Or, Oliver Deussen, Dani Lischinski, and Tien-Tsin Wong. 2007. Solid Texture Synthesis from 2D Exemplars. ACM Trans. Graph. 26, 3, Article 2 (July 2007).Google Scholar
Digital Library
- Vivek Kwatra, Arno Schödl, Irfan Essa, Greg Turk, and Aaron Bobick. 2003. Graphcut textures: image and video synthesis using graph cuts. In ACM Transactions on Graphics (ToG), Vol. 22. ACM, 277--286.Google Scholar
Digital Library
- Ares Lagae, Peter Vangorp, Toon Lenaerts, and Philip Dutré. 2010. Procedural Isotropic Stochastic Textures by Example. Computers & Graphics (Special issue on Procedural Methods in Computer Graphics) 34, 4 (2010), 312--321.Google Scholar
- Anass Lasram and Sylvain Lefebvre. 2012. Parallel Patch-based Texture Synthesis. In Proceedings of the Fourth ACM SIGGRAPH/Eurographics Conference on High-Performance Graphics (EGGH-HPG'12). Eurographics Association, Goslar Germany, Germany, 115--124.Google Scholar
Digital Library
- Sylvain Lefebvre and Hugues Hoppe. 2005. Parallel Controllable Texture Synthesis. In ACM SIGGRAPH 2005 Papers (SIGGRAPH '05). ACM, New York, NY, USA, 777--786.Google Scholar
- Sylvain Lefebvre and Hugues Hoppe. 2006. Appearance-space Texture Synthesis. In ACM SIGGRAPH 2006 Papers (SIGGRAPH '06). ACM, New York, NY, USA, 541--548.Google Scholar
- Bruno Lévy, Sylvain Petitjean, Nicolas Ray, and Jérome Maillot. 2002. Least Squares Conformal Maps for Automatic Texture Atlas Generation. ACM Trans. Graph. 21, 3 (July 2002), 362--371.Google Scholar
Digital Library
- Andrew Nealen and Marc Alexa. 2003. Hybrid Texture Synthesis. In Proceedings of the 14th Eurographics Workshop on Rendering (EGRW '03). Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 97--105.Google Scholar
Digital Library
- Marcin Novotni, Reinhard Klein, et al. 2002. Computing geodesic distances on triangular meshes. In In Proc. of WSCG'2002.Google Scholar
- Patrick Pérez, Michel Gangnet, and Andrew Blake. 2003. Poisson Image Editing. ACM Trans. Graph. 22, 3 (July 2003), 313--318.Google Scholar
Digital Library
- Ken Perlin. 1985. An image synthesizer. ACM Siggraph Computer Graphics 19, 3 (1985), 287--296.Google Scholar
Digital Library
- Nico Pietroni, Paolo Cignoni, Miguel Otaduy, and Roberto Scopigno. 2010. Solid-texture synthesis: a survey. IEEE Computer Graphics and Applications 30, 4 (2010), 74--89.Google Scholar
Digital Library
- Javier Portilla and Eero P. Simoncelli. 2000. A Parametric Texture Model Based on Joint Statistics of Complex Wavelet Coefficients. International Journal of Computer Vision 40, 1 (01 Oct 2000), 49--70.Google Scholar
Digital Library
- Emil Praun, Adam Finkelstein, and Hugues Hoppe. 2000. Lapped Textures. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 465--470.Google Scholar
- Michael Rabinovich, Roi Poranne, Daniele Panozzo, and Olga Sorkine-Hornung. 2017. Scalable Locally Injective Mappings. ACM Trans. Graph. 36, 4, Article 37a (April 2017).Google Scholar
Digital Library
- Ryan Schmidt, Cindy Grimm, and Brian Wyvill. 2006. Interactive Decal Compositing with Discrete Exponential Maps. ACM Trans. Graph. 25, 3 (July 2006), 605--613.Google Scholar
Digital Library
- Stanford. 2020. The Stanford 3D Scanning Repository. http://www-graphics.stanford.edu/data/3Dscanrep/. Accessed: 2020-03-13.Google Scholar
- Textures.com. 2020. Textures for 3D, graphic design and Photoshop. https://www.textures.com/. Accessed: 2019-12--12.Google Scholar
- Thingiverse. 2011a. Ghost Model by navalguijo on Thingiverse. https://www.thingiverse.com/thing:12585 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2011b. Part of Sesame Street Sign Model by cptnAWESOME on Thingiverse. https://www.thingiverse.com/thing:14974 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2012. Anvil Model by WorksBySolo on Thingiverse. https://www.thingiverse.com/thing:31397 Accessed March 17, 2020.Google Scholar
- Thingiverse. 2015. Metatron/Entangled Model by bathsheba on Thingiverse. https://www.thingiverse.com/thing:1146870 Accessed March 17, 2020.Google Scholar
- Xin Tong, Jingdan Zhang, Ligang Liu, Xi Wang, Baining Guo, and Heung-Yeung Shum. 2002. Synthesis of Bidirectional Texture Functions on Arbitrary Surfaces. ACM Trans. Graph. 21, 3 (July 2002), 665--672.Google Scholar
Digital Library
- Greg Turk. 2001. Texture Synthesis on Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 347--354.Google Scholar
Digital Library
- Dmitry Ulyanov, Vadim Lebedev, Andrea Vedaldi, and Victor S Lempitsky. 2016. Texture Networks: Feed-forward Synthesis of Textures and Stylized Images.. In ICML, Vol. 1. 4.Google Scholar
- Li-Yi Wei, Sylvain Lefebvre, Vivek Kwatra, and Greg Turk. 2009. State of the art in example-based texture synthesis.Google Scholar
- Li-Yi Wei and Marc Levoy. 2000. Fast Texture Synthesis Using Tree-structured Vector Quantization. In Proceedings of the 27th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '00). ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 479--488.Google Scholar
Digital Library
- Li-Yi Wei and Marc Levoy. 2001. Texture Synthesis over Arbitrary Manifold Surfaces. In Proceedings of the 28th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH '01). ACM, New York, NY, USA, 355--360.Google Scholar
Digital Library
- Jingdan Zhang, Kun Zhou, Luiz Velho, Baining Guo, Heung-Yeung Shum, Heung-Yeung Shum, and Heung-Yeung Shum. 2003. Synthesis of Progressively-variant Textures on Arbitrary Surfaces. ACM Trans. Graph. 22, 3 (July 2003), 295--302.Google Scholar
Digital Library
Index Terms
A Three-Level Approach to Texture Mapping and Synthesis on 3D Surfaces
Recommendations
MIP-Map Level Selection for Texture Mapping
Texture mapping is a fundamental feature of computer graphics image generation. In current PC-based acceleration hardware, MIP-mapping with bilinear and trilinear filtering is a commonly used filtering technique for reducing spatial aliasing artifacts. ...
Synthesis of bidirectional texture functions on arbitrary surfaces
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniquesThe bidirectional texture function (BTF) is a 6D function that can describe textures arising from both spatially-variant surface reflectance and surface mesostructures. In this paper, we present an algorithm for synthesizing the BTF on an arbitrary ...
Synthesis and Rendering of Bidirectional Texture Functions on Arbitrary Surfaces
Abstract--The bidirectional texture function (BTF) is a 6D function that describes the appearance of a real-world surface as a function of lighting and viewing directions. The BTF can model the fine-scale shadows, occlusions, and specularities caused by ...






Comments