Mesh quilting for geometric texture synthesis

Abstract

We introduce mesh quilting, a geometric texture synthesis algorithm in which a 3D texture sample given in the form of a triangle mesh is seamlessly applied inside a thin shell around an arbitrary surface through local stitching and deformation. We show that such geometric textures allow interactive and versatile editing and animation, producing compelling visual effects that are difficult to achieve with traditional texturing methods. Unlike pixel-based image quilting, mesh quilting is based on stitching together 3D geometry elements. Our quilting algorithm finds corresponding geometry elements in adjacent texture patches, aligns elements through local deformation, and merges elements to seamlessly connect texture patches. For mesh quilting on curved surfaces, a critical issue is to reduce distortion of geometry elements inside the 3D space of the thin shell. To address this problem we introduce a low-distortion parameterization of the shell space so that geometry elements can be synthesized even on very curved objects without the visual distortion present in previous approaches. We demonstrate how mesh quilting can be used to generate convincing decorations for a wide range of geometric textures.

References

1. Bhat, P., Ingram, S., and Turk, G. 2004. Geometric texture synthesis by example. In Eurographics Symposium on Geometry Processing, 41--46.
2. Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Trans on Pattern Analysis and Machine Intelligence 23, 11, 1--18.
3. Desbrun, M., Meyer, M., and Alliez, P. 2002. Intrinsic parameterizations of surface meshes. In Eurographics, 209--218.
4. Dischler, J., Maritaud, K., Lévy, B., and Ghazanfarpour, D. 2002. Texture particles. Computer Graphics Forum 21, 3, 401--410.
5. Efros, A. A., and Freeman, W. T. 2001. Image quilting for texture synthesis and transfer. In Proceedings of SIGGRAPH 2001, 341--346.
6. Efros, A. A., and Leung, T. K. 1999. Texture synthesis by non-parametric sampling. In Proceedings of ICCV, 1033--1038.
7. Elber, G. 2005. Geometric texture modeling. IEEE Computer Graphics and Applications 25, 4, 66--76.
8. Fang, H., and Hart, J. C. 2004. Textureshop: texture synthesis as a photograph editing tool. ACM Transactions on Graphics 23, 3, 354--359.
9. Fleischer, K. W., Laidlaw, D. H., Currin, B. L., and Barr, A. H. 1995. Cellular texture generation. In Proceedings of SIGGRAPH 95, 239--248.
10. Kajiya, J. T., and Kay, T. L. 1989. Rendering fur with three dimensional textures. In Proceedings of SIGGRAPH 89, 271--280.
11. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3, 277--286.
12. Kwatra, V., Essa, I., Bobick, A. F., and Kwatra, N. 2005. Texture optimization for example-based synthesis. ACM Transactions on Graphics 23, 3, 795--802.
13. Lagae, A., Dumont, O., and Dutré, P. 2005. Geometry synthesis by example. In Shape Modeling International, 174--183.
14. Lefebvre, S., and Hoppe, H. 2005. Parallel controllable texture synthesis. ACM Transactions on Graphics 23, 3, 777--786.
15. Lévy, B., Petitjean, S., Ray, N., and Mallet, J.-L. 2002. Least squares con-formal maps for automatic texture atlas generation. In Proceedings of SIGGRAPH 2002, 362--371.
16. Liang, L., Liu, C., Xu, Y., Guo, B., and Shum, H.-Y. 2001. Real-time texture synthesis using patch-based sampling. ACM Transactions on Graphics 20, 3, 127--150.
17. Magda, S., and Kriegman, D. 2003. Fast texture synthesis on arbitrary meshes. In Eurographics Symposium on Rendering, 82--89.
18. Nealen, A., and Alexa, M. 2003. Hybrid texture synthesis. In Eurographics Symposium on Rendering, 97--105.
19. Neyret, F. 1998. Modeling, animating, and rendering complex scenes using volumetric textures. IEEE Transactions on Visualization and Computer Graphics 4, 1, 55--70.
20. Peachey, D. R. 1985. Solid texturing of complex surfaces. In Proceedings of SIGGRAPH 85, 279--286.
21. Peng, J., Kristjansson, D., and Zorin, D. 2004. Interactive modeling of topo-logically complex geometric detail. ACM Transactions on Graphics 23, 3, 635--643.
22. Perlin, K., and Hoffert, E. M. 1989. Hypertexture. In Proceedings of SIG-GRAPH 89, 253--262.
23. Perlin, K. 1985. An image synthesizer. In Proceedings of SIGGRAPH 85, 287--296.
24. Porumbescu, S. D., Budge, B., Feng, L., and Joy, K. I. 2005. Shell maps. ACM Transactions on Graphics 23, 3, 626--633.
25. Praun, E., Finkelstein, A., and Hoppe, H. 2000. Lapped textures. In Proceedings of SIGGRAPH 2000, 465--470.
26. Sander, P., Snyder, J., Gortler, S., and Hoppe, H. 2001. Texture mapping Progressive meshes. In Proceedings of SIGGRAPH 2001, 409--416.
27. Soler, C., Cani, M.-P., and Angelidis, A. 2002. Hierarchical pattern mapping. ACM Transactions on Graphics 21, 3, 673--680.
28. Sorkine, O., Lipman, Y., Cohen-Or, D., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In Eurographics Symposium on Geometry Processing, 179--188.
29. Tong, X., Zhang, J., Liu, L., Wang, X., Guo, B., and Shum, H.-Y. 2002. Synthesis of bidirectional texture functions on arbitrary surfaces. ACM Transactions on Graphics 21, 3, 665--672.
30. Turk, G. 2001. Texture synthesis on surfaces. In Proceedings of SIGGRAPH 2001, 347--354.
31. Wei, L.-Y., and Levoy, M. 2000. Fast texture synthesis using tree-structured vector quantization. In Proceedings of SIGGRAPH 2000, 479--488.
32. Wei, L.-Y., and Levoy, M. 2001. Texture synthesis over arbitrary manifold surfaces. In Proceedings of SIGGRAPH 2001, 355--360.
33. Wu, Q., and Yu, Y. 2004. Feature matching and deformation for texture synthesis. In Proceedings of SIGGRAPH 2004, 364--367.
34. Ying, L., Hertzmann, A., Biermann, H., and Zorin, D. 2001. Texture and shape synthesis on surfaces. In Proceedings of 12th Eurographics Workshop on Rendering, 301--312.
35. Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Shum, H.-Y. 2004. Mesh Editing With Poisson-Based Gradient Field Manipulation. ACM Transactions on Graphics 23, 3, 644--651.
36. Zelinka, S., and Garland, M. 2003. Interactive texture synthesis on surfaces using jump maps. In Eurographics Symposium on Rendering, 90--96.
37. Zhang, J., Zhou, K., Velho, L., Guo, B., and Shum, H.-Y. 2003. Synthesis of progressively variant textures on arbitrary surfaces. ACM Transactions on Graphics 22, 3, 295--302.
38. Zhou, K., Du, P., Wang, L., Matsushita, Y., Shi, J., Guo, B., and Shum, H.-Y. 2005. Decorating surfaces with bidirectional texture functions. IEEE Transactions on Visualization and Computer Graphics 11, 5, 519--528.

Index Terms

• Computing methodologies

  • Computer graphics

    • Animation

    • Image manipulation

      • Texturing

    • Shape modeling

• Theory of computation

  • Randomness, geometry and discrete structures