Alexei A. Efros
William T. Freeman
ABSTRACT
We present a simple image-based method of generating novel visual appearance in which a new image is synthesized by stitching together small patches of existing images. We call this process image quilting. First, we use quilting as a fast and very simple texture synthesis algorithm which produces surprisingly good results for a wide range of textures. Second, we extend the algorithm to perform texture transfer — rendering an object with a texture taken from a different object. More generally, we demonstrate how an image can be re-rendered in the style of a different image. The method works directly on the images and does not require 3D information.
- 1.M. Ashikhmin. Synthesizing natural textures. In Symposium on Interactive 3D Graphics, 2001. Google Scholar
Digital Library
- 2.J. Bergen and E. Adelson. Early vision and texture perception. Nature, 333:363- 364, 1988.Google ScholarCross Ref
- 3.J. S. De Bonet. Multiresolution sampling procedure for analysis and synthesis of texture images. In SIGGRAPH 97, pages 361-368, 1997. Google ScholarDigital Library
- 4.C. J. Curtis, S. E. Anderson, J. E. Seims, Kurt W. Fleisher, and D. H. Salsin. Computer-generated watercolor. In SIGGRAPH 97, pages 421-430, 1997. Google ScholarDigital Library
- 5.J. Davis. Mosaics of scenes with moving objects. In Proc. IEEE Conf. on Comp. Vision and Patt. Recog., 1998. Google ScholarDigital Library
- 6.A. A. Efros and T. K. Leung. Texture synthesis by non-parametric sampling. In International Conference on Computer Vision, pages 1033-1038, Corfu, Greece, September 1999. Google ScholarDigital Library
- 7.D.D.Garber.Computational Models for Texture Analysis and Texture Synthesis. PhD thesis, University of Southern California, Image Processing Institute, 1981. Google ScholarDigital Library
- 8.J. J. Gibson. The Perception of the Visual World. Houghton Mifflin, Boston, Massachusetts, 1950.Google Scholar
- 9.P. Harrison. A non-hierarchical procedure for re-synthesis of complex textures. In WSCG '2001 Conference proceedings, pages 190-197, 2001. See also http://www.csse.monash.edu.au/~pfh/resynthesizer/.Google Scholar
- 10.David J. Heeger and James R. Bergen. Pyramid-based texture analysis/synthesis. In SIGGRAPH 95, pages 229-238, 1995. Google ScholarDigital Library
- 11.A. Hertzmann, C.E. Jacobs, N. Oliver, B. Curless, and D.H. Salesin. Image analogies. In SIGGRAPH 01, 2001. Google ScholarDigital Library
- 12.Bela Julesz. Visual pattern discrimination. IRE Transactions on Information Theory, 8(2):84-92, 1962.Google ScholarCross Ref
- 13.L. Liang, C. Liu, , Y. Xu, B. Guo, and H.-Y. Shum. Real-time texture synthesis by patch-based sampling. Technical Report MSR-TR-2001-40, Microsoft Research, March 2001.Google Scholar
- 14.J. Malik and P. Perona. Preattentive texture discrimination with early vision mechanism. JOSA-A, 5(5):923-932, May 1990.Google ScholarCross Ref
- 15.V. Ostromoukhov and R. D. Hersch. Multi-color and artistic dithering. In SIG- GRAPH 99, pages 425-432, 1999. Google ScholarDigital Library
- 16.Kris Popat and Rosalind W. Picard. Novel cluster-based probability model for texture synthesis, classification, and compression. In Proc. SPIE Visual Comm. and Image Processing, 1993.Google ScholarCross Ref
- 17.J. Portilla and E. P. Simoncelli. A parametric texture model based on joint statistics of complex wavelet coefficients. International Journal of Computer Vision, 40(1):49-71, December 2000. Google ScholarDigital Library
- 18.Emil Praun, Adam Finkelstein, and Hugues Hoppe. Lapped textures. In SIG- GRAPH 00, pages 465-470, 2000. Google ScholarDigital Library
- 19.M. P. Salisbury, M. T. Wong, J. F. Hughes, and D. H. Salesin. Orientable textures for image-based pen-and-ink illustration. In SIGGRAPH 97, 1997. Google ScholarDigital Library
- 20.Li-Yi Wei and Marc Levoy. Fast texture synthesis using tree-structured vector quantization. In SIGGRAPH 00, pages 479-488, 2000. Google ScholarDigital Library
- 21.Y. Xu, B. Guo, and H.-Y. Shum. Chaos mosaic: Fast and memory efficient texture synthesis. Technical Report MSR-TR-2000-32, Microsoft Research, April 2000.Google Scholar
- 22.Song Chun Zhu, Yingnian Wu, and David Mumford. Filters, random fields and maximum entropy (frame). International Journal of Computer Vision, 27(2):1- 20, March/April 1998. Google ScholarDigital Library
Index Terms
Image quilting for texture synthesis and transfer
Recommendations
Image Quilting for Texture Synthesis and Transfer
Seminal Graphics Papers: Pushing the Boundaries, Volume 2We present a simple image-based method of generating novel visual appearance in which a new image is synthesized by stitching together small patches of existing images. We call this process image quilting. First, we use quilting as a fast and very ...
Synthesis of bidirectional texture functions on arbitrary surfaces
SIGGRAPH '02: Proceedings of the 29th annual conference on Computer graphics and interactive techniquesThe bidirectional texture function (BTF) is a 6D function that can describe textures arising from both spatially-variant surface reflectance and surface mesostructures. In this paper, we present an algorithm for synthesizing the BTF on an arbitrary ...
Synthesis and Rendering of Bidirectional Texture Functions on Arbitrary Surfaces
Abstract--The bidirectional texture function (BTF) is a 6D function that describes the appearance of a real-world surface as a function of lighting and viewing directions. The BTF can model the fine-scale shadows, occlusions, and specularities caused by ...
Comments