Texture Generation

Image Analogies:
Texture Synthesis Papers:
Texture synthesis uses example textures to algorithmically generate more of the same texture.

Ashikhmin, M. "Synthesizing Natural Textures", 2001.
Since nearby pixels are often best, and a brute force search of the input image is slow, appropriate neighbors of previous candidate pixels are the only ones considered at each step. This significantly speeds up the algorithm and improves quality in some cases, but tends to have artifacts from pixels at the edge of the input image.

Wei and Levoy, Fast Texture Synthesis using Tree-structured Vector Quantization, SIGGRAPH 2000.
They use the concept of neighborhoods (the pixels surrounding the current pixel) to generate an arbitrary-sized texture based on an input sample texture. Starting from a random noise image, the texture is synthesized in scanline order by finding the pixel in the input image that has the most similar neighborhood to the current pixel neighborhood in the output image. Similarity is measured by the sum of squares of differences in the RGB colors. Using larger neighborhoods give fewer artifacts, but neighborhood size is proportional to running time. However, a pyramid scheme can be used to build the image up from low frequency patterns, which allows you to maintain quality and use smaller neighborhoods.


Sample texture

A tiled sample	A 5x5 neighborhood
A 9x9 Neighborhood	Using a 3-level image pyramid with 5x5 and 3x3 neighborhoods

And a nice big 512x512 texture:


NPR Paper references:
Pen & Ink

Kevin Buchin and Maike Walther. "Real-Time Per-Pixel Rendering With Stroke Textures". Proc. of Spring Conference on Computer Graphics 2003, ACM Press (to appear), 2003.

Kevin Buchin and Maike Walther. "Hatching, Stroke Styles & Pointillism", ShaderX2 - Shader Tips & Tricks, Wordware Publishing, Inc., 2003.

Nelson S.H. Chu and C.L. Tai. "An Efficient Brush Model for Physically-Based 3D Painting", Pacific Graphics, Beijing, October, 2002, pp.413-421.

Michael P. Salisbury, Michael T. Wong, John F. Hughes, and David H. Salesin. "Orientable Textures for Image-Based Pen-and-Ink Illustration", Proceedings of SIGGRAPH 97, in Computer Graphics Proceedings, Annual Conference Series, 401-406, August 1997.

George Winkenbach, David H. Salesin. "Rendering parametric surfaces in pen and ink". Proceedings of SIGGRAPH 96, in Computer Graphics Proceedings, Annual Conference Series, 469-476, August 1996.

Aaron Hertzmann, Denis Zorin. "Illustrating Smooth Surfaces" Proceedings of the 27th annual conference on Computer graphics and interactive techniques, 517-526 2000.

Example-based:

Drori, I.; Cohen-Or, D.; Yeshurun, H. "Example-based style synthesis". Computer Vision and Pattern Recognition, 2003. Proceedings. 2003 IEEE Computer Society Conference on Volume 2, 18-20 June 2003 Page(s):II - 143-50 vol.2.

Hashimoto, R.; Johan, H.; Nishita, T. "Creating various styles of animations using example-based filtering". Computer Graphics International, 2003. Proceedings 9-11 July 2003 Page(s):312 - 317

Yu Meng; Yan Zhang; Wenhui Li; Yunjie Pang. "Image analogy using patch-based texture synthesis". Communications, Circuits and Systems, 2004. ICCCAS 2004. 2004 International Conference on Volume 2, 27-29 June 2004 Page(s):974 - 978 Vol.2

Alexei A. Efros and William T. Freeman "Image Quilting for Texture Synthesis and Transfer". Proceedings of SIGGRAPH '01, Los Angeles, California, August, 2001.

Bin Wang, Wenping Wang, Huaiping Yang, Jiaguang Sun, "Efficient Example-Based Painting and Synthesis of 2D Directional Texture," IEEE Transactions on Visualization and Computer Graphics, vol. 10, no. 3, pp. 266-277, May/Jun, 2004.

"A fast algorithm for image analogy using particle swarm optimization" Yan Zhang; Yu Meng; Wen-Hui Li; Yun-Jie Pang; Machine Learning and Cybernetics, 2004. Proceedings of 2004 International Conference on Volume 7, 26-29 Aug. 2004 Page(s):4043 - 4048 vol.7

"Texturing and line art rendering using patch-based image analogies" Bao, P.; Xiaohu Ma; Multimedia Signal Processing, 2002 IEEE Workshop on 9-11 Dec. 2002 Page(s):142 - 148

Yanxi Liu, Wen-Chieh Lin, and James H. Hays. "Near-Regular Texture Analysis and Manipulation". ACM Transactions on Graphics (SIGGRAPH 2004), 23(3), August 2004.

Noah Snavely, C. Lawrence Zitnick, Sing Bing Kang, Michael Cohen. "Stylizing 2.5D video". In Proc. Symposium on Non-Photorealistic Animation and Rendering (NPAR) 2006, pages 63-69.

Aaron Hertzmann, Nuria Oliver, Brian Curless, and Steven M. Seitz. "Curve Analogies". 13th Eurographics Workshop on Rendering, Pisa, Italy, June 26-28, 2002.