CrossShade: shading concept sketches using cross-section curves

Abstract

We facilitate the creation of 3D-looking shaded production drawings from concept sketches. The key to our approach is a class of commonly used construction curves known as cross-sections, that function as an aid to both sketch creation and viewer understanding of the depicted 3D shape. In particular, intersections of these curves, or cross-hairs, convey valuable 3D information, that viewers compose into a mental model of the overall sketch. We use the artist-drawn cross-sections to automatically infer the 3D normals across the sketch, enabling 3D-like rendering.

The technical contribution of our work is twofold. First, we distill artistic guidelines for drawing cross-sections and insights from perception literature to introduce an explicit mathematical formulation of the relationships between cross-section curves and the geometry they aim to convey. We then use these relationships to develop an algorithm for estimating a normal field from cross-section curve networks and other curves present in concept sketches. We validate our formulation and algorithm through a user study and a ground truth normal comparison. As demonstrated by the examples throughout the paper, these contributions enable us to shade a wide range of concept sketches with a variety of rendering styles.

References

1. Andre, A., and Saito, S. 2011. Single-view sketch based modeling. In Proc. Symp. on Sketch-Based Interfaces and Modeling.
2. Andre, A., Saito, S., and Nakajima, M. 2007. Crosssketch: freeform surface modeling with details. In Proc. Symp. on Sketch-Based Interfaces and Modeling, 45--52.
3. Bae, S., Balakrishnan, R., and Singh, K. 2008. ILoveSketch: as-natural-as-possible sketching system for creating 3d curve models. In Proc. User Interface Software and Technology.
4. Biard, L., Farouki, R. T., and Szafran, N. 2010. Construction of rational surface patches bounded by lines of curvature. Comput. Aided Geom. Des. 27, 359--371.
5. Cole, F., Sanik, K., DeCarlo, D., Finkelstein, A., Funkhouser, T., Rusinkiewicz, S., and Singh, M. 2009. How well do line drawings depict shape? ACM Trans. on Graph. (Proc. of SIGGRAPH) 28, 3.
6. Cook, R. 2008. Behind the scenes at pixar. In Keynote talk, Siggraph Asia.
7. Cooper, M. 2008. Line Drawing Interpretation. Springer.
8. do Carmo, M. P. 1976. Differential Geometry of Curves and Surfaces. Prentice-Hall, Englewood Cliffs, NJ.
9. Ecker, A., Kutulakos, K., and Jepson, A. 2007. Shape from planar curves: A linear escape from flatland. In IEEE Computer Vision and Pattern Recognition.
10. Eissen, K., and Steur, R. 2008. Sketching: Drawing Techniques for Product Designers. Bis Publishers.
11. Eissen, K., and Steur, R. 2011. Sketching: The Basics. Bis Publishers.
12. Farin, G., and Hansford, D. 1999. Discrete coons patches. Computer Aided Geometric Design 16 (August), 691--700.
13. Finch, M., Snyder, J., and Hoppe, H. 2011. Freeform vector graphics with controlled thin-plate splines. ACM Trans. on Graph. (Proc. SIGGRAPH Asia) 30.
14. Gangnet, M., Hervé, J.-C., Pudet, T., and van Thong, J.-M. 1989. Incremental computation of planar maps. SIGGRAPH 23 (July), 345--354.
15. Gingold, Y., Igarashi, T., and Zorin, D. 2009. Structured annotations for 2D-to-3D modeling. ACM Trans. on Graph. (Proc. SIGGRAPH Asia) 28, 5.
16. Gooch, A., Gooch, B., Shirley, P., and Cohen, E. 1998. A non-photorealistic lighting model for automatic technical illustration. SIGGRAPH, 447--452.
17. Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: a sketching interface for 3d freeform design. SIGGRAPH.
18. Johnston, S. F. 2002. Lumo: illumination for cel animation. In Proc. Symp. on Non-Photorealistic Animation and Rendering.
19. Joshi, P., and Carr, N. A. 2008. Repoussé: Automatic inflation of 2d artwork. In Proc. of Sketch Based Interfaces and Modeling.
20. Knill, D. C. 1992. Perception of surface contours and surface shape: from computation to psychophysics. Journal of Optical Society of America 9, 9, 1449--1464.
21. Koenderink, J. J., Doorn, A. J. V., and Kappers, A. M. L. 1992. Surface perception in pictures. Perception & Psychophysics, 487--496.
22. Lipson, H., and Shpitalni, M. 1996. Optimization-based reconstruction of a 3d object from a single freehand line drawing. Computer-Aided Design 28, 651--663.
23. Malik, J. 1987. Interpreting line drawings of curved objects. International Journal of Computer Vision 1, 1, 73--103.
24. Mamassian, P., and Landy, M. S. 1998. Observer biases in the 3D interpretation of line drawings. Vision research 38, 18, 2817--2832.
25. McCrae, J., Singh, K., and Mitra, N. J. 2011. Slices: A shape-proxy based on planar sections. ACM Trans. on Graph. (Proc. SIGGRAPH Asia) 30, 6.
26. Nasri, A., Sabin, M., and Yasseen, Z. 2009. Filling N -Sided Regions by Quad Meshes for Subdivision Surfaces. Computer Graphics Forum 28, 6 (Sept.), 1644--1658.
27. Nealen, A., Igarashi, T., Sorkine, O., and Alexa, M. 2007. Fibermesh: designing freeform surfaces with 3d curves. ACM Trans. on Graph. (Proc. SIGGRAPH) 26 (July).
28. Okabe, M., Zeng, G., Matsushita, Y., Igarashi, T., Quan, L., and yeung Shum, H. 2006. Single-view relighting with normal map painting. In Proc. Pacific Graphics, 27--34.
29. Olsen, L., Samavati, F., Sousa, M., and Jorge, J. 2009. Sketch-based modeling: A survey. Computers & Graphics 33.
30. Orzan, A., Bousseau, A., Winnemöller, H., Barla, P., Thollot, J., and Salesin, D. 2008. Diffusion curves: A vector representation for smooth-shaded images. ACM Trans. on Graph. (Proc. SIGGRAPH) 27.
31. Pipes, A. 2007. Drawing for Designers. Laurence King.
32. Robertson, S. 2003. How to Draw Cars the Hot Wheels Way. MBI.
33. Schmidt, R., Khan, A., Kurtenbach, G., and Singh, K. 2009. On expert performance in 3D curve-drawing tasks. In Proc. Symp. Sketch-Based Interfaces and Modeling.
34. Schmidt, R., Khan, A., Singh, K., and Kurtenbach, G. 2009. Analytic drawing of 3d scaffolds. ACM Trans. on Graph. (Proc. SIGGRAPH Asia) 28, 5.
35. Stevens, K. A. 1981. The visual interpretation of surface contours. Artificial Intelligence 17.
36. Sýkora, D., Dingliana, J., and Collins, S. 2009. Lazy-Brush: Flexible painting tool for hand-drawn cartoons. Computer Graphics Forum (Proc. EUROGRAPHICS) 28, 2.
37. Winnemöller, H., Orzan, A., Boissieux, L., and Thollot, J. 2009. Texture design and draping in 2d images. Computer Graphics Forum (Proc. Symp. on Rendering) 28, 4.
38. Wu, T.-P., Tang, C.-K., Brown, M. S., and Shum, H.-Y. 2007. Shapepalettes: interactive normal transfer via sketching. ACM Trans. on Graph. (Proc. of SIGGRAPH) 26.
39. Zhang, L., Dugas-Phocion, G., Samson, J.-S., and Seitz, S. M. 2002. Single view modeling of free-form scenes. In IEEE Computer Vision and Pattern Recognition, 990--997.

Index Terms

• Computing methodologies

  • Computer graphics

    • Shape modeling

• Theory of computation

  • Randomness, geometry and discrete structures

    • Computational geometry