SmoothSketch: 3D free-form shapes from complex sketches

Abstract

We introduce SmoothSketch---a system for inferring plausible 3D free-form shapes from visible-contour sketches. In our system, a user's sketch need not be a simple closed curve as in Igarashi's Teddy [1999], but may have cusps and T-junctions, i.e., endpoints of hidden parts of the contour. We follow a process suggested by Williams [1994] for inferring a smooth solid shape from its visible contours: completion of hidden contours, topological shape reconstruction, and smoothly embedding the shape via relaxation. Our main contribution is a practical method to go from a contour drawing to a fairly smooth surface with that drawing as its visible contour. In doing so, we make several technical contributions: • extending Williams' and Mumford's work [Mumford 1994] on figural completion of hidden contours containing T-junctions to contours containing cusps as well, • characterizing a class of visible-contour drawings for which inflation can be proved possible, • finding a topological embedding of the combinatorial surface that Williams creates from the figural completion, and • creating a fairly smooth solid shape by smoothing the topological embedding using a mass-spring system.We handle many kinds of drawings (including objects with holes), and the generated shapes are plausible interpretations of the sketches. The method can be incorporated into any sketch-based free-form modeling interface like Teddy.

References

1. Alexe, A., Barthe, L., Cani, M.-P., and Gaildrat, V. 2005. Shape modeling by sketching using convolution surfaces. In Pacific Graphics, Short paper.]]
2. Bourguignon, D., Cani, M.-P., and Drettakis, G. 2001. Drawing for illustration and annotation in 3D. Computer Graphics Forum 20, 3, 114--122.]]
3. Gibson, S., and Mirtich, B. 1997. A survey of deformable modeling in computer graphics. Tech. Rep. TR-97-19, Mitsubishi Electric Research Lab., Cambridge, MA.]]
4. Grenander, U. 1981. Lectures in Pattern Theory, vol. 1--3. Springer-Verlag.]]
5. Griffiths, H. B. 1981. Surfaces. Cambridge University Press.]]
6. Guillemin, V., and Pollack, A. 1974. Differential Topology. Prentice Hall.]]
7. Hoffman, D. D. 2000. Visual Intelligence: How We Create What We See. W. W. Norton.]]
8. Huffman, D. A. 1971. Impossible objects as nonsense sentences. In Machine Intelligence 6, B. Meltzer and D. Michie, Eds. American Elsevier Publishing Co., New York.]]
9. Igarashi, T., and Hughes, J. F. 2003. Smooth meshes for sketch-based freeform modeling. In Symposium on Interactive 3D Graphics, 139--142.]]
10. Igarashi, T., Matsuoka, S., and Tanaka, H. 1999. Teddy: A sketching interface for 3D freeform design. In Proceedings of SIGGRAPH 99, 409--416.]]
11. Johnston, S. F. 2002. Lumo: illumination for cel animation. In Proceedings of the Symposium on Non-photorealistic animation and rendering, 45--52.]]
12. Kanizsa, G. 1979. Organization in vision. Praeger, New York.]]
13. Karpenko, O., and Hughes, J. 2005. Inferring 3d free-form shapes from contour drawings. In Siggraph 2005 Sketches Program.]]
14. Karpenko, O., Hughes, J., and Raskar, R. 2002. Free-form sketching with variational implicit surfaces. In Eurographics Computer Graphics Forum, vol. 21/3, 585--594.]]
15. Kho, Y., and Garland, M. 2005. Sketching mesh deformations. In Symposium on Interactive 3D Graphics and Games 2005, 147--154.]]
16. Kobbelt, L. P., Bareuther, T., and Seidel, H.-P. 2000. Multiresolution shape deformations for meshes with dynamic vertex connectivity. Computer Graphics Forum 19, 3.]]
17. Koenderink, J. J. 1990. Solid Shape. MIT Press.]]
18. Lipson, H., and Shpitalni, M. 1997. Conceptual design and analysis by sketching. In AIEDAM-97, vol. 14, 391--401.]]
19. Mumford, D. 1994. Elastica and computer vision. In Algebraic Geometry and Its Applications, C. L. Bajaj, Ed. Springer-Verlag New York Inc.]]
20. Nealen, A., Sorkine, O., Alexa, M., and Cohen-Or, D. 2005. A sketch-based interface for detail-preserving mesh editing. ACM SIGGRAPH Transactions on Graphics, 1142--1147.]]
21. Nitzberg, M., Mumford, D., and Shiota, T. 1993. Filtering, Segmentation, and Depth. Springer-Verlag.]]
22. Pentland, A., and Kuo, J. 1989. The artist at the interface. Tech. Rep. 114, MIT Media Lab.]]
23. Pereira, J. P., Branco, V. A., Jorge, J. A., Silva, N. F., Cardoso, T. D., and Ferreira, F. N. 2004. Cascading recognizers for ambiguous calligraphic interaction. In Eurographics Workshop on Sketch-Based Interfaces and Modeling.]]
24. Schmidt, R., Wyvill, B., Sousa, M. C., and Jorge, J. A. 2005. Shapeshop: Sketch-based solid modeling with blobtrees. In Eurographics Workshop on Sketch-Based Interfaces and Modeling, 53--62.]]
25. Shesh, A., and Chen, B. 2004. Smartpaper: An interactive and user-friendly sketching system. In Eurographics Computer Graphics Forum, vol. 23/3, 301--310.]]
26. Shewchuk, J. R. 1996. Triangle: Engineering a 2D Quality Mesh Generator and Delaunay Triangulator. In Applied Computational Geometry: Towards Geometric Engineering, M. C. Lin and D. Manocha, Eds., vol. 1148. May.]]
27. Sketchup. SketchUp software: 3D sketching software for the conceptual phases of design. http://www.sketchup.com.]]
28. Taubin, G. 1995. A signal processing approach to fair surface design. Computer Graphics 29, Annual Conference Series, 351--358.]]
29. Taubin, G. 2001. Linear anisotropic mesh filtering. Tech. Rep. RC-22213, IBM Research.]]
30. Tolba, O., Dorsey, J., and Mcmillan, L. 2001. A projective drawing system. In 2001 ACM Symposium on Interactive 3D Graphics, 25--34.]]
31. Ulupinar, F., and Nevatia, R. 1993. Perception of 3D surfaces from 2D contours. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 15/1, 3--18.]]
32. Ulupinar, F., and Nevatia, R. 1995. Shape from contour: Straight homogeneous generalized cylinders and constant section generalized cylinders. In IEEE Transactions on Pattern Analysis and Machine Intelligence, vol. 17/2, 120--135.]]
33. Williams, L. R., and Jacobs, D. W. 1997. Stochastic Completion Fields: A Neural Model of Illusory Contour Shape and Salience. In Neural Computation, vol. 9/4, 837--858.]]
34. Williams, L. R. 1994. Perceptual Completion of Occluded Surfaces. PhD thesis, University of Massachusetts.]]
35. Williams, L. R. 1997. Topological reconstruction of a smooth manifold-solid from its occluding contour. Intl. Journal of Computer Vision 23, 1, 93--108.]]
36. Witkin, A. P. 1980. Shape from contour. PhD thesis, MIT.]]
37. Zeleznik, R. C., Herndon, K., and Hughes, J. 1996. Sketch: An Interface for Sketching 3D Scenes. In Proceedings of SIGGRAPH 96, 163--170.]]

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Shape inference

      • Computer vision representations

        • Shape representations

  • Computer graphics

    • Shape modeling

• Software and its engineering

  • Software notations and tools

    • Development frameworks and environments

      • Application specific development environments