DAB: interactive haptic painting with 3D virtual brushes

ABSTRACT

We present a novel painting system with an intuitive haptic interface, which serves as an expressive vehicle for interactively creating painterly works. We introduce a deformable, 3D brush model, which gives the user natural control of complex brush strokes. The force feedback enhances the sense of realism and provides tactile cues that enable the user to better manipulate the paint brush. We have also developed a bidirectional, two-layer paint model that, combined with a palette interface, enables easy loading of complex blends onto our 3D virtual brushes to generate interesting paint effects on the canvas. The resulting system, DAB, provides the user with an artistic setting, which is conceptually equivalent to a real-world painting environment. Several users have tested DAB and were able to start creating original art work within minutes.

References

1. ABL95.M. Agrawala, A. Beers, and M. Levoy. 3D painting on scanned surfaces. In the Proc. of 1995 Symposium on Interactive 3D Graphics, pages 145- 150. ACM SIGGRAPH, April 1995.
2. BW98.D. Baraff and A. Witkin. Large steps in cloth simulation. Proc. of ACM SIGGRAPH, pages 43-54, 1998.
3. CAS+97.C. Curtis, S. Anderson, J. Seims, K. Fleischer, and D. Salesin. Computergenerated watercolor. Proc. of SIGGRAPH'97, pages 421-430, 1997.
4. COR00.COREL. Painter. http://newgraphics.corel.com/products/painter6.html, 2000.
5. CPE92.T. Cockshott, J. Patterson, and D. England. Modelling the texture of paint. Computer Graphics Forum (Eurographics'92 Proc.), 11(3):C217- C226, 1992.
6. DSB99.M. Desbrun, P. Schroder, and A. Barr. Interactive animation of structured deformable objects. Proc. of Graphics Interface'99, 1999.
7. GEL00.A. Gregory, S. Ehmann, and M. C. Lin. inTouch: Interactive multiresolution modeling and 3D painting with a haptic interface. Proc. of IEEE VR Conference, 2000.
8. HDD+94.H. Hoppe, T. DeRose, T. Duchamp, M. Halstead, H. Jin, J. McDonald, J. Schweitzer, and W. Stuetzle. Piecewise smooth surface reconstruction. In Proceedings of ACM SIGGRAPH, pages 295-302, 1994.
9. hem00.RIGHT hemisphere. Deep paint. http://www.us.deeppaint.com/, 2000.
10. Her98.A. Hertzmann. Painterly rendering with curved brush strokes of multiple sizes. Proc. of ACM SIGGRAPH'98, pages 453-460, 1998.
11. HH90.P. Hanrahan and P. Haeberli. Direct WYSIWYG painting and texturing on 3D shapes. In Computer Graphics (SIGGRAPH '90 Proceedings), volume 24, pages 215-223, August 1990.
12. JTK+99.D. Johnson, T. V. Thompson II, M. Kaplan, D. Nelson, and E. Cohen. Painting textures with a haptic interface. Proceedings of IEEE Virtual Reality Conference, 1999.
13. Lit97.P. Litwinowicz. Processing images and video for an impressionist effect. Proc. of SIGGRAPH'97, pages 407-414, 1997.
14. May70.R. Mayer. The Artist's Handbook of Materials and Techniques. The Viking Press, 1970.
15. Mei96.B. Meier. Painterly rendering for animation. In SIGGRAPH 96 Conference Proceedings, pages 477-484. August 1996.
16. Pix00.Pixologic. Z-brush. http://pixologic.com, 2000.
17. Smi78.Alvy Ray Smith. Paint. TM 7, NYIT Computer Graphics Lab, July 1978.
18. SN99.S. Saito and M. Nakajima. 3D physically based brush model for painting. SIGGRAPH99 Conference Abstracts and Applications, page 226, 1999.
19. Str86.S. Strassmann. Hairy brushes. Computer Graphics (SIGGRAPH'86 Proc.), 20:225-232, 1986.
20. WB97.A. Witkin and D. Baraff. Physically Based Modeling: Principles and Practice. ACM Press, 1997.
21. WI00.H. Wong and H. Ip. Virtual brush: A model-based synthesis of chinese calligraphy. Computers & Graphics, 24, 2000.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation

    • Shape modeling

• Theory of computation

  • Randomness, geometry and discrete structures

    • Computational geometry