Editing arbitrarily deforming surface animations

Abstract

Deforming surfaces, such as cloth, can be generated through physical simulation, morphing, and even video capture. Such data is currently very difficult to alter after the generation process is complete, and data generated for one purpose generally cannot be adapted to other uses. Such adaptation would be extremely useful, however. Being able to take cloth captured from a flapping flag and attach it to a character to make a cape, or enhance the wrinkles on a simulated garment, would greatly enhance the usability and re-usability of deforming surface data. In addition, it is often necessary to cleanup or "tweak" simulation results. Doing this by editing each frame individually is a very time consuming and tedious process. Extensive research has investigated how to edit and re-use skeletal motion capture data, but very little has addressed completely non-rigid deforming surfaces. We have developed a novel method that now makes it easy to edit such arbitrary deforming surfaces. Our system enables global signal processing, direct manipulation, multiresolution embossing, and constraint editing on arbitrarily deforming surfaces, such as simulated cloth, motion-captured cloth, morphs, and other animations. The foundation of our method is a novel time-varying multiresolution transform, which adapts to the changing geometry of the surface in a temporally coherent manner.

References

1. Alexa, M., and Müller, W. 2000. Representing animations by principal components. In Proc. Eurographics.
2. Baraff, D., Witkin, A., and Kass, M. 2003. Untangling cloth. ACM Trans. Graph. 22, 3, 862--870.
3. Botsch, M., and Kobbelt, L. 2003. Multiresolution surface representation based on displacement volumes. Comput. Graph. Forum 22, 3, 483--492.
4. Bridson, R., Marino, S., and Fedkiw, R. 2003. Simulation of clothing with folds and wrinkles. In SCA 2003, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 28--36.
5. Bruderlin, A., and Williams, L. 1995. Motion signal processing. In SIGGRAPH 1995, ACM Press, New York, NY, USA, 97--104.
6. Burt, P. J., and Adelson, E. H. 1987. The laplacian pyramid as a compact image code. IEEE Trans. on Communications, 671--679.
7. Choi, K.-J., and Ko, H.-S. 2002. Stable but responsive cloth. In SIGGRAPH 2002, ACM Press, New York. NY, USA, 604--611.
8. Cohen-Steiner, D., Alliez, P., and Desburn, M. 2004. Variational shape approximation. ACM Trans. Graph. 23, 3, 905--914.
9. Dey, T. K., Edelsbrunner, H., Guha, S., and Nekhayev, D. V. 1999. Topology preserving edge contraction. Publ. Inst. Math. (Beograd) (N.S.) 66, 23--45.
10. Garland, M., and Heckbert, P. S. 1997. Surface simplification using quadric error metrics. In SIGGRAPH 1997, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 209--216.
11. Garland, M., and Zhou, Y. 2005. Quadric-based simplification in any dimension. ACM Trans. Graph. 24, 2, 209--239.
12. Gleicher, M. 1997. Motion editing with spacetime constraints. In Symposium on Interactive 3D Graphics, ACM Press, New York, NY, USA, 139-ff.
13. Gleicher, M. 2001. Motion path editing. In Symposium on Interactive 3D Graphics, ACM Press, New York, NY, USA, 195--202.
14. Guskov, I., and Khodakovsky, A. 2004. Wavelet compression of parametrically coherent mesh sequences. In SCA 2004, ACM Press, New York, NY, USA, 183--192.
15. Guskov, I., Sweldens, W., and Schröder, P. 1999. Multiresolution signal processing for meshes. In SIGGRAPH 1999, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 325--334.
16. Guskov, I., Klibanov, S., and Bryant, B. 2003. Trackable surfaces. In SCA 2003, Eurographics Association, Aire-la-Ville, Switzerland, Switzerland, 251--257.
17. Hoppe, H. 1996. Progressive meshes. In SIGGRAPH 1996, ACM Press, New York, NY, USA, 99--108.
18. James, D. L., and Twigg, C. D. 2005. Skinning mesh animations. ACM Trans. Graph. 24, 3, 399--407.
19. Karni, Z., and Gotsman, C. 2004. Compression of soft-body animation sequences. Computers & Graphics 28, 1, 25--34.
20. Kernighan, B. W., and Lin, S. 1970. An efficient heuristic for partitioning graphs. Bell Systems Tech. J. 49 (Feb.), 291--308.
21. Kircher, S., and Garland, M. 2005. Progressive multiresolution meshes for deforming surfaces. In SCA 2005, ACM Press, New York, NY, USA, 191--200.
22. Kobbelt, L., Campagna, S., Vorsatz, J., and Seidel, H.-P. 1998. Interactive multi-resolution modeling on arbitrary meshes. In SIGGRAPH 1998, ACM Press, New York, NY, USA, 105--114.
23. Lengyel, J. E. 1999. Compression of time-dependent geometry. In Symposium on Interactive 3D graphics, ACM Press, New York, NY, USA, 89--95.
24. Lipman, Y., Sorkine, O., Levin, D., and Cohen-Or, D. 2005. Linear rotation-invariant coordinates for meshes. ACM Trans. Graph. 24, 3, 479--487.
25. Loop, C. 1987. Smooth Subdivision Smfaces Based on Triangles. Master's thesis, Department of Mathematics, University of Utah.
26. No, H. M. B., Sander, P. V., McMillan, L., Gortler, S., and Hoppe, H. 2003. Geometry videos: a new representation for 3d animations. In SCA 2003, 136--146.
27. Scholz, V., Stich, T., Keckesien, M., Wacker, M., and Magnor, M. 2005. Garment motion capture using color-coded patterns. Computer Graphics Forum (Proc. Eurographics EG'05) 24, 3 (Aug.), 439--448.
28. Shamir, A., Pascucci, V., and Bajaj, C. 2000. Multi-resolution dynamic meshes with arbitrary deformations. In Proc. Visualization '00, 423--430.
29. Singh, K., and Fiume, E. 1998. Wires: a geometric deformation technique. In SIGGRAPH 1998, ACM Press, New York, NY, USA, 405--414.
30. Sorkine, O., Cohen-Or, D., Lipman, Y., Alexa, M., Rössl, C., and Seidel, H.-P. 2004. Laplacian surface editing. In SGP 2004, ACM Press, New York, NY, USA, 175--184.
31. Sumner, R. W., Zwicker, M., Gotsman, C., and Popović, J. 2005. Mesh-based inverse kinematics. ACM Trans. Graph. 24, 3, 488--495.
32. White, R., Lobay, A., and Forsyth, D., 2005. Cloth capture. Technical Report No UCB/CSD-5-1387, EECS Department, U. of California, 2005. http://www.cs.berkeley.edu/~ryanw/research/tr_cloth.html.
33. Yu, Y., Zhou, K., Xu, D., Shi, X., Bao, H., Guo, B., and Shum, H.-Y. 2004. Mesh editing with poisson-based gradient field manipulation. ACM Trans. Graph. 23, 3, 644--651.
34. Zhou, K., Huang, J., Snyder, J., Liu, X., Bao, H., Guo, B., and Shum, H.-Y. 2005. Large mesh deformation using the volumetric graph laplacian. ACM Trans. Graph. 24, 3, 496--503.
35. Zorin, D., Schröder, P., and Sweldens, W. 1997. Interactive multiresolution mesh editing. In SIGGRAPH 1997, ACM Press/Addison-Wesley Publishing Co., New York, NY, USA, 259--268.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Reconstruction

  • Computer graphics

    • Image manipulation

    • Shape modeling

      • Parametric curve and surface models

      • Volumetric models

• Theory of computation

  • Randomness, geometry and discrete structures