Time-varying surface appearance: acquisition, modeling and rendering

Abstract

For computer graphics rendering, we generally assume that the appearance of surfaces remains static over time. Yet, there are a number of natural processes that cause surface appearance to vary dramatically, such as burning of wood, wetting and drying of rock and fabric, decay of fruit skins, and corrosion and rusting of steel and copper. In this paper, we take a significant step towards measuring, modeling, and rendering time-varying surface appearance. We describe the acquisition of the first time-varying database of 26 samples, encompassing a variety of natural processes including burning, drying, decay, and corrosion. Our main technical contribution is a Space-Time Appearance Factorization (STAF). This model factors space and time-varying effects. We derive an overall temporal appearance variation characteristic curve of the specific process, as well as space-dependent textures, rates, and offsets. This overall temporal curve controls different spatial locations evolve at the different rates, causing spatial patterns on the surface over time. We show that the model accurately represents a variety of phenomena. Moreover, it enables a number of novel rendering applications, such as transfer of the time-varying effect to a new static surface, control to accelerate time evolution in certain areas, extrapolation beyond the acquired sequence, and texture synthesis of time-varying appearance.

References

1. Chen, Y., Xia, L., Wong, T., Tong, X., Bao, H., Guo, B., and Shum, H. 2005. Visual simulation of weathering by gammaton tracing. ACM Transactions on Graphics, SIGGRAPH 2005, 1127--1133.
2. Cross, M., and Hohenberg, P. 1993. Pattern formation out of equilibrium. Reviews of Modern Physics 65, 851--1112.
3. Dana, K., Van Ginneken, B., Nayar, S., and Koenderink, J. 1999. Reflectance and texture of real-world surfaces. ACM Transactions on Graphics 18, 1 (January), 1--34.
4. Debevec, P., Wenger, A., Tchou, C., Gardner, A., Waese, J., and Hawkins, T. 2002. A lighting reproduction approach to live-action compositing. ACM TOG (SIGGRAPH 02) 21, 3, 547--556.
5. Dorsey, J., and Hanrahan, P. 1996. Modeling and rendering of metallic patinas. In SIGGRAPH, 387--396.
6. Dorsey, J., Pederson, H., and Hanrahan, P. 1996. Flow and changes in appearance. In SIGGRAPH, 411--420.
7. Dorsey, J., Edelman, A., Wann Jensen, H., Legakis, J., and Pederson, H. 1999. Modeling and rendering of weathered stone. In SIGGRAPH, 225--234.
8. Efros, A., and Freeman, W. 2001. Image quilting for texture synthesis and transfer. In SIGGRAPH, 341--346.
9. Gasser, T., Muller, H. G., and Mammitzsch, V. 1985. Kernels for nonparametric curve estimation. Journal of the Royal Statistical Society. Seriers B (Methodological) 47, 2, 238--252.
10. Hsu, S., and Wong, T. 1995. Simulating dust accumulation. IEEE Computer Graphics & Applications 15, 1 (January), 18--22.
11. Hughes, R., and Rowe, M. 1991. The colouring, bronzing and patination of metals. Watson-Guptill Publications, New York.
12. Jankowsky, I., and Santos, G. 2004. Drying behavior and permeability of eucalyptus grandis lumber. In International Drying Symposium, 1385--1389.
13. Jensen, H., Legakis, J., and Dorsey, J. 1999. Rendering of wet materials. In Rendering Techniques'99, Springer-Verlag, D. Lischinski and G. Larson, Eds., 273--282.
14. Kneip, A., and Engel, J. 1995. Model estimation in nonlinear regression under shape invariance. The Annals of Statistics 23, 2 (April), 551--570.
15. Koudelka, M. 2004. Capture, Analysis and Synthesis of Textured Surfaces With Variation in Illumination, Viewpoint and Time. PhD thesis, Yale University.
16. Lu, J., Georghiades, A., Rushmeier, H., Dorsey, J., and Xu, C. 2005. Synthesis of material drying history: Phenomenon modeling, transferring and rendering. In Eurographics Workshop on Natural Phenomena, 7--16.
17. Matusik, W., Pfister, H., Brand, M., and Mcmillan, L. 2003. A data-driven reflectance model. ACM Transactions on Graphics, SIGGRAPH 2003 (July), 759--769.
18. Meinhardt, H. 1992. Pattern formation in biology: a comparison of models and experiments. Reports on Progress in Physics 55, 797--849.
19. Merillou, S., Dischler, J.-M., and Ghazanfarpour, D. 2001. Corrosion: simulating and rendering. In Graphics Interface 01, 167--174.
20. Miller, G. 1994. Efficient algorithms for local and global accessibility shading. In SIGGRAPH, 319--326.
21. Pharr, M., and Humphreys, G. 2004. Physically Based Rendering: From Theory to Implementation. Morgan Kaufmann.
22. Sakoe, H., and Chiba, S. 1978. Dynamic programming algorithm optimization for spoken word recognition. IEEE Trans Acoustic Speech and Signal Processing 26, 43--49.
23. Vasilescu, M., and Terzopoulos, D. 2004. Tensortextures: Multilinear image-based rendering. In SIGGRAPH, 336--342.
24. Vlasic, D., Pfister, H., Molinov, S., Grzeszczuk, R., and Matusik, W. 2003. Opacity light fields: Interactive rendering of surface light fields with view-dependent opacity. In Symposium on Interactive 3D graphics, 65--74.
25. Wang, K., and Gasser, T. 1999. Synchronizing sample curves non-parametrically. The Annals of Statistics 27, 2, 439--460.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Reconstruction

        • Video segmentation

      • Computer vision tasks

        • Scene understanding

  • Computer graphics

    • Shape modeling

      • Parametric curve and surface models

      • Volumetric models

• Theory of computation

  • Randomness, geometry and discrete structures