Printing reflectance functions

Abstract

The reflectance function of a scene point captures the appearance of that point as a function of lighting direction. We present an approach to printing the reflectance functions of an object or scene so that its appearance is modified correctly as a function of the lighting conditions when viewing the print. For example, such a “photograph” of a statue printed with our approach appears to cast shadows to the right when the “photograph” is illuminated from the left. Viewing the same print with lighting from the right will cause the statue's shadows to be cast to the left. Beyond shadows, all effects due to the lighting variation, such as Lambertian shading, specularity, and inter-reflection can be reproduced. We achieve this ability by geometrically and photometrically controlling specular highlights on the surface of the print. For a particular viewpoint, arbitrary reflectance functions can be built up at each pixel by controlling only the specular highlights and avoiding significant diffuse reflections. Our initial binary prototype uses halftoning to approximate continuous grayscale reflectance functions.

References

1. Alexa, M. and Matusik, W. 2010. Reliefs as images. ACM Trans. Graph. 29, 4.
2. Allebach, J. 2001. DBS: Retrospective and future directions. In Proceedings of the Color Imaging: Device Independent Color, Color Hardcopy, and Graphic Arts VI Conference (SPIE). Vol. 4300, 23--26.
3. Arce, G. 2008. Modern Digital Halftoning 2^nd Ed. CRC Press.
4. Debevec, P., Hawkins, T., Tchou, C., Duiker, H., Sarokin, W., and Sagar, M. 2000. Acquiring the reflectance field of a human face. In Proceedings of the SIGGRAPH'00 Conference. 145--156.
5. Freeth, T., Bitsakis, Y., Moussas, X., Seiradakis, J., Tselikas, A., Mangou, H., Zafeiropoulou, M., Hadland, R., Bate, D., Ramsey, A., Allen, M., Crawley, A., Hockley, P., Malzbender, T., Gelb, D., Ambrisco, W., and Edmunds, M. 2006. Decoding the ancient Greek astronomical calculator known as the antikythera mechanism. Nature 444, 587--591.
6. Fuchs, M., Raskar, R., Seidel, H.-P., and Lensch, H. 2008. Towards passive 6D reflectance function displays. ACM Trans. Graph. 27, 3.
7. Hawkins, T., Cohen, J., and Debevec, P. 2001. A photometric approach to digitizing cultural artifacts. In Proceedings of the Conference on Virtual Reality, Archeology, and Cultural Heritage (VAST'01).
8. Malzbender, T., Gelb, D., and Wolters, H. 2001. Polynomial texture maps. In Proceedings of the SIGGRAPH'01 Conference. 519--528.
9. Matusik, W., Ajdin, B., Gu, J., Lawrence, J., Lensch, H., Pellacini, F., and Rusinkiewicz, S. 2009. Printing spatially-varying reflectance. ACM Trans. Graph. 28, 5.
10. Mudge, M., Malzbender, T., Schroer, C., and Lum, M. 2006. New reflection transformation imaging methods for rock art and multiple-viewpoint display. In Proceedings of the 7^th International Symposium on Virtual Reality, Archeology, and Cultural Heritage (VAST'06).
11. Nayar, S., Belhumeur, P., and Boult, T. 2004. Lighting sensitive display. ACM Trans. Graph. 23, 4.
12. Nicodemus, F., Richmond, J., and Hsai, J. 1977. Geometrical considerations and nomenclature for reflectance. U.S. Department of Commerce, National Bureau of Standards.
13. Padfield, J., Saunders, D., and Malzbender, T. 2005. Polynomial texture mapping: A new tool for examining the surface of paintings. ICOM Committee for Conservation.
14. Peers, P., Hawkins, T., and Debevec, P. 2006. A reflective light stage. Tech. rep. ICT-TR-04.2006, ICT (USC Institute for Creative Technologies).
15. Peers, P., Tamura, N., Matusik, W., and Debevec, P. 2007. Post-Production facial performance relighting using reflectance transfer. ACM Trans. Graph. 26, 3.
16. Ramamoorthi, R. and Hanrahan, P. 2001. An efficient representation for irradiance environment maps. In Proceedings of the SIGGRAPH'01 Conference.
17. Regg, C., Rusinkiewicz, S., Matusik, W., and Gross, M. 2010. Computational highlight holography. ACM Trans. Graph. 29, 6.
18. Ulichney, R. 1987. Digital Halftoning. MIT Press.
19. Wenger, A., Gardner, A., Tchou, C., Unger, J., Hawkins, T., and Debevec, P. 2005. Performance relighting and reflectance transformation with time-multiplexed illumination. ACM Trans. Graph. 24, 3.
20. Weyrich, T., Deng, J., Barnes, C., Rusinkiewicz, S., and Finkelstein, A. 2007. Digital bas-relief from 3D scenes. ACM Trans. Graph. 26, 5.
21. Weyrich, T., Peers, P., Matusik, W., and Rusinkiewicz, S. 2009. Fabricating microgeometry for custom surface reflectance. ACM Trans. Graph. 28, 5.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

• Hardware

  • Communication hardware, interfaces and storage

    • Displays and imagers

    • Printers