Paulo Scatena
ABSTRACT
This work proposes and evaluates a method of image-based rendering for integrating light-emitting CG assets with digital photography. The framework consists of a capture stage, in which footage of the scene under varied lighting is acquired, and a reconstruction stage, which outputs the calculated light contribution of the CG element upon the scene. This form of relighting is novel as it embraces scenarios where the light source is intended to be in the frame. The freedom to introduce emissive objects in post opens creative room for light animation and was assessed here as employed in the production of a stop-motion short-film.
Supplemental Material
Available for Download
- Mojtaba Bemana, Karol Myszkowski, Hans-Peter Seidel, and Tobias Ritschel. 2020. X-Fields: Implicit Neural View-, Light- and Time-Image Interpolation. ACM Trans. Graph. 39, 6, Article 257 (Nov. 2020), 15 pages. https://doi.org/10.1145/3414685.3417827Google Scholar
Digital Library
- Yaozhun Huang, Sze-Chun Tsang, Hei-Ting Tamar Wong, and Miu-Ling Lam. 2018. Computational Light Painting and Kinetic Photography. In Proceedings of the Joint Symposium on Computational Aesthetics and Sketch-Based Interfaces and Modeling and Non-Photorealistic Animation and Rendering (Victoria, British Columbia, Canada) (Expressive ’18). Association for Computing Machinery, New York, NY, USA, Article 14, 9 pages. https://doi.org/10.1145/3229147.3229167Google ScholarDigital Library
- Bitbanger Labs. 2017. The Pixelstick. Retrieved January 17, 2021 from http://www.thepixelstick.comGoogle Scholar
- Tiancheng Sun, Zexiang Xu, Xiuming Zhang, Sean Fanello, Christoph Rhemann, Paul Debevec, Yun-Ta Tsai, Jonathan T. Barron, and Ravi Ramamoorthi. 2020. Light Stage Super-Resolution: Continuous High-Frequency Relighting. ACM Trans. Graph. 39, 6, Article 260 (Nov. 2020), 12 pages. https://doi.org/10.1145/3414685.3417821Google Scholar
- Andreas Wenger, Andrew Gardner, Chris Tchou, Jonas Unger, Tim Hawkins, and Paul Debevec. 2005. Performance Relighting and Reflectance Transformation with Time-Multiplexed Illumination. ACM Trans. Graph. 24, 3 (July 2005), 756–764. https://doi.org/10.1145/1073204.1073258Google ScholarDigital Library
Index Terms
Freezing Fire – Automated Light-Passes for Stop-Motion VFX
Recommendations
Performance relighting and reflectance transformation with time-multiplexed illumination
SIGGRAPH '05: ACM SIGGRAPH 2005 PapersWe present a technique for capturing an actor's live-action performance in such a way that the lighting and reflectance of the actor can be designed and modified in postproduction. Our approach is to illuminate the subject with a sequence of time-...
Performance relighting and reflectance transformation with time-multiplexed illumination
We present a technique for capturing an actor's live-action performance in such a way that the lighting and reflectance of the actor can be designed and modified in postproduction. Our approach is to illuminate the subject with a sequence of time-...
Relighting with the Reflected Irradiance Field: Representation, Sampling and Reconstruction
Image-based relighting (IBL) is a technique to change the illumination of an image-based object/scene. In this paper, we define a representation called the reflected irradiance field which records the light reflected from a scene as viewed at a fixed ...
Comments