article

Joint bilateral upsampling

Authors:

Michael F. Cohen,

Dani Lischinski,

Matt UyttendaeleAuthors Info & Claims

ACM Transactions on Graphics (TOG), Volume 26, Issue 3

Pages 96 - es

https://doi.org/10.1145/1276377.1276497

Published: 29 July 2007 Publication History

Abstract

Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often require that a smaller solution be run over a downsampled image. Although general purpose upsampling methods can be used to interpolate the low resolution solution to the full resolution, these methods generally assume a smoothness prior for the interpolation.

We demonstrate that in cases, such as those above, the available high resolution input image may be leveraged as a prior in the context of a joint bilateral upsampling procedure to produce a better high resolution solution. We show results for each of the applications above and compare them to traditional upsampling methods.

Supplementary Material

JPG File (pps095.jpg)

Download
14.37 KB

MP4 File (pps095.mp4)

Download
55.62 MB

References

[1]

Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 294--302.

Digital Library

[2]

Barash, D. 2002. A fundamental relationship between bilateral filtering, adaptive smoothing, and the nonlinear diffusion equation. IEEE Transactions on Pattern Analysis and Machine Intelligence 24, 6, 844--847.

Digital Library

[3]

Boykov, Y., Veksler, O., and Zabih, R. 2001. Fast approximate energy minimization via graph cuts. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 11, 1222--1239.

Digital Library

[4]

Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 257--266.

Digital Library

[5]

Durand, F., Holzschuch, N., Soler, C., Chan, E., and Sillion, F. X. 2005. A frequency analysis of light transport. ACM Transactions on Graphics 24, 3 (Proc. SIGGRAPH 2005), 1115--1126.

Digital Library

[6]

Eisemann, E., and Durand, F. 2004. Flash photography enhancement via intrinsic relighting. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 673--678.

Digital Library

[7]

Elad, M. 2002. On the bilateral filter and ways to improve it. IEEE Transactions on Image Processing 11, 10, 1141--1151.

Digital Library

[8]

Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 249--256.

Digital Library

[9]

Flint, G. 2007. The Gigapxl Project.

[10]

Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics 26, 3 (Proc. SIGGRAPH 2007).

Digital Library

[11]

Levin, A., Lischinski, D., and Weiss, Y. 2004. Colorization using optimization. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 689--694.

Digital Library

[12]

Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 646--653.

Digital Library

[13]

Paris, S., and Durand, F. 2006. A fast approximation of the bilateral filter using a signal processing approach. Proceedings of ECCV 2006).

Digital Library

[14]

Petschnigg, G., Szeliski, R., Agrawala, M., Cohen, M., Hoppe, H., and Toyama, K. 2004. Digital photography with flash and no-flash image pairs. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 664--672.

Digital Library

[15]

Ramanath, R., and Snyder, W. 2003. Adaptive demosaicking. Journal of Electronic Imaging 12, 4, 633--642.

[16]

Reinhard, E., Ward, G., Pattanaik, S., and Debevec, P. 2005. High Dynamic Range Imaging. Morgan Kaufmann.

[17]

Sawhney, H. S., Guo, Y., Hanna, K., Kumar, R., Adkins, S., and Zhou, S. 2001. Hybrid stereo camera: an ibr approach for synthesis of very high resolution stereoscopic image sequences. Proceedings of SIGGRAPH 2001, 451--460.

Digital Library

[18]

Scharstein, D., and Szeliski, R. 2002. A taxonomy and evaluation of dense two-frame stereo correspondence algorithms. International Journal of Computer Vision 47, 1--3, 7--42.

Digital Library

[19]

Szeliski, R. 2006. Locally adapted hierarchical basis preconditioning. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 1135--1143.

Digital Library

[20]

Tomasi, C., and Manduchi, R. 1998. Bilateral filtering for gray and color images. Proceedings of ICCV 1998, 839--846.

Digital Library

[21]

Weiss, B. 2006. Fast median and bilateral filtering. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 519--526.

Digital Library

[22]

Wolberg, G. 1990. Digital Image Warping. IEEE Computer Society Press, Los Alamitos, CA.

Digital Library

[23]

Yatziv, L., and Sapiro, G. 2006. Fast image and video colorization using chrominance blending. IEEE Transactions on Image Processing 15, 5, 1120--1129.

Digital Library

Cited By

Li YLiu ZXing YLiu KGeng LSong QWang J(2025)Dehazing with all we havePattern Recognition Letters10.1016/j.patrec.2024.11.011187(122-129)Online publication date: Jan-2025
https://doi.org/10.1016/j.patrec.2024.11.011
Jue ZMinglei SZiyuan LYemei SShudong L(2024)Infrared image super-resolution reconstruction based on visible light image guidance and recursive fusionScientific Insights and Discoveries Review10.59782/sidr.v5i1.1675(325-338)Online publication date: 14-Oct-2024
https://doi.org/10.59782/sidr.v5i1.167
Geng Haowen 耿Wang Yu 王Xin Yanling 辛(2024)基于双特征融合引导的深度图像超分辨率重建网络Laser & Optoelectronics Progress10.3788/LOP23059361:8(0837007)Online publication date: 2024
https://doi.org/10.3788/LOP230593
Show More Cited By

Index Terms

Joint bilateral upsampling
1. Computing methodologies
  1. Artificial intelligence
    1. Computer vision
      1. Image and video acquisition
        3D imaging
  2. Computer graphics
    1. Animation

Recommendations

Bilateral guided upsampling

We present an algorithm to accelerate a large class of image processing operators. Given a low-resolution reference input and output pair, we model the operator by fitting local curves that map the input to the output. We can then produce a full-...
Joint bilateral upsampling
SIGGRAPH '07: ACM SIGGRAPH 2007 papers

Image analysis and enhancement tasks such as tone mapping, colorization, stereo depth, and photomontage, often require computing a solution (e.g., for exposure, chromaticity, disparity, labels) over the pixel grid. Computational and memory costs often ...
Fast multi-scale joint bilateral texture upsampling
Special Issue: CAD/Graphics 2009

We present a new approach using a multi-scale joint bilateral filter for upsampling the synthesized texture generated by optimization-based methods. Our method is based on the following motivation: if the available exemplar texture is used as a priority ...

Comments

Information & Contributors

Information

Published In

cover image ACM Transactions on Graphics

ACM Transactions on Graphics Volume 26, Issue 3

July 2007

976 pages

ISSN:0730-0301

EISSN:1557-7368

DOI:10.1145/1276377

Issue’s Table of Contents

Copyright © 2007 ACM.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 29 July 2007

Published in TOG Volume 26, Issue 3

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

844
Total Citations
View Citations
5,959
Total Downloads

Downloads (Last 12 months)214
Downloads (Last 6 weeks)23

Reflects downloads up to 12 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Li YLiu ZXing YLiu KGeng LSong QWang J(2025)Dehazing with all we havePattern Recognition Letters10.1016/j.patrec.2024.11.011187(122-129)Online publication date: Jan-2025
https://doi.org/10.1016/j.patrec.2024.11.011
Jue ZMinglei SZiyuan LYemei SShudong L(2024)Infrared image super-resolution reconstruction based on visible light image guidance and recursive fusionScientific Insights and Discoveries Review10.59782/sidr.v5i1.1675(325-338)Online publication date: 14-Oct-2024
https://doi.org/10.59782/sidr.v5i1.167
Geng Haowen 耿Wang Yu 王Xin Yanling 辛(2024)基于双特征融合引导的深度图像超分辨率重建网络Laser & Optoelectronics Progress10.3788/LOP23059361:8(0837007)Online publication date: 2024
https://doi.org/10.3788/LOP230593
Lo CVandewalle P(2024)Expanding Sparse Radar Depth Based on Joint Bilateral Filter for Radar-Guided Monocular Depth EstimationSensors10.3390/s2406186424:6(1864)Online publication date: 14-Mar-2024
https://doi.org/10.3390/s24061864
Nogami HKanetaka YNaganawa YMaeda YFukushima N(2024)Decomposed Multilateral Filtering for Accelerating Filtering with Multiple Guidance ImagesSensors10.3390/s2402063324:2(633)Online publication date: 19-Jan-2024
https://doi.org/10.3390/s24020633
Wunsch LTenorio CAnding KGolomoz ANotni G(2024)Data Fusion of RGB and Depth Data with Image EnhancementJournal of Imaging10.3390/jimaging1003007310:3(73)Online publication date: 21-Mar-2024
https://doi.org/10.3390/jimaging10030073
Wang Q(2024)Towards Real-Time 3D Terrain Reconstruction from Aerial ImageryGeographies10.3390/geographies40100054:1(66-82)Online publication date: 29-Jan-2024
https://doi.org/10.3390/geographies4010005
Yang YQiu SZeng LPan Z(2024)Detail-preserving Joint Image UpsamplingACM Transactions on Multimedia Computing, Communications, and Applications10.1145/366524620:8(1-23)Online publication date: 13-Jun-2024
https://dl.acm.org/doi/10.1145/3665246
Wang YWang CGong BXue T(2024)Bilateral Guided Radiance Field ProcessingACM Transactions on Graphics10.1145/365814843:4(1-13)Online publication date: 19-Jul-2024
https://dl.acm.org/doi/10.1145/3658148
Wu Y(2024)Efficient Environment Map Rendering Based on DecompositionComputer Graphics Forum10.1111/cgf.15264Online publication date: 22-Oct-2024
https://doi.org/10.1111/cgf.15264
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Article

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents