Capturing and viewing gigapixel images

Abstract

We present a system to capture and view "Gigapixel images": very high resolution, high dynamic range, and wide angle imagery consisting of several billion pixels each. A specialized camera mount, in combination with an automated pipeline for alignment, exposure compensation, and stitching, provide the means to acquire Gigapixel images with a standard camera and lens. More importantly, our novel viewer enables exploration of such images at interactive rates over a network, while dynamically and smoothly interpolating the projection between perspective and curved projections, and simultaneously modifying the tone-mapping to ensure an optimal view of the portion of the scene being viewed.

References

1. Agarwala, A., Dontcheva, M., Agrawala, M., Drucker, S., Colburn, A., Curless, B., Salesin, D., and Cohen, M. 2004. Interactive digital photomontage. ACM Transactions on Graphics 23, 3 (Proc. SIGGRAPH 2004), 294--302.
2. Brown, M., Szeliski, R., and Winder, S. 2005. Multi-image matching using multi-scale oriented patches. Proceedings of CVPR 2005, 510--517.
3. Burt, P. J., and Adelson, E. H. 1983. The Laplacian pyramid as a compact image code. IEEE Transactions on Communications COM-31, 4, 532--540.
4. Chen, S. E. 1995. QuickTime VR - an image-based approach to virtual environment navigation. Proceedings of SIGGRAPH '95, 29--38.
5. Debevec, P. E., and Malik, J. 1997. Recovering high dynamic range radiance maps from photographs. Proceedings of SIGGRAPH 97 (August).
6. Durand, F., and Dorsey, J. 2002. Fast bilateral filtering for the display of high-dynamic-range images. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 257--266.
7. Eden, A., Uyttendaele, M., and Szeliski, R. 2006. Seamless image stitching of scenes with large motions and exposure differences. Proceedings of CVPR 2006) 3, 2498--2505.
8. Fattal, R., Lischinski, D., and Werman, M. 2002. Gradient domain high dynamic range compression. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 249--256.
9. Fischler, M. A., and Bolles, R. C. 1981. Random sample consensus: A paradigm for model fitting with applications to image analysis and automated cartography. Communications of the ACM 24, 6, 381--395.
10. HDP, 2006. Hd photo. Microsoft Corporation, http://www.microsoft.com/whdc/xps/wmphoto.mspx.
11. Kopf, J., Cohen, M., Lischinski, D., and Uyttendaele, M. 2007. Joint bilateral upsampling. ACM Transactions on Graphics 26, 3 (Proc. of SIGGRAPH 2007).
12. Lam, K. 1985. Metamerism and Colour Constancy. PhD thesis, University of Bradford.
13. Lischinski, D., Farbman, Z., Uyttendaele, M., and Szeliski, R. 2006. Interactive local adjustment of tonal values. ACM Transactions on Graphics 25, 3 (Proc. SIGGRAPH 2006), 646--653.
14. Lowe, D. 2004. Distinctive image features from scale-invariant keypoints. International Journal of Computer Vision 60, 2, 91--100.
15. Mitsunaga, T., and Nayar, S. 1999. Radiometric self calibration. Proceedings of CVPR '99 2, 374--380.
16. Pérez, P., Gangnet, M., and Blake, A. 2003. Poisson image editing. ACM Transactions on Graphics 22, 3 (Proc. SIGGRAPH 2003), 313--318.
17. Reinhard, E., Stark, M., Shirley, P., and Ferwerda, J. 2002. Photographic tone reproduction for digital images. ACM Transactions on Graphics 21, 3 (Proc. SIGGRAPH 2002), 267--276.
18. Reinhard, E. 2002. Parameter estimation for photographic tone reproduction. Journal of Graphics Tools 7, 1, 45--52.
19. Szeliski, R., and Kang, S. B. 1994. Recovering 3D shape and motion from image streams using nonlinear least squares. Journal of Visual Communication and Image Representation 5, 1 (March), 10--28.
20. Szeliski, R. 2006. Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Computer Vision 2, 1.
21. Wilburn, B., Joshi, N., Vaish, V., Talvala, E.-V., Antunez, E., Barth, A., Adams, A., Horowitz, M., and Levoy, M. 2005. High performance imaging using large camera arrays. ACM Transactions on Graphics 24, 3 (Proc. SIGGRAPH 2005), 795--802.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

      • Image and video acquisition

  • Computer graphics

    • Image manipulation

    • Rendering