Street slide: browsing street level imagery

Abstract

Systems such as Google Street View and Bing Maps Streetside enable users to virtually visit cities by navigating between immersive 360° panoramas, or bubbles. The discrete moves from bubble to bubble enabled in these systems do not provide a good visual sense of a larger aggregate such as a whole city block. Multi-perspective "strip" panoramas can provide a visual summary of a city street but lack the full realism of immersive panoramas.

We present Street Slide, which combines the best aspects of the immersive nature of bubbles with the overview provided by multi-perspective strip panoramas. We demonstrate a seamless transition between bubbles and multi-perspective panoramas. We also present a dynamic construction of the panoramas which overcomes many of the limitations of previous systems. As the user slides sideways, the multi-perspective panorama is constructed and rendered dynamically to simulate either a perspective or hyper-perspective view. This provides a strong sense of parallax, which adds to the immersion. We call this form of sliding sideways while looking at a street façade a street slide. Finally we integrate annotations and a mini-map within the user interface to provide geographic information as well additional affordances for navigation. We demonstrate our Street Slide system on a series of intersecting streets in an urban setting. We report the results of a user study, which shows that visual searching is greatly enhanced with the Street Slide interface over existing systems from Google and Bing.

References

1. Agarwala, A., Agrawala, M., Cohen, M., Salesin, D., and Szeliski, R. 2006. Photographing long scenes with multi-viewpoint panoramas. ACM Transactions on Graphics 25, 3 (August), 853--861.
2. Buehler, C., Bosse, M., McMillan, L., Gortler, S., and Cohen, M. 2001. Unstructured lumigraph rendering. In SIGGRAPH '01: Proceedings of the 28th annual conference on Computer graphics and interactive techniques, ACM, New York, NY, USA, 425--432.
3. Chen, S. E. 1995. QuickTime VR -- an image-based approach to virtual environment navigation. Computer Graphics (SIGGRAPH'95) (August), 29--38.
4. Gortler, S. J., Grzeszczuk, R., Szeliski, R., and Cohen, M. F. 1996. The Lumigraph. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'96 (New Orleans), 43--54.
5. Gupta, R., and Hartley, R. 1997. Linear pushbroom cameras. IEEE Transactions on Pattern Analysis and Machine Intelligence 19, 9 (September), 963--975.
6. Igarashi, T., and Hinckley, K. 2000. Speed-dependent automatic zooming for browsing large documents. In UIST '00: Proceedings of the 13th annual ACM symposium on User interface software and technology, ACM, New York, NY, USA, 139--148.
7. Kopf, J., Uyttendaele, M., Deussen, O., and Cohen, M. F. 2007. Capturing and viewing gigapixel images. ACM Transactions on Graphics 26, 3 (August).
8. Kwatra, V., Schödl, A., Essa, I., Turk, G., and Bobick, A. 2003. Graphcut textures: Image and video synthesis using graph cuts. ACM Transactions on Graphics 22, 3 (July), 277--286.
9. Levoy, M., and Hanrahan, P. 1996. Light field rendering. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'96 (New Orleans), 31--42.
10. Lippman, A. 1980. Movie maps: An application of the optical videodisc to computer graphics. Computer Graphics (SIGGRAPH'80) 14, 3 (July), 32--43.
11. McMillan, L., and Bishop, G. 1995. Plenoptic modeling: An image-based rendering system. Computer Graphics (SIGGRAPH'95) (August), 39--46.
12. Peleg, S., Rousso, B., Rav-Acha, A., and Zomet, A. 2000. Mosaicing on adaptive manifolds. IEEE Transactions on Pattern Analysis and Machine Intelligence 22, 10 (October), 1144--1154.
13. Peleg, R., Ben-Ezra, M., and Pritch, Y. 2001. Omnistereo: Panoramic stereo imaging. IEEE Transactions on Pattern Analysis and Machine Intelligence 23, 3 (March), 279--290.
14. Rademacher, P., and Bishop, G. 1998. Multiple-center-of-projection images. In Computer Graphics Proceedings, Annual Conference Series, ACM SIGGRAPH, Proc. SIGGRAPH'98 (Orlando), 199--206.
15. Rav-Acha, A., Engel, G., and Peleg, S. 2008. Minimal aspect distortion (MAD) mosaicing of long scenes. International Journal of Computer Vision 78, 2--3 (July), 187--206.
16. Román, A., and Lensch, H. P. A. 2006. Automatic multi-perspective images. In Eurographics Symposium on Rendering, 83--92.
17. Román, A., Garg, G., and Levoy, M. 2004. Interactive design of multi-perspective images for visualizing urban landscapes. In IEEE Visualization 2004, 537--544.
18. Snavely, N., Seitz, S. M., and Szeliski, R. 2006. Photo tourism: Exploring photo collections in 3D. ACM Transactions on Graphics 25, 3 (August), 835--846.
19. Szeliski, R. 2006. Image alignment and stitching: A tutorial. Foundations and Trends in Computer Graphics and Computer Vision 2, 1 (December).
20. Uyttendaele, M., Criminisi, A., Kang, S. B., Winder, S., Hartley, R., and Szeliski, R. 2004. Image-based interactive exploration of real-world environments. IEEE Computer Graphics and Applications 24, 3 (May/June), 52--63.
21. Vincent, L. 2007. Taking online maps down to street level. Computer 40, 12 (December), 118--120.
22. Zomet, A., Feldman, D., Peleg, S., and Weinshall, D. 2003. Mosaicing new views: The crossed-slits projection. IEEE Transaction on PAMI (June), 741--754.

Index Terms

• Applied computing

  • Computers in other domains

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Image and video acquisition

        • 3D imaging

  • Computer graphics

    • Animation