Interactive Visualizations of Video Tours in Space and Time

ABSTRACT

Videos and movies are increasingly being created, shared and accessed from different platforms and devices, that are supporting georeferencing as a form to enrich their contextualization, demanding for new and more powerful ways to search, browse and view them. An effective access to video is very challenging due to the amount of items available and their inner complexity. Interactive visualization, in complement to video cataloguing, can help to handle this challenge, making information more accessible and useful. Moreover, it is worth doing this navigation ludic, and aesthetically interesting, while providing new ways to search and filter through their properties and their impact on the users. In previous work we focused on the temporal dimension in movies and videos in a way that is possible to explore and access them through time, genre and rating criteria, and inside their contents regarding image, movement, audio, subtitles and emotions. We are now extending our goal by considering the spatial dimension, through trajectories like the ones we find in city tours. We present the design of the main interactive visualizations for navigating georeferenced videos, allowing the user to 1) overview videos shot in a given geographic location in a given moment of time; 2) zoom in the trajectories of individual videos, e.g. by length, speed, age and content of the shootings; 3) access and watch each video content in a specific trajectory, e.g. through color, sound, spoken words, emotions and neighbor connections.

References

1. Andrienko, G., Andrienko, N., Bak, P., Keim, D., Kisilevich, S., and Wrobel, S. (2011). A Conceptual Framework and Taxonomy of Techniques for Analyzing Movement. Journal of Visual Languages & Computing 22 (3): 213--32.
2. Angesleva, J., and Cooper, R. (2005) Last Clock. Computer Graphics and Applications, IEEE 25 (1): 20--23.
3. Cruz, P., and Machado, P. (2011) Visualizing the Circulatory Problems of Lisbon. In ACM SIGGRAPH 2011 Posters, 92. ACM.
4. Finsterwald, J-M., Grefenstette, G., Law-To, J., Bouchard, H., and Mezaour, A. D. (2012) The Movie Mashup Application MoMa: Geolocalizing and Finding Movies. In Proc. of the ACM GeoMM'12, 15--18. ACM.
5. Gil, N., Silva, N., Dias, E., Martins, P., Langlois, T., and Chambel, T. (2012) Going through the Clouds: Search Overviews and Browsing of Movies. In Proc. of Academic MindTrek'12, ACM, 158--65.
6. Hao, J., Wang, G., Seo, B., and Zimmermann, R. (2011). Keyframe Presentation for Browsing of User-Generated Videos on Map Interfaces. In Proc. ACM Multimedia, 1013--16. ACM.
7. Harley, J. B., and Woodward, D. (1987) The History of Cartography. Vol. 1. Univ. of Chicago Press.
8. Jorge, A., and Chambel, T. (2013) Exploring Movies through Interactive Visualizations. In Proc. of the 27th Int. BCS Human Computer Interaction Conf., 6 pgs, Sep 2013, London, UK.
9. Jorge, A., Gil, N., and Chambel, T. (2012) Time for a New Look at the Movies through Visualization. In Proc. of Artech'2012, the 6th Int. Conf. on Digital Arts, 269--78. Faro, Portugal.
10. Kraak, M. J, and Ormeling, F. (2010) Cartography: Visualization of Geospatial Data. Harlow; New York: Prentice Hall.
11. Levin, G. (2005) An Informal Catalogue of Slit-Scan Video Artworks and Research. FLONG. http://www.flong.com/texts/lists/slit_scan/
12. Noronha, G., Álvares, C., and Chambel, T. (2012) Sharing and Navigating 360° Videos and Maps in Sight Surfers. In Proc. of Academic MindTrek'12, 255--62. ACM.
13. Nunes, M., Greenberg, S., Carpendale, S., and Gutwin, C. (2007) What Did I Miss? Visualizing the Past through Video Traces. In ECSCW 2007, 1--20. Springer.
14. Peterson, M.P. (1997) Trends in Internet Map Use. In Proc. of the 18th Int. Cartographic Conf., Stockholm, Sweden, 1635--42.
15. Peuquet, D. J. (1994) It's about Time: A Conceptual Framework for the Representation of Temporal Dynamics in Geographic Information Systems. Annals of the Association of American Geographers 84 (3): 441--61.
16. Peuquet, D. J. (2001) Making Space for Time: Issues in Space-Time Data Representation. GeoInformatica 5 (1): 11--32.
17. Peuquet, D. J. (2002) Representations of Space and Time. New York: The Guilford Press.
18. Ramalho, J., and Chambel, T. (2013) Immersive 360° Mobile Video with an Emotional Perspective. Proc. ImmersiveMe'2013, ACM Press, pp. 35--40.
19. Rego, A., Baptista, C., Silva, E., Schiel, U., and Figueirêdo, H. (2007) VideoLib: A Video Digital Library with Support to Spatial and Temporal Dimensions. In Proc. of ACM SAC'07, 1074--78.
20. Serra, S., Jorge, A., and Chambel, T. (2014) Multimodal Access to Georeferenced Mobile Video through Shape, Speed and Time. In Proc. of the 28th Int BCS Human Computer Interaction Conf., 6 pgs, Sep 2014, Southport, UK.
21. Viégas, F., Boyd, D., Nguyen, D. H., Potter, J., and Donath, J. (2004) Digital Artifacts for Remembering and Storytelling: Posthistory and Social Network Fragments. In Proc. of HICSS'04, 10 pgs.
22. Viégas, F., and Wattenberg, M. (2009) "Flickr Flow." HINT.FM. http://hint.fm/projects/fli

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition

• Human-centered computing

  • Human computer interaction (HCI)

    • HCI design and evaluation methods

    • Interaction paradigms