Exploring movies through interactive visualizations

ABSTRACT

Videos and movies are important sources of information in the entertainment and learning form, having great power to affect us, perceptually, cognitively and emotionally. By integrating various media like image, sound and text along time, they are very rich and they are becoming pervasive on the Internet and interactive TV, increasing the need for new and powerful ways to access, browse and view them. Interactive visualization techniques have the potential to help handling with this rich but complex information: both the time when they were released, and the time along which their contents are weaved, in each movie. In previous work we have presented visualizations that allow the access to the movies released over a certain period of time based on genres and rankings, and to overview and browse movies based on their contents represented with tag clouds. In this paper, we explore the movies through visual representations of the different aspects of their contents, especially image, audio, and subtitles, with a focus on emotions. This approach has the ultimate goal of providing overviews, and browsing mechanisms based on interactive visualizations that may provide insights in analytical or more ludic uses, that may be efficient in conveying and accessing information, and are also easy, funny and aesthetical.

References

1. Ahlberg, C., Shneiderman, B.: Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays. SIGCHI. pp. 313--317., Boston, USA (1994).
2. Aigner, W., Miksch, S., Müller, W., Schumann, H., Tominski, C.: Visualizing time-oriented data-A systematicview. Computers & Graphics. 31, 401--409 (2007).
3. Angesleva, J., Cooper, R.: Last clock. Computer Graphics and Applications, IEEE.25, 20--23 (2005)
4. Bestiario, Videosphere, http://www.bestiario.
5. Bly, S. A., Harrison, S. R., Irwin, S.: Media spaces: bringing people together in a video, audio, and computing environment. Commun. ACM. 36, 28--46 (1993).
6. Brodbeck, F. CINEMETRICS, BSc graduation project, Royal Academy of Arts (KABK), Den Haag. http://cinemetrics.fredericbrodbeck.de/
7. Davis, M.: Media Streams: an iconic visual language for video representation. Readings in Human-Computer Interaction: Toward the Year 2000. 854--866 (2000).
8. Dimitrova, N., Zhang, H.-J., Shahraray, B., Sezan, I., Huang, T., Zakhor, A.: Applications of videocontent analysis and retrieval. MultiMedia, IEEE. 9, 42--55 (2002).
9. Geisler, G., Marchionini, G., Nelson, M., Spinks, R., Yang, M.: Interface concepts for the open video project. Proc. of the Annual Meeting-American Society for Information Science. pp. 58--75 (2001).
10. Gil, N., Silva, N., Dias, E., Martins, P., Langlois, T., Chambel, T.: Going through the clouds: search overviews and browsing of movies. Proc. of 16th Int. Academic Mind Trek Conf. pp. 158--165 (2012).
11. Hauptmann, A.: Lessons for the future from a decade of informedia video analysis research. Image and Video Retrieval. pp. 1--10., National University of Singapore (2005).
12. Jorge, A., Gil, N., Chambel, T.: Time for a New Look at the Movies through Visualization. Proceedings of Artech'2012 Crossing Digital Boundaries, the 6th International Conference on Digital Arts. pp. 269--278. Faro, Portugal (2012).
13. Levin, G. & collaborators: An Informal Catalogue of Slit-Scan Video Artworks and Research. http://www.flong.com/texts/lists/slit_scan/
14. Martinho, J., Chambel, T.: ColorsInMotion: Interactive Visualization and Exploration of Video Spaces. In Proc. of Academic MindTrek (2009).
15. McEwan, G., Greenberg, S.: Supporting social worlds with the community bar. Proceedings of the 2005 international ACM SIGGROUP conf. on Supporting group work. pp. 21--30 (2005).
16. Nunes, M., Greenberg, S., Carpendale, S., Gutwin, C.: What did I miss? Visualizing the past through video traces. ECSCW 2007.1--20 (2007).
17. Post, F. H., Vrolijk, B., Hauser, H., Laramee, R. S., Doleisch, H.: The state of the art in flow visualisation: Feature extraction and tracking. Computer Graphics Forum. pp. 775--792 (2003).
18. Plutchik, R. 1980. Emotion: A psychoevolutionary synthesis Harper & Row New York.
19. Rocha, T., Chambel, T.: VideoSpace: a 3D Video Experience. Proceedings of Artech. (2008).
20. Shneiderman, B.: The eyes have it: A task by data type taxonomy for information visualizations. Proceedings of IEEE Symposium on Visual Languages, pp. 336--343 (1996).
21. Silva, S. F., Catarci, T.: Visualization of linear time-oriented data: a survey. Web Information Systems Engineering, 2000. Proc. of the First International Conference on. pp. 310--319 (2000).

Index Terms

• Human-centered computing

  • Human computer interaction (HCI)

• Information systems

  • Information systems applications

    • Multimedia information systems