Going Through the Clouds: Search Overviews and Browsing of Movies

ABSTRACT

Movies are one of the biggest sources of entertainment, in individual and social contexts, and increasingly accessible as enormous collections of videos and movies over the Internet, in social media and interactive TV. These richer environments demand for new and more powerful ways to search, browse and view videos and movies, that may benefit from video content-based analysis and classification techniques. In this paper, we present and evaluate extended features of content processing, search, overview and browsing in the MovieClouds, from overview clouds at the movies space down to the movies, based on the information conveyed in the different tracks or perspectives of its content, especially audio and subtitles where most of the semantics is expressed. Tag clouds are adopted as a unifying-paradigm, complemented with other approaches, to extend to movies the power, flexibility, engagement and fun usually associated with clouds, in a consistent way. Evaluation results were very encouraging, reinforcing the previous approach and reflecting the improvements and new features.

References

1. Ahlberg, C. & Truvéé, S. 1995. Tight coupling: Guiding user actions in a direct manipulation retrieval system. In People and computers X: Proc. of HCI'95, Aug. 305--321.
2. Chambel, T., Oliveira, E., & Martins, P. 2011. Being Happy, Healthy and Whole Watching Movies that Affect our Emotions. In Proc. of ACII'2011, Memphis, TN, USA.
3. Chen, Y. 2010. Exploratory Browsing: Enhancing the Browsing Experience with Media Collections, PhD thesis, Ludwig-Maximilians-Universität München, June.
4. Chu, S., Narayanan, S. and Jay Kuo, C.-C. 2008. Environmental Sound Recognition using MP-based Features. In IEEE Int. Conf. on Acoustics, Speech, and Signal Process.
5. Cunningham, S. and David M. Nichols. 2008. How people find videos. In Proc. of the 8th ACM/IEEE-CS joint conference on Digital libraries (JCDL '08), 201--210.
6. Daniel, G. and Chen, M. 2003. Video Visualization In Proc. of the 14th IEEE Visualization 2003 (Vis'03). IEEE Visualization. IEEE Computer Society, Washington, DC, 54.
7. Feinerer, I., Hornik, K., and Meyer, D. 2008. Text Mining Infrastructure in R, Journ. of Statistical Software, Mar, 23(5).
8. Gulik, R., van Vignoli, F. 2005. Visual Playlist Generation on the Artist Map. In Proc. of the 6th Int. Conf. on Music Information Retrieval. ISMIR 2005, London, UK. 520--523.
9. Hassenzahl, M., Platz, A., Burmester, M, and Lehner, K. 2000. Hedonic and Ergonomic Quality Aspects Determine a Software's Appeal. ACM CHI 2000. The Hague, Amsterdam, pp. 201--208.
10. Hauptmann, A. G. 2005. Lessons for the Future from a Decade of Informedia Video Analysis Research. Int. Conf. on Image and Video Retrieval, Singapure, July 20--22. LNCS, vol 3568, pp. 1--10, Aug.
11. Katsiouli P., Tsetsos V., Hadjiefthymiades S. 2007. Semantic video classification based on subtitles and domain terminologies. Workshop on Knowledge Acquisition from Multimedia Content.
12. Kuhn, M., Wattenhofer, R. and Welten, S. 2010. Social audio features for advanced music retrieval interfaces. In Proc. of ACM MM.
13. Langlois, T., Chambel, T., Oliveira, E., Carvalho, P., Marques, G., & Falcñño, A. 2010. VIRUS: Video Information Retrieval Using Subtitles. In Proc. of Acad. MindTrek'2010.
14. Langlois, T. & Marques, G. 2009. Music Classification Method based on Timbral Features. In Proc. of ISMIR'2009.
15. Li, T., and Ogihara, M. 2003. Detecting emotion in music. In Proc. of the Intl. Conf. on Music Information Retrieval, Baltimore MD, October.
16. Lohmann, S., Ziegler, J. and Tetzlaff, L. 2009. Comparison of Tag Cloud Layouts: Task-Related Performance and Visual Exploration. Proc. of INTERACT'09 Part I, Springer-Verlag Berlin, Heidelberg. 392--404.
17. Lund, A. M. 2001. Measuring usability with the USE questionnaire. Usability and User Experience, 8(2).
18. Martins, P., Langlois, T., & Chambel, T. 2011. MovieClouds: Content-Based Overviews and Exploratory Browsing of Movies. In Proc. of Academic MindTrek'2011, Tampere, Finland.
19. Miller, G. A. 1995. WordNet: A Lexical Database for English. Communications of the ACM 38(11): 39--41.
20. Oliveira, E., Benovoy, M., Ribeiro, N., & Chambel, T. 2011. Towards Emotional Interaction: Using Movies to Automatically Learn Users' Emotional States. In Proc. of Interact, Lisbon, Portugal, Sep 5--9
21. Pradeep K. Atrey, Namunu C. Maddage and Mohan S. Kankanhalli. 2006. Audio Based Event Detection For Multimedia Surveillance, ICASSP.
22. Wang, D., and Brown, G. J. Eds. 2006. Computational Auditory Scene Analysis, Principles, Algorithms and Applications, John Wiley & Sons Publishing.
23. Wang, J-C, Shih, Y-C, Wu, M-S, Wang, H-M, and Jeng, S-K. 2011. Colorizing Tags in Tag Cloud: A Novel Query-by-Tag Music Search System. Proc. of ACM MM, pp. 293--302.
24. Wattenburg, M., and Viegas, F. 2008. Tag Clouds and the Case for Vernacular Visualization. ACM Interactions, XV. 4.
25. Wu, H. C., Luk, R. W. P., Wong, K. F., and Kwok, K. L. 2008. Interpreting tf--idf term weights as making relevance decisions. ACM Trans. on Information Systems 26 (3): 1--37.
26. Zhou, D., Bousquet, O., Lal, T. N., Weston, J., and Schölkopf, B. 2004. Learning with local and global consistency. In Advances in Neural Information Processing Systems 16, pp. 321--328.

Index Terms

• Computing methodologies

  • Artificial intelligence

    • Computer vision

      • Computer vision problems

        • Video segmentation

      • Computer vision tasks

        • Video summarization

      • Image and video acquisition

• Hardware

  • Communication hardware, interfaces and storage

    • Signal processing systems

  • Robustness

    • Hardware reliability

      • Signal integrity and noise analysis

• Human-centered computing

  • Human computer interaction (HCI)

    • Interaction devices

      • Touch screens

    • Interaction paradigms

      • Graphical user interfaces

  • Interaction design

    • Interaction design process and methods

      • User centered design

• Information systems

  • Information retrieval

    • Retrieval models and ranking