Michael G. Christel
Alexander G. Hauptmann
ABSTRACT
This paper introduces the video collage, a novel effective interface for browsing and interpreting video collections. The paper discusses how collages are automatically produced, illustrates their use, and evaluates their effectiveness as summaries across news stories. Collages are presentations of text and images derived from multiple video sources, which provide an interactive visualization for a set of video documents, summarizing their contents and providing a navigation aid for further exploration. The dynamic creation of collages is based on user context, e.g., an originating query, coupled with automatic processing to refine the candidate imagery. Named entity identification and common phrase extraction provides descriptive text. The dynamic manipulation of collages allows user-directed browsing and reveals additional detail. The utility of collages as summaries is examined with respect to other published news summaries.
- Ahlberg, C. and Shneiderman, B. Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays, in Proc. ACM CHI '94 (Boston MA, April 1994), ACM Press, 313--317. Google Scholar
Digital Library
- Bates, M.J. The design of browsing and berrypicking techniques for the on-line search interface. Online Review 13(5) (1989), 407--431.Google ScholarCross Ref
- Bikel, D. M., Miller, S., Schwartz, R., and Weischedel, R. 1997. Nymble: a high-performance learning name-finder, in Proc. 5th Conf. on Applied Natural Language Processing (ANLP) (Washington DC, April 1997), 194--201. Google ScholarDigital Library
- Boreczky, J., Girgensohn, A., Golovchinsky, G., and Uchihashi, S. An Interactive Comic Book Presentation for Exploring Video, in Proc. ACM CHI '00 (The Hague, Netherlands, April 2000), ACM Press, 185--192. Google ScholarDigital Library
- Chang, S.-F., moderator. Multimedia Access and Retrieval: The State of the Art and Future Directions, in Proc. ACM Multimedia '99 (Orlando FL, Nov. 1999), ACM Press, 443--445. Google ScholarDigital Library
- Christel, M. Visual Digests for News Video Libraries, in Proc. ACM Multimedia '99 (Orlando FL, Nov. 1999), ACM Press, 303--311. Google ScholarDigital Library
- Christel, M. and Warmack, A. The Effect of Text in Storyboards for Video Navigation, in Proc. IEEE ICASSP (Salt Lake City UT, May 2001), vol. III, 1409--1412. Google ScholarDigital Library
- Clarkson, P. and Rosenfeld, R. Statistical language modeling using the CMU-Cambridge toolkit, in Proc. Eurospeech '97 (Rhodes, Greece, Sept. 1997), Assoc., 2707--2710.Google Scholar
- Ding, W., Marchionini, G., and Soergel, D. Multimodal Surrogates for Video Browsing, in Proc. ACM Conf. on Digital Lib. (Berkeley, CA, Aug. 1999), ACM Press, 85--93. Google ScholarDigital Library
- Google search engine (as of April, 2002), © 2002 Google, http://www.google.com.Google Scholar
- Hearst, M.A. User Interfaces and Visualization. In Modern Information Retrieval, edited by R. Baeza-Yates and B. Ribeiro-Neto, Addison Wesley/ACM Press, New York, 1999.Google Scholar
- Infoplease.com. 2001 People in the News, © 2002 Learning Network, http://www.infoplease.com/ipa/A0878485.html.Google Scholar
- Large, A., Beheshti, J., Breuleux, A., and Renaud, A. Multimedia and Comprehension: The Relationship among Text, Animation, and Captions. J. American Society for Information Science 46(5) (June 1995), 340--347. Google ScholarDigital Library
- Li, F., Gupta, A., Sanocki, E., He, L., & Rui, Y. Browsing Digital Video, in Proc. ACM CHI '00 (The Hague, Netherlands, April 2000), ACM Press, 169--176. Google ScholarDigital Library
- Merlino, A., Morey, D., and Maybury, M. Broadcast News Navigation using Story Segmentation, in Proc. ACM Multimedia '97 (Seattle WA, Nov. 1997), ACM Press, 381--391. Google ScholarDigital Library
- Miller, D., Schwartz, R., Weischedel, R., and Stone, R. Named Entity Extraction for Broadcast News, in Proc. DARPA Broadcast News Workshop (Washington DC, March 1999), http://www.nist.gov/speech/publications/darpa99/html/ie20/ie20.htm.Google Scholar
- Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. HCI Lab, Inst. Systems Research, Inst. Advanced Computer Studies, Dept. of Computer Science Tech. Report CS-TR-3665, Univ. of Maryland, (July 1996). Google ScholarDigital Library
- Van Rijsbergen, C. J. Information Retrieval. London: Butterworths, 1979. Google ScholarDigital Library
- Wactlar, H., Christel, M., Gong, Y., and Hauptmann, A. Lessons Learned from the Creation and Deployment of a Terabyte Digital Video Library. IEEE Computer 32(2) (Feb. 1999), 66--73. Google ScholarDigital Library
- Who2.com. Find Famous People Fast!, © 2002 by Who2?, http://www.who2.com.Google Scholar
- Zhang, H.J., Gong, Y.H., Smoliar, S.W., and Yan, S.Y. Automatic Parsing of news video, in Proc. IEEE Conf. on Multimedia Computing and Systems (Boston MA, May 1994), 45--54.Google Scholar
Index Terms
Collages as dynamic summaries for news video
Recommendations
Temporal Summaries: Supporting Temporal Categorical Searching, Aggregation and Comparison
When analyzing thousands of event histories, analysts often want to see the events as an aggregate to detect insights and generate new hypotheses about the data.An analysis tool must emphasize both the prevalence and the temporal ordering of these ...
Visualizing Change over Time Using Dynamic Hierarchies: TreeVersity2 and the StemView
To analyze data such as the US Federal Budget or characteristics of the student population of a University it is common to look for changes over time. This task can be made easier and more fruitful if the analysis is performed by grouping by attributes, ...
Browsing Zoomable Treemaps: Structure-Aware Multi-Scale Navigation Techniques
Treemaps provide an interesting solution for representing hierarchical data. However, most studies have mainly focused on layout algorithms and paid limited attention to the interaction with treemaps. This makes it difficult to explore large data sets ...
Comments