Visual digests for news video libraries

ABSTRACT

The Informedia Digital Video Library contains over 2000 hours of video, growing at a rate of 15 hours per week. A good query engine is not sufficient for information retrieval because often the candidate result sets grow in number as the library grows. Video digests summarize sets of stories from the library, providing users with a visual mechanism for interactive browsing and query refinement. These digests are generated dynamically under the direction of the user based on automatically derived metadata from the video library. Three types of digests are discussed: VIBE digests emphasizing word relationships, timelines showing trends against time, and maps showing geographic correlations. Multiple digests can be combined into a single view or animated into a temporal presentation.

References

1. 1.Ahlberg, C. and Shneiderman, B. Visual Information Seeking: Tight Coupling of Dynamic Query Filters with Starfield Displays. In Proc. of CHI '94 (Boston MA, April 1994), ACM Press, 313-322.
2. 2.Allan, J., Carbonell, J., Doddington, G., Yamron, I., and Yang, Y. Topic Detection and Tracking Pilot Study: Final Report. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998), 194-218.
3. 3.Christel, M.G. and Martin, D.J. Information Visualization within a Digital Video Library. Journal of Intelligent Information Systems, 11(3) (Nov/Dec 1998), 235-257.
4. 4.Christel, M.G., and Olligschlaeger, A.M. Interactive Maps for a Digital Video Library. In Proc. Int'l Conf. on Multimedia Computing and Systems (Florence, Italy, June 1999), IEEE Press, 381-387.
5. 5.Chfistel, M.G., Winkler, D.B., & Taylor, C.R. Multimedia Abstractions for a Digital Video Library. In Proc. 2nd ACM Conf. on Digital Libraries, R. Allen & E. Rasmussen, eds. (Philadelphia PA, July 1997), ACM Press, 21-29.
6. 6.Environmental Systems Research Institute, Inc., home page, httv://www.esri.com/
7. 7.Hauptmann, A.G., Jones, R.E., Seymore, K., Siegler, M.A., Slattery, S.T., and Witbrock, M.J. Experiments in Information Retrieval from Spoken Documents. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998), 175-181.
8. 8.Hauptmann, A.G., and Witbrock, M.J. Story Segmentation and Detection of Commercials in Broadcast News Video. In Proc. IEEE Advances in Digital Libraries Conf. (Santa Barbara CA, April 1998).
9. 9.Houghton, R. Automatic Accumulation of a Scalable Named Face Database. iEEE Intelligent Systems, 1999, in press.
10. 10.Kubala, F., Schwartz, R., Stone, R., and Weischedel, R. Named Entity Extraction from Speech. In Proc. DARPA Workshop on Broadcast News Understanding Systems (Lansdowne VA, February 1998).
11. 11.Mani, I., House, D., Maybury, M. and Green, M. Towards Content-Based Browsing of Broadcast News Video. in Intelligent Multimedia Information Retrieval, M. Maybury, ed. AAAI Press/MIT Press: Menlo Park CA, 1997.
12. 12.Olsen, K. A., Korfhage, R. R., Sochats, K. M., Spring, M. B., and Williams, J. G. Visualization of a Document Collection: The VIBE System. Information Processing & Management, 29(1), 69-81.
13. 13.Sato, T., Kanade, T., Hughes, E., and Smifil, M. Video OCR for Digital News Archive. In Proc. Workshop on Content- Based Access of image and Video Databases. (Los Alamitos CA, Jan 1998), 52-60.
14. 14.Shneiderman, B. The Eyes Have It: A Task by Data Type Taxonomy for Information Visualizations. HCI Lab, Inst. Systems Research, Inst. Advanced Computer Studies, Dept. of Computer Science Tech. Report CS-TR-3665, Univ. of Maryland, (July 1996).
15. 15.Wactlar, H., Christel, M., Gong, Y., and Hauptmann, A. Lessons Learned from the Creation and Deployment of a Terabyte Digital Video Library. IEEE Computer, 32(2) (February 1999), 66-73.

Index Terms

• Applied computing

  • Computers in other domains

    • Digital libraries and archives

• Information systems

  • Information systems applications

    • Digital libraries and archives

    • Multimedia information systems