Enhanced exploration of oral history archives through processed video and synchronized text transcripts

ABSTRACT

A digital video library of over 900 hours of video and 18000 stories from The HistoryMakers was used by 266 students, faculty, librarians, and life-long learners interacting with a system providing multiple search and viewing capabilities over a trial period of several months. User demographics and actions were logged with this multimedia collection, providing quantitative and qualitative metrics on system use. These transaction logs were complemented with heuristic evaluation, interviews, and contextual inquiry with representative users. Collectively, these mixed methods informed the development of the next generation web-based interface for the HistoryMakers video oral histories to improve access to and dissemination of this rich cultural resource. In particular, the feature of a synchronized text transcript in the video player for the narratives merited further investigation. Such an interface has not seen widespread use in digital video players available on the web, yet was valued highly by oral history archive viewers. A user study with 27 participants measured the utility of the HistoryMakers web interface incorporating the synchronized transcript video player for stated fact-finding and open-ended tasks. For life oral histories, an aligned text transcript is valued for both tasks, with the video rated significantly more useful for open-ended tasks over fact-finding. These results suggest a task-dependent role of modality in presentation of oral histories, with synchronized transcripts rated highly across tasks.

References

1. Alberti, C., Bacchiani, M., Bezman, A., Chelba, C., Drofa, A., Liao, H., Moreno, P., Power, T., Sahuguet, A., Shugrina, M., and Siohan, O. An Audio Indexing System for Election Video Material. In Proc. ICASSP 2009, IEEE (2009), 4873--4876.
2. Beyer, H., Holtzblatt, K. Contextual Design: Defining Customer-Centered Systems. Academic Press, London, UK, 1998.
3. Christel, M., Richardson, J., and Wactlar, H. Facilitating access to large digital oral history archives through Informedia technologies. In Proc. JCDL 2006, ACM Press (2006), 194--195. DOI= http://doi.acm.org/10.1145/1141753.1141795.
4. Christel, M., and Frisch, M. Evaluating the contributions of video representation for a life oral history collection. In Proc. JCDL 2008, ACM Press (2008), 241--250. DOI= http://doi.acm.org/10.1145/1378889.1378929.
5. Frisch, M. 2003. Working-Class Public History in the Context of Deindustrialization: Dilemmas of Authority and the Possibilities of Dialogue. Labour/Le Travail 51 (2003).
6. George Mason University. Oral History Program. http://sca.gmu.edu/oral_history.htm.
7. Hearst, M. A. TileBars: Visualization of Term Distribution Information in Full Text Information Access. In Proc. CHI 1995, ACM Press (2005), 59--66. DOI= http://doi.acm.org/10.1145/223904.223912.
8. HistoryMakers. The HistoryMakers.com African American History Archive. http://www.thehistorymakers.com.
9. HistoryMakers and Informedia Digital Video Library. The HistoryMakers IDVL Digital Archive, http://www.idvl.org/thehistorymakers.
10. Jong, F. D., Oard, D. W., Heeren, W., and Ordelman, R. Access to recorded interviews: A research agenda. J. Comput. Cult. Herit. 1, 1 (2008), 1--27. DOI= http://doi.acm.org/10.1145/1367080.1367083.
11. Klemmer, S. R., Graham, J., Wolff, G. J., and Landay, J. A. Books with voices: paper transcripts as a physical interface to oral histories. In Proc. CHI 2003, ACM Press (2003), 89--96. DOI= http://doi.acm.org/10.1145/642611.642628.
12. Lemur Toolkit for Language Modeling and Information Retrieval. http://www.lemurproject.org.
13. Marchionini, G. Exploratory Search: From Finding to Understanding. CACM 49, 4 (2006), 41--46. DOI= http://doi.acm.org/10.1145/1121949.1121979.
14. Microsoft Research. Project Tuva. http://research.microsoft.com/apps/tools/tuva/index.html.
15. Munteanu, C., Baecker, R., and Penn, G. Collaborative Editing for Improved Usefulness and Usability of Transcript-Enhanced Webcasts. In Proc. CHI 2008, ACM Press (2008), 373--382. DOI= http://doi.acm.org/10.1145/1357054.1357117.
16. Nielsen, J. and Molich, R. Heuristic evaluation of user interfaces. In Proc. CHI 1990, ACM Press (1990), 249--256. DOI= http://doi.acm.org/10.1145/97243.97281.
17. Vemuri, S., DeCamp, P., Bender, W., and Schmandt, C. Improving Speech Playback Using Time-Compression and Speech Recognition. In Proc. CHI 2004, ACM Press (2004), 295--302. DOI= http://doi.acm.org/10.1145/985692.985730.

Index Terms

• Information systems

  • Information retrieval