Diogo Cabral
ABSTRACT
This paper presents a video annotator that supports multimodal annotation and is applied to contemporary dance as a creation tool. The Creation-Tool was conceived and designed to assist the creative processes of choreographers, working as a digital notebook for personal annotations. The prototype, developed for Tablet PCs, is a real-time multimodal video annotator based on keyboard, pen and voice inputs. In addition, a remote control for mobile devices was added to the system. Two types of annotations were defined: annotation marks and regular annotations. The annotations marks are defined by a keyword and an icon, in contrast to regular annotations that do not have a pre-defined structure. Motion tracking defines the dynamic behavior of the annotations and voice input complements the other modalities.
References
- Bradski, G. R. 1998. Computer Vision Face Tracking For Use in a Perceptual User Interface. Intel Technology Journal, 2, 2, 12--21.Google Scholar
- Bulterman, D. 2004.Animating peer-level annotations within web-based multimedia. In EuroGraphics Multimedia Workshop 2004, Euro-graphics Association, 49--57. Google Scholar
- Calonder, M., Lepetit, V., Strecha, C. and Fua, P. 2010. BRIEF: binary robust independent elementary features. In Proc. ECCV'10 . Springer-Verlag, 778--792. Google Scholar
- Cabral, D. and Correia, N. 2009. Pen-Based Video Annotations: A Proposal and a Prototype for Tablet PCs. In Proc. INTERACT'09. Springer-Verlag, 17--20. Google Scholar
- Cattelan, R. G., Teixeira, C., Goularte, R., and Pimentel, M. C. 2008. Watch-and-comment as a paradigm toward ubiquitous interactive video editing. ACM Trans. Multimedia Comput. Commun. Appl. 4, 4, 28 -52. Google Scholar
- Cherry, G., Fournier, J., and Stevens, R. 2003. Using a digital video annotation tool to teach dance composition. Interactive Multimedia Electronic Journal of Computer-Enhanced Learning.Google Scholar
- Chiu, P., Kapuskar, A., Reitmeier, S., and Wilcox, L. 1999. NoteLook: taking notes in meetings with digital video and ink. In Proc. ACM MM'99. ACM, 149--158. Google Scholar
- Correia, N. and Chambel, T. 1999. Active video watching using annotation. In Proc. ACM MM'99. ACM, 151--154. Google Scholar
- Diakopoulos, N. and Essa, I. 2006. Videotater: an approach for pen-based digital video segmentation and tagging. In Proc. UIST'06. ACM, 221--224. Google Scholar
- Goldman, D. B., Gonterman, C., Curless, B., Salesin, D., and Seitz, S. M. 2008. Video object annotation, navigation, and composition. In Proc. UIST'08. ACM, 3--12. Google Scholar
- Kannan, R., Andres, F., and Guetl, C. 2010. DanVideo: an MPEG-7 authoring and retrieval system for dance videos. Multimedia Tools Appl. 46, 2--3, 545--572. Google Scholar
- Li, Y., Hinckley, K., Guan, Z., and Landay, J. A. 2005. Experimental analysis of mode switching techniques in pen-based user interfaces. In Proc. CHI'05. ACM, 461--470. Google Scholar
- Ramos, G. and Balakrishnan, R. 2003. Fluid interaction techniques for the control and annotation of digital video. In Proc. UIST'03. ACM, 105--114. Google Scholar
- Rosten, E. and Drummond, T. 2006. Machine learning for high-speed corner detection. In Proc. of ECCV (1). 430--443. Google Scholar
- VideoAnnEx, http://www.research.ibm.com/VideoAnnEx/Google Scholar
- Weher, K. and Poon, A. 1994. Marquee: a tool for real-time video logging. In Proc. CHI'94. ACM, 58--64. Google Scholar
Index Terms
A creation-tool for contemporary dance using multimodal video annotation
Comments