Abstract
The literature reports research efforts allowing the editing of interactive TV multimedia documents by end-users. In this article we propose complementary contributions relative to end-user generated interactive video, video tagging, and collaboration. In earlier work we proposed the watch-and-comment (WaC) paradigm as the seamless capture of an individual's comments so that corresponding annotated interactive videos be automatically generated. As a proof of concept, we implemented a prototype application, the WaCTool, that supports the capture of digital ink and voice comments over individual frames and segments of the video, producing a declarative document that specifies both: different media stream structure and synchronization.
In this article, we extend the WaC paradigm in two ways. First, user-video interactions are associated with edit commands and digital ink operations. Second, focusing on collaboration and distribution issues, we employ annotations as simple containers for context information by using them as tags in order to organize, store and distribute information in a P2P-based multimedia capture platform. We highlight the design principles of the watch-and-comment paradigm, and demonstrate related results including the current version of the WaCTool and its architecture. We also illustrate how an interactive video produced by the WaCTool can be rendered in an interactive video environment, the Ginga-NCL player, and include results from a preliminary evaluation.
- Abowd, G. D., Mynatt, E. D., and Rodden, T. 2002. The human experience. IEEE Pervasive Comput. 1, 1, 48--57. Google Scholar
Digital Library
- Belmont, V. 2006. Create your own video blog. CNet Reviews, http://reviews.cnet.com/Create_your_own_video_blog4660-10165_7-6634979.html.Google Scholar
- Bulterman, D. C. A. 2003. Using smil to encode interactive, peer-level multimedia annotations. In Proceedings of the ACM Symposium on Document Engineering (DocEng'03). ACM, New York, 32--41. Google Scholar
Digital Library
- Bulterman, D. C. A., César, P., and Jansen, A. J. 2006. An architecture for viewer-side enrichment of tv content. In Proceedings of the 14th Annual ACM International Conference on Multimedia (MULTIMEDIA'06). ACM, New York, 651--654. Google Scholar
Digital Library
- Butkus, A. and Petersen, M. 2007. Semantic modelling using tv-anytime genre metadata. In Proceedings of the European Interactive Television Conference. 226--234. Google Scholar
Digital Library
- Cattelan, R. and Pimentel, M. 2008. Supporting multimedia capture in mobile computing environments through a peer-to-peer platform. In Proceedings of the ACM Symposium on Applied Computing (SAC'08). ACM, New York, 1246--1251. Google Scholar
Digital Library
- Cattelan, R. G., Teixeira, C., Ribas, H., Munson, E., and Pimentel, M. 2008. Inkteractors: interacting with digital ink. In Proceedings of the ACM Symposium on Applied Computing (SAC'08). ACM, New York, 1246--1251. Google Scholar
Digital Library
- César, P., Bulterman, D. C. A., and Jansen, A. J. 2006a. The ambulant annotator: empowering viewer-side enrichment of multimedia content. In Proceedings of the ACM Symposium on Document Engineering (DocEng'06). ACM, New York, 186--187. Google Scholar
Digital Library
- César, P., Bulterman, D. C. A., and Jansen, A. J. 2006b. Benefits of structured multimedia documents in idtv: the end-user enrichment system. In Proceedings of the 2006 ACM Symposium on Document Engineering (DocEng'06). ACM, New York, 176--178. Google Scholar
Digital Library
- César, P., Bulterman, D. C. A., and Jansen, A. J. 2008. Usages of the secondary screen in an interactive television environment: Control, enrich, share, and transfer television content. In Proceedings of the European Interactive Television Conference. 168--177. Google Scholar
Digital Library
- César, P., Bulterman, D. C. A., Obrenovic, Z., Ducret, J., and Cruz-Lara, S. 2007. An architecture for non-intrusive user interfaces for interactive digital television. In Proceedings of the European Interactive Television Conference. 11--20. Google Scholar
Digital Library
- Coppens, T., Trappeniers, L., and Godon, M. 2004. Amigotv: towards a social tv experience. In Proceedings of the European Interactive Television Conference.Google Scholar
- de Resende Costa, R. M., Moreno, M. F., Rodrigues, R. F., and Soares, L. F. G. 2006. Live editing of hypermedia documents. In Proceedings of the ACM Symposium on Document Engineering (DocEng'06). ACM, New York, 165--172. Google Scholar
Digital Library
- den Ende, N. V., de Hesselle, H., and Meesters, L. 2007. Towards content-aware coding: User study. In Proceedings of the European Interactive Television Conference. 185--194. Google Scholar
Digital Library
- Geerts, D. 2006. Comparing voice chat and text chat in a communication tool for interactive television. In Proceedings of the 4th Nordic Conference on Human-Computer Interaction (NordiCHI'06). ACM, New York, 461--464. Google Scholar
Digital Library
- Girgensohn, A., Boreczky, J., Chiu, P., Doherty, J., Foote, J., Golovchinsky, G., Uchihashi, S., and Wilcox, L. 2000. A semi-automatic approach to home video editing. In Proceedings of the 13th Annual ACM Symposium on User Interface Software and Technology (UIST'00). ACM, New York, 81--89. Google Scholar
Digital Library
- Goularte, R., Cattelan, R. G., Camacho-Guerrero, J. A., Valter R. Inácio, J., and da Graça C. Pimentel, M. 2004. Interactive multimedia annotations: enriching and extending content. In Proceedings of the ACM Symposium on Document Engineering (DocEng'04). ACM, New York, 84--86. Google Scholar
Digital Library
- Guimarães, R. L., Costa, R. M. R., and Soares, L. F. G. 2008. Composer: Authoring tool for itv programs. In Proceedings of the European Interactive Television Conference. 61--71. Google Scholar
Digital Library
- Harboe, G., Massey, N., Metcalf, C., Wheatley, D., and Romano, G. 2008. The uses of social television. Comput. Entertain. 6, 1, 1--15. Google Scholar
Digital Library
- Hemmeryckx-Deleersnijder, B. and Thorne, J. M. 2007. Awareness and conversational context sharing to enrich tv based communication. In Proceedings of the European Interactive Television Conference. 1--10. Google Scholar
Digital Library
- Hua, X.-S. and Li, S. 2006. Interactive video authoring and sharing based on two-layer templates. In Proceedings of the 1st ACM International Workshop on Human-Centered Multimedia (HCM'06). ACM, New York, 65--74. Google Scholar
Digital Library
- Hua, X.-S., Lu, L., and Zhang, H.-J. 2004. P-karaoke: personalized karaoke system. In Proceedings of the 12th Annual ACM International Conference on Multimedia (MULTIMEDIA'04). ACM, New York, 172--173. Google Scholar
Digital Library
- Kindberg, T., Spasojevic, M., Fleck, R., and Sellen, A. 2005. I saw this and thought of you: some social uses of camera phones. In Proceedings of the Extended Abstracts Conference on Human Factors in Computing Systems (CHI'05). ACM, New York, 1545--1548. Google Scholar
Digital Library
- Kirk, D., Sellen, A., Harper, R., and Wood, K. 2007. Understanding videowork. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). ACM, New York, 61--70. Google Scholar
Digital Library
- Liu, K.-Y. and Chen, H.-Y. 2005. Exploring media correlation and synchronization for navigated hypermedia documents. In Proceedings of the 13th Annual ACM International Conference on Multimedia (MULTIMEDIA'05). ACM, New York, 61--70. Google Scholar
Digital Library
- Luyten, K., Thys, K., Huypens, S., and Coninx, K. 2006. Telebuddies: social stitching with interactive television. In Proceedings of the Extended Abstracts Conference on Human Factors in Computing Systems (CHI'06). ACM, New York, 1049--1054. Google Scholar
Digital Library
- Madhwacharyula, C. L., Davis, M., Mulhem, P., and Kankanhalli, M. S. 2006. Metadata handling: A video perspective. ACM Trans. Multimed. Comput. Comm. Appl. 2, 4, 358--388. Google Scholar
Digital Library
- Nielsen, J. 1992. Finding usability problems through heuristic evaluation. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'92). ACM, New York, 373--380. Google Scholar
Digital Library
- Pimentel, M., Baldochi, L., and Cattelan, R. 2007. Prototyping applications to document human experiences. IEEE Pervasive Comput. 6, 2, 93--100. Google Scholar
Digital Library
- Pimentel, M., Goularte, R., Cattelan, R., Santos, F., and Teixeira, C. 2007. Enhancing multimodal annotations with pen-based information. In Proceedings of the Workshop on New Techniques for Consuming, Managing, and Manipulating Interactive Digital Media at Home. IEEE Computer Society, Los Alamitos, CA, 207--213. Google Scholar
Digital Library
- Pimentel, M., Goularte, R., Cattelan, R., Santos, F., and Teixeira, C. 2008. Ubiquitous interactive video editing via multimodal annotations. In Proceedings of the European Interactive Television Conference. 72--81. Google Scholar
Digital Library
- Ramos, G. and Balakrishnan, R. 2003. Fluid interaction techniques for the control and annotation of digital video. In Proceedings of the 16th Annual ACM Symposium on User Interface Software and Technology (UIST'03). ACM, New York, NY, 105--114. Google Scholar
Digital Library
- Regan, T. and Todd, I. 2004. Media center buddies: instant messaging around a media center. In Proceedings of the 3rd Nordic Conference on Human-Computer Interaction (NordiCHI'04). ACM, New York, NY, 141--144. Google Scholar
Digital Library
- Ross, J. M. and Ross, K. R. 2005. Developing web-based video training modules to aid students learning multimedia skills. J. Comput. Small Coll. 21, 2, 281--287. Google Scholar
Digital Library
- Sadka, A. H. 2004. Visnet: Noe on networked audiovisual media technologies. In Proceedings of the Workshop on Image Analysis for Multimedia Interactive Services.Google Scholar
- Shamma, D. A., Shaw, R., Shafton, P. L., and Liu, Y. 2007. Watch what i watch: using community activity to understand content. In Proceedings of the International Workshop on Multimedia Information Retrieval (MIR'07). ACM, New York, 275--284. Google Scholar
Digital Library
- Shaw, R. and Schmitz, P. 2006. Community annotation and remix: a research platform and pilot deployment. In Proceedings of the 1st ACM International Workshop on Human-Centered Multimedia (HCM'06). ACM, New York, 89--98. Google Scholar
Digital Library
- Truong, B. T. and Venkatesh, S. 2007. Video abstraction: A systematic review and classification. ACM Trans. Multimed. Comput. Comm. Appl. 3, 1, 3. Google Scholar
Digital Library
- Tsekleves, E., Cruickshank, L., Hill, A., Kondo, K., and Whitham, R. 2007. Interacting with digital media at home via a second screen. In Proceedings of the Workshop on New Techniques for Consuming, Managing, and Manipulating Interactive Digital Media at Home. IEEE Computer Society, Los Alamitos, CA, 201--206. Google Scholar
Digital Library
- Ullmer, B., Ishii, H., and Glas, D. 1998. mediablocks: physical containers, transports, and controls for online media. In Proceedings of the 25th Annual Conference on Computer Graphics and Interactive Techniques (SIGGRAPH'98). ACM, New York, 379--386. Google Scholar
Digital Library
- Weiser, M. 1991. The computer for the 21st century. Scientific American 265, 3, 94--104.Google Scholar
Cross Ref
- Weisz, J. D., Kiesler, S., Zhang, H., Ren, Y., Kraut, R. E., and Konstan, J. A. 2007. Watching together: integrating text chat with video. In Proceedings of the SIGCHI Conference on Human Factors in Computing Systems (CHI'07). ACM, New York, 877--886. Google Scholar
Digital Library
- Wright, P. C. and Monk, A. F. 1991. The use of think-aloud evaluation methods in design. SIGCHI Bull. 23, 1, 55--57. Google Scholar
Digital Library
- Zigelbaum, J., Horn, M. S., Shaer, O., and Jacob, R. J. K. 2007. The tangible video editor: collaborative video editing with active tokens. In Proceedings of the 1st International Conference on Tangible and Embedded Interaction (TEI'07). ACM, New York, 43--46. Google Scholar
Digital Library
Index Terms
Watch-and-comment as a paradigm toward ubiquitous interactive video editing
Recommendations
User-media interaction with interactive TV
SAC '09: Proceedings of the 2009 ACM symposium on Applied ComputingWatching TV is a practice many people enjoy and feel comfortable with. We propose the capture of the user interaction while interacting with a remote control to watch TV: such detailed information is most valuable to many applications and services. We ...
Ubiquitous end-user live editing of interactive multimedia programs
WebMedia '08: Proceedings of the 14th Brazilian Symposium on Multimedia and the WebWatching TV is a practice many people enjoy and feel comfortable with. In the context of interactive TV, a program is defined by means of a structured multimedia document delivered to the viewer's digital TV equipment. While watching TV, a user can be ...
SMS as interactive channel for portable digital TV receivers
EuroITV '11: Proceedings of the 9th European Conference on Interactive TV and VideoIn emerging countries the primary way of communication and entertainment is broadcast TV. Interactive TV content providers, especially the ones aiming handheld devices, can take advantage of SMS (Short Message Service) as a mechanism of returning ...








Comments