Abstract
The evolution of multimedia applications has drastically changed human life and behaviors. New communication technologies lead to new requirements for multimedia synchronization. This article presents a historical view of temporal synchronization studies focusing on continuous multimedia. We demonstrate how the development of multimedia systems has created new challenges for synchronization technologies. We conclude with a new application-dependent, multilocation, multirequirement synchronization framework to address these new challenges.
- Akyildiz, I. F. and Yen, W. 1996. Multimedia group synchronization protocols for integrated services networks. IEEE J. Select. Areas Commun. 14, 1, 162--173. Google Scholar
Digital Library
- Anderson, D. P. and Homsy, G. 1991. A continuous media I/O server and its synchronization mechanism. IEEE Comput. 24, 10, 51--57. Google Scholar
Digital Library
- Bailey, B., Konstan, J., Cooley, R., and Dejong, M. 1998. Nsync—a toolkit for building interactive multimedia presentations. In Proceedings of the ACM International Conference on Multimedia. 257--266. Google Scholar
Digital Library
- Barrios, R. 1995. Examination of early sound musicals, with extensive coverage of Vitaphone. In A Song in the Dark, Oxford University Press.Google Scholar
- BellLabs. 1969. The picture of the future. Bell Labs Record 47, 134--186.Google Scholar
- Blakowski, G. and Steinmetz, R. 1996. A media synchronization survey: Reference model, specification, and case studies. IEEE J. Select. Areas Commun. 14, 1, 5--35. Google Scholar
Digital Library
- Blesser, B. 1978. Digitization of audio: A comprehensive examination of theory, implementation, and current practice. J. Audio Engi. Soci. 26, 739--771.Google Scholar
- Boronat, F., Cebollada, J. C. G., and Mauri, J. L. 2008. Study of delay jitter with and without peak rate enforcement. J. Multimedia Tools Appli. 40, 2, 285--319. Google Scholar
Digital Library
- Boronat, F., Lloret, J., and Garcia, M. 2009. Multimedia group and inter-stream synchronization techniques: A comparative study. Inf. Syst. 34, 108--131. Google Scholar
Digital Library
- Brandenburg, R., Stokking, H., van Deventer, O., Vaishnari, I., Boronat, F., and Montagud, M. 2012. IETF draft: RTCP for inter-destination media synchronization. http://tods.ietf.org/agenda/80/slides/artcore-5.pdf.Google Scholar
- Buchanan, M. and Zellweger, P. 2005. Automatic temporal layout mechanisms revisited. ACM Trans. Multimedia Comput. Commun. Appl. 1, 1, 60--88. Google Scholar
Digital Library
- Bulterman, D. 1993. Specification and support of adaptable networked multimedia. Multimedia Syst. 1, 2, 68--76.Google Scholar
Digital Library
- Bunn, J., Newman, H., and Wilkinson, R. 1998. Status report from the Caltech/CERN/HP “GIOD” joint project: Globally interconnected object databases. In Proceedings of the Conference on Computing in High Energy Physics.Google Scholar
- Campbell, A., Coulson, G., Garcla, F., and Hutchison, D. 1992. Orchestration services for distributed multimedia synchronisation. In Proceedings of the IFIP International Conference on High Performance Networking. Google Scholar
Digital Library
- Cluver, K. and Noll, P. 1996. Reconstruction of missing speech frames using sub-band excitation. In Proceedings of the IEEE International Symposium on Time-Frequency and Time-Scale Analysis. 277--280.Google Scholar
- Cronin, E., Kurc, A. R., Filstrup, B., and Jamin, S. 2004. An efficient synchronization mechanism for mirrored game architectures. In Proceedings of the 1st Workshop on Network and Support Systems for Games. Google Scholar
Digital Library
- Curcio, I. and Lundan, M. 2007. Human perception of lip synchronization in mobile environment. In Proceedings of the IEEE International Symposium on a World of Wireless, Mobile and Multimedia Networks.Google Scholar
- Damer, B. 1998. Avatars: Exploring and Building Virtual Worlds on the Internet. Peachpit Press. Google Scholar
Digital Library
- Dannenberg, R. and Stern, R. 1993. Experiments concerning the allowable skew of two audio channels operating in the stereo mode. Personal Communications.Google Scholar
- Ehley, L., Furth, B., and Ilyas, M. 1994. Evaluation of multimedia synchronization techniques. In Proceedings of the International Conference on Multimedia Computing and Systems. 110--119.Google Scholar
- Fujimoto, T., Ishibashi, Y., and Sugawara, S. 2008. Influences of inter-stream synchronization error on collaborative work in haptic and visual environments. In Proceedings of the IEEE Symposium on Haptic Interfaces for Virtual Environment and Teleoperator System. 113--119. Google Scholar
Digital Library
- Gardner, B. 1992. A realtime multichannel room simulator. In Proceedings of the 124th Meeting of the Acoustical Society of America.Google Scholar
- Ghinea, G. and Ademoye, O. A. 2010. Perceived synchronization of olfactory multimedia. IEEE Trans. Syst. Man, Cybernet. 40, 4, 657--663. Google Scholar
Digital Library
- Goldmann, L., Lee, J.-S., and Ebrahimi, T. 2010. Temporal synchronization in stereoscopic video: Influence on quality of experience and automatic asynchrony detection. In Proceedings of the IEEE International Conference on Image Processing. 3241--3244.Google Scholar
- Hodges, M., Sasnett, R., and Ackerman, M. 1989. Athena Mouse: A construction set for multimedia applications. IEEE Software. Google Scholar
Digital Library
- Hoshino, S., Ishibashi, Y., Fukushima, N., and Sugawara, S. 2011. Qoe assessment in olfactory and haptic media transmission: Influence of inter-stream synchronization error. In Proceedings of the IEEE International Workshop on Communications Quality and Reliability. 1--6.Google Scholar
- Hu, N. and Steenkiste, P. 2002. Estimating available bandwidth using packet pair probing. Tech. rep. CMU-CS-02-166. Carnegie Mellon University.Google Scholar
- Huang, Z. 2012. Synchronized distribution framework for high-quality multi-modal interactive teleimmersion. Ph.D. Dissertation, University of Illinois at Urbana-Champaign, Urbana, IL.Google Scholar
- Huang, Z., Mei, C., Li, L., and Woo, T. 2011. Cloudstream: Delivering high-quality streaming video through a cloud-based H.264/SVC proxy. In Proceedings of the IEEE International Conference on Computer Communications.Google Scholar
- Huang, Z., Wu, W., Nahrstedt, K., Arefin, A., and Rivas, R. 2010. Tsync: A new synchronization framework for multi-site 3D tele-immersion. In Proceedings of the ACM Workshop on Network and Operating Systems Support for Digital Audio and Video. Google Scholar
Digital Library
- Huang, Z., Wu, W., Nahrstedt, K., Rivas, R., and Arefin, A. 2011. Synccast: Synchronized dissemination in multi-site interactive 3D tele-immersion. In Proceedings of the ACM Multimedia Systems Conference. Google Scholar
Digital Library
- IEEE. 2008. IEEE 1588 standard: Precise time synchronization as the basis for real time applications in automation. http://www.nist.gov/el/isd/ieee/ieee1588.cfm.Google Scholar
- IETF. 2003. IETF RFC3550 standard - RTP: A transport protocol for real-time applications. http://www.ietf.org/rfc/rfc3550.txt.Google Scholar
- Ishibashi, Y. and Tasaka, S. 2000. A comparative survey of synchronization algorithms for continuous media in network environments. In Proceedings of the IEEE Conference on Local Computer Networks. 337--348. Google Scholar
Digital Library
- Ishibashi, Y., Tsuji, A., and Tasaka, S. 1997. A group synchronization mechanism for stored media in multicast communications. In Proceedings of the Annual Joint Conference of the IEEE Computer and Communications Societies. 692--700. Google Scholar
Digital Library
- Kohler, E., Handley, M., and Floyd, S. 2006. RFC4340: Datagram congestion control protocol (DCCP).Google Scholar
- Leroux, P., Verstraete, V., De Turck, F., and Demeester, P. 2007. Synchronized interactive services for mobile devices over ipdc/dvb-h and umts. In Proceedings of the IEEE/IFIP International Workshop on Broadband Convergence Networks. 1--12.Google Scholar
- Little, T. 1993. A framework for synchronous delivery of time-depdent multimedia data. Multimedia Syst. 1, 2, 87--94.Google Scholar
Digital Library
- Little, T. and Ghafoor, A. 1991. Spatio-temporal composition of distributed multimedia objects for value-added networks. IEEE Computer 24, 10, 42--50. Google Scholar
Digital Library
- Meyer, T., Effelsberg, W., and Steinmetz, R. 1994. A taxonomy on multimedia synchronization. In Proceedings of the IEEE Workshop on Future Trends of Distributed Computing Systems. 97--103.Google Scholar
- Michel, U. 2006. History of acoustic beamforming. In Proceedings of the Berlin Beamforming Conference.Google Scholar
- PictureTel. 1991. Picturetel in project with I.B.M. New York Times, October 22, 1991.Google Scholar
- Qiao, L. and Nahrstedt, K. 1997. Lip synchronizatioin within an adaptive VoD. In Proceedings of the SPIE Multimedia Computing and Network. 170--181.Google Scholar
- Ramanathan, S. and Rangan, P. 1993. Feedback techniques for intra-media continuity and inter-media synchronization in distributed media systems. Computer J. 36, 1, 19--31.Google Scholar
Cross Ref
- Ravindran, K. and Bansal, V. 1993. Delay compensation protocols for synchronization of multimedia data streams. IEEE Trans. Knowl. Data Eng. 4, 5, 574--589. Google Scholar
Digital Library
- Rothermel, K. and Helbig, T. 1995. An adaptive stream synchronization protocol. In Proceedings of the ACM International Workshop on Network and Operating System Support for Digital Audio and Video. 189--202. Google Scholar
Digital Library
- Rouskas, G. N. and Baldine, I. 1997. Multicast routing with end-to-end delay and delay variation constraints. IEEE J. Select. Areas Commun. 15, 3, 346--356. Google Scholar
Digital Library
- Shi, S. Y., Turner, J. S., and Waldvogel, M. 2001. Dimensioning server access bandwidth and multicast routing in overlay networks. In Proceedings of the ACM International Workshop on Network and Operating System Support for Digital Audio and Video. 83--92. Google Scholar
Digital Library
- Steinmetz, R. 1990. Analyse von synchronisation mechanismen mit anwendung im multimedia-bereich. In Proceedings of the GI ITG Workshop Sprachen und System zur Parallelverarbeitung. 39--47.Google Scholar
- Steinmetz, R. and Engler, C. 1993. Human perception of media synchronization. Tech. rep. 43.9310, IBM European Networking Center Heidelberg.Google Scholar
- Steinmetz, R. and Nahrstedt, K. 1995. Multimedia Computing, Communications and Applications. Prentice Hall. Google Scholar
Digital Library
- Stockham, T. 1972. A/D and D/A converters: Their effect on digital audio fidelity. In Digital Signal Processing, IEEE Press, 55--66.Google Scholar
- Tov, S.-Y. 2005. Happy 10th birthday, VoIP. Haaretz, June 16, 2005.Google Scholar
- Wahl, T. and Rothermel, K. 1994. Representing time in multimedia systems. In Proceedings of the IEEE International Conference on Multimedia Computing and Systems. 538--543.Google Scholar
- Wallis, A. 1995. Cambridge corners the future in networking. TWANZ 5, 10.Google Scholar
- Williams, A., Gross, K., Brandenburg, R., and Stokking, H. 2013. RTP clock source signalling. IETF.Google Scholar
- Woo, M., Qazi, N., and Ghafoor, A. 1994. A synchronization framework for communication of pre-orchestrated multimedia information. IEEE Netw. 1, 8, 52--61. Google Scholar
Digital Library
- Yang, Z., Wu, W., Nahrstedt, K., Kurillo, G., and Bajcsy, R. 2010. Enabling multi-party 3d tele-immersive environments with viewcast. ACM Trans. Multimedia Comput. Commun. Appl. 6, 2. Google Scholar
Cross Ref
- Yavatkar, R. 1992. MCP: A protocol for coordination and temporal synchronization in collaborative applications. In Proceedings of the IEEE International Conference Distributed Computing Systems. 606--613.Google Scholar
Cross Ref
- Zimmermann, R. and Liang, K. 2008. Spatialized audio streaming for networked virtual environments. In Proceedings of the ACM International Conference on Multimedia. 299--308. Google Scholar
Digital Library
Index Terms
Evolution of temporal multimedia synchronization principles: A historical viewpoint
Recommendations
Multiple-Scent Enhanced Multimedia Synchronization
Special Issue on Multiple Sensorial (MulSeMedia) Multimodal Media : Advances and ApplicationsThis study looked at users' perception of interstream synchronization between audiovisual media and two olfactory streams. The ability to detect skews and the perception and impact of skews on user Quality of Experience (QoE) is analyzed. The olfactory ...
Modeling distributed multimedia synchronization with DSPN
AbstractMultimedia synchronization is the essential technology for the integration of multimedia in distributed multimedia systems. The multimedia synchronization model has been recognized by many researchers as a premise of the implementation of ...
Design and Evaluation of a Distributed Multimedia Synchronization Algorithm using Media Scalings and Variable Service Rates
ICPADS '97: Proceedings of the 1997 International Conference on Parallel and Distributed SystemsThis paper presents a distributed multimedia synchronization algorithm that supports both intramedia and intermedia Synchronizations. The intramedia synchronization is achieved by media scaling techniques, and the intermedia synchronization is achieved ...






Comments