skip to main content
article

Cache architecture for on-demand streaming on the Web

Published:01 September 2007Publication History
Skip Abstract Section

Abstract

On-demand streaming from a remote server through best-effort Internet poses several challenges because of network losses and variable delays. The primary technique used to improve the quality of distributed content service is replication. In the context of the Internet, Web caching is the traditional mechanism that is used. In this article we develop a new staged delivery model for a distributed architecture in which video is streamed from remote servers to edge caches where the video is buffered and then streamed to the client through a last-mile connection. The model uses a novel revolving indexed cache buffer management mechanism at the edge cache and employs selective retransmissions of lost packets between the remote and edge cache for a best-effort recovery of the losses. The new Web cache buffer management scheme includes a dynamic adjustment of cache buffer parameters based on network conditions. In addition, performance of buffer management and retransmission policies at the edge cache is modeled and assessed using a probabilistic analysis of the streaming process as well as system simulations. The influence of different endogenous control parameters on the quality of stream received by the client is studied. Calibration curves on the QoS metrics for different network conditions have been obtained using simulations. Edge cache management can be done using these calibration curves. ISPs can make use of calibration curves to set the values of the endogenous control parameters for specific QoS in real-time streaming operations based on network conditions. A methodology to benchmark transmission characteristics using real-time traffic data is developed to enable effective decision making on edge cache buffer allocation and management strategies.

References

  1. Albanese, A., Blomer, J., Edmonds, J., Luby, M., and Sudan, M. 1996. Priority encoding transmission. IEEE Trans. Inform. Theory, 42 (Nov), 1737--1744. Google ScholarGoogle ScholarCross RefCross Ref
  2. Anjum, F. and Jain, R. 2000. Performance of TCP over lossy upstream and downstream links with link level retransmissions. In Proceedings of the 8th IEEE International Conference on Networks (ICON'00). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Balkir, N. and Ozsoyoglu, G. 1998. Delivering presentations from multimedia servers. In Proceedings of the IEEE International Workshop on Multimedia DBMS.Google ScholarGoogle Scholar
  4. Berra, B., Golshani, F., Mehetro, R., and Sheng, O. 1993. Multimedia information systems. IEEE Trans. Knowl. Data Engin. 5, 4 (Aug), 545--550. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Bolot J. and Turletti, T. 1996. Adaptive error control for packet video in the Internet. In Proceedings of the IEEE International Conference on Image Processing (ICIP'96), 25--28.Google ScholarGoogle Scholar
  6. Bouazizi, I. and Gunes, M. 2003. Selective proxy caching for robust video transmission over lossy networks. In IEEE ITRE, Special Session for Robust Video Transmission.Google ScholarGoogle Scholar
  7. Bouthillier, L. 2003. Streaming vs. downloading video: Understanding the differences. Streaming Media.Com, http://www.streamingmedia.com/article.asp?id=8456&page=2&c=11 Accessed April 2007.Google ScholarGoogle Scholar
  8. Briceno, H., Gortler, S., and McMillan, L. 1999. NAÏVE---Network aware internet video encoding. In Proceedings of 7th ACM Multimedia Conference. 251--260. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Chen, S., Shen, B., Wee, S., and Zhang, X. 2004. Designs of high quality streaming proxy systems. In Proceedings of Twenty-Third Annual Joint Conference of the IEEE Computer and Communications Societies.Google ScholarGoogle Scholar
  10. Conklin, G., Greenbaum, G., Lillevold, K., Lippman, A., and Reznik, Y. 2001. Video coding for streaming media delivery on the Internet. IEEE Trans. Circuits Syst. Video Techn. 11, 3 (Mar.), 269--281. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Cuetos P. and Ross, K. 2003. Optimal streaming of layered video: joint scheduling and error concealment. In Proceedings of the 3rd ACM Multimedia Conference 55--64. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Dai, R., Stahl, D., and Whinston, A. 2003. The economics of smart routing and quality of service. Netwo. Group Comm. 318--331.Google ScholarGoogle Scholar
  13. Dempsey, B., Liebeherr, J., and Weaver, A. 1996. On retransmission based error control for continuous media traffic in packet-switching networks. Comp. Netw. ISDN Syst. 28, 5 (Mar.), 719-- 736. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Eleftheriadis, A. and Anastassiou, D. 1995. Meeting arbitrary QoS constraints using dynamic rate shaping of coded digital video. In Proceedings of 5th International Workshop Network and Operating System Support for Digital Audio and Video (NOSSDAV'95), 95-- 106. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Frossard, P. and Verscheure, O. 2002. Batched patch caching for streaming media. Comm. Let. 6, 4, 159--161Google ScholarGoogle ScholarCross RefCross Ref
  16. Fu, Y. and Vahdat, A. 2002. Service level agreement based distributed resource allocation for streaming hosting systems. In Proceedings of 7th International Workshop on Web Caching and Content Distribution (WCW).Google ScholarGoogle Scholar
  17. Girod, B., Horn, U., and Belzer, B. 1995. Scalable video coding with multiscale motion compensation and unequal error protection. In Proceedings of Symposium on Multimedia Communications and Video Coding.Google ScholarGoogle Scholar
  18. Grieco, R., Malandino, D., Scarano, V., Varriale, F., and Mazzoni, F. An Intermediary software infrastructure for edge services. Proceedings of the IEEE International Conference on Distributed Computing Systems Workshops, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Gupta, A., Jukic, B., Parameswaran, M., Stahl, D., and Whinston, A. 1997. Streamlining the digital economy: how to avert a tragedy of the commons. IEEE Internet Comput. 1, 6, 38--46. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Hemy, M., Hengartner, U., Steenkiste, P., and Gross, T. 1999. MPEG system streams in best-effort networks. In Proceedings of IEEE Packet Video.Google ScholarGoogle Scholar
  21. Hillestand, O. I., Libak, B., and Perkis, A. 2005. Performance evaluation of multimedia services over IP networks. In Proceedings of ICME.Google ScholarGoogle Scholar
  22. Hsiao, P., Kung, H., and Tan, K. 2001. Video over TCP with receiver-based delay control. In Proceedings of ACM NOSSDAV. 199--208. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Jin, S., Bestavros, A., and Iyengar, A. 2002. Accelerating Internet streaming media delivery using network-aware partial caching. In Proceedings of International Conference of Distrubuted Computer Systems. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Jin, S., Bestavros, A., and Iyengar, A. 2003. Network-aware partial caching for Internet streaming media. Multime. Syst. Springer-Verlag.Google ScholarGoogle Scholar
  25. Kangasharju, J., Hartanto, F., Reisslein, M., and Ross, K. 2002. Distributed Layered Encoded Video through Caches. IEEE Trans. Comput. 51, 6, (June), 622--636. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Karrer R. and Gross, T. 2001. Dynamic Handoff of Multimedia Streams. In Proceedings of ACM NOSSDAV. Port Jefferson, NY. 125--133. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Lee S. and Lee, S. 1998. Retransmission scheme for MPEG streams in mission critical multimedia applications. In Proceedings of 24th EUROMICRO Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Li, S., Wu, F., and Zhang, Y. 1999. Study of a new approach to improve FGS video coding efficiency. ISO/IEC JTC1/SC29/WG11, MPEG99/M5583.Google ScholarGoogle Scholar
  29. Li, X., Paul, S., and Ammar, M. 1998. Layered video multicast with retransmissions (LVMR): Evaluation of hierarchical rate control. In Proceedings of IEEE Infocom.Google ScholarGoogle Scholar
  30. Little, T. 1993. A framework for synchronous delivery of time-dependent multimedia data.Multime. Syst. 1, 2, 87--94.Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Lu Y. and Christensen, K. 1999. Using selective discard to improve real-time video quality on an ethernet local area network. Inter. J. Network Manage. 9, 106--117. Google ScholarGoogle ScholarCross RefCross Ref
  32. Marioni, R., Streaming video and the media. Rich Web. http://richweb.net/Streaming_Video_Articles. htm. Accessed April 2007.Google ScholarGoogle Scholar
  33. McCanne, S., Jacobson, V., and Vetterli, M. 1996. Receiver-driven layered multicast. In Proceedings of ACM SIGCOMM. 117--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Miao Z. and Ortega, A. 1999. Proxy caching for efficient video services over the Internet. In Proceedings of Packet Video.Google ScholarGoogle Scholar
  35. Mourad, A. 1996. Doubly striped disk mirroring: Reliable storage for video servers. Multimed. Tools Appl. 2, 253--272.Google ScholarGoogle ScholarCross RefCross Ref
  36. Mulabegovic, E., Schonfeld, D., and Ansari, R. 2002. Lightweight streaming protocol (LSP). In Proceedings of the 10th ACM International Conference on Multimedia. Juan-les-Pins, France. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Nithish, M., Ramakrishna, C., Ramkumar, J., and Lakshmi, P. 2002. Design and Evaluation of Intermediate retransmission and packet loss detection schemes for MPEG4 transmission. In Proceedings of the International Conference Information Technology: Coding and Computing (ITCC'04). Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Nonnenmacher, J., Biersack, E., and Towsley, D. 1998. Parity-Based Loss recovery for Reliable Multicast transmission. IEEE/ACM Trans. Netwo. 6, 4 (Aug.), 349--361. Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. Ozer, J. 2003. The moving picture: the problem with streaming. e-Media Live. http://www.emedialive.com/Articles/ReadArticle.aspx?ArticleID=8071. Accessed April 2007.Google ScholarGoogle Scholar
  40. Papadopoulos, C. and Parulkar, G. 1996. Retransmission-based error control for continuous media applications. In Proceedings of the International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV), 5--12.Google ScholarGoogle Scholar
  41. Piecuch, M., French, K., Oprica, G., and Claypool, M. 2000. A selective retransmission protocol for multimedia on the internet. In Proceedings of the SPIE International Symposium on Multimedia Systems and Applications.Google ScholarGoogle Scholar
  42. Puri, R., Lee, K., Ramchandran, K., and Bharghavan, V. 2000. Application of FEC-based multiple description coding to Internet video streaming and multicast,” In Proceedings of the Packet Video Workshop. Cagliari, Sardinia, Italy.Google ScholarGoogle Scholar
  43. Rabinovich, M. and Aggarwal, A. 1999. Radar: A scalable architecture for a global web hosting service, Comput. Netw. 31, 11--16, 1645--1661. Google ScholarGoogle ScholarDigital LibraryDigital Library
  44. Rabinovich, M. and Spatscheck, O. 2002. Web Caching and Replication, Addison-Wesley, Boston, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Rejaie, R., Handley, M., and Estrin, D. 1999. Quality adaptation for congestion controlled video playback over the Internet. In Proceedings of the ACM SIGCOMM. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Rejaie, R., Yu, H., Handley, M., and Estrin, D. 2000. Multimedia proxy caching for quality adaptive streaming applications in the Internet. In Proceedings of the 19th Annual Joint Conference of the IEEE Computer and Communications Societies (INFOCOM'00). 980--989.Google ScholarGoogle Scholar
  47. Rizzo, L. 2000. pgmcc: a TCP-friendly single-rate multicast congestion control scheme. In Proceedings of ACM SIGCOMM'00. 17--28. Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Sen, S., Rexford, J., and Towsley, D. 1999. Proxy prefix caching for multimedia streams. In Proceedings of IEEE INFOCOM.Google ScholarGoogle Scholar
  49. Shen, B., Lee, S., and Basu, S. 2004. Caching strategies in transcoding-enabled proxy systems for streaming media distribution networks. Multimedia. 6, 2, 375--386 Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Shim J. and K. Ahn, K. (Forthcoming). Empirical findings on the perceived use of digital multimedia broadcasting mobile phone services. Indus. Manag. Data Syst. To appear.Google ScholarGoogle Scholar
  51. Shim, J., Varshney, U., Dekleva, S., and Knoerzer, G. 2006. Mobile and wireless networks: Services, evolution & issues. Inter. J. Mobile Comm. 4, 4, 405--417. Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Sinha R. and Papadopoulos, C. 2004. An adaptive multiple retransmission technique for continuous media streams. In Proceedings of 14th International workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV' 04). Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Tan, W. and Zakhor, A. 2001. Video multicast using layered FEC and scalable compression. IEEE Trans. Circuits Syst. Video Techn. 11, 3, 373--387. Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Varadarajan, S., Ngo, H., and Srivastava, J. 2002. Error spreading: A perception-driven approach to handling error in continuous media streaming. IEEE/ACM Trans. Netw. 10, 1, 139--152. Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Wada, M. 1989. Selective recovery of video packet loss using error concealment.IEEE J. Select. Areas Commu. 7, 807--814.Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Wang, B., Sen, S., Adler, M., and Towsley, D. 2002. Optimal proxy cache allocation for efficient streaming media distribution. In Proceedings of 21st Annual Joint Conference of the IEEE Computer and Communications Societies.Google ScholarGoogle Scholar
  57. Wang, S. and Bhargava, B. 1997. Multi-pass transmission policy: An effective method of transmitting large multimedia objects in the wide-area network. In Proceedings of 21st International Computer Software and Applications Conference (COMPSAC'97). Google ScholarGoogle ScholarDigital LibraryDigital Library
  58. Wu, D., Hou, Y., Zhu, W., Zhang, Y., and Peha, J. 2001. Streaming video over the Internet: Approaches and directions. IEEE Trans. Circuits Syst. Video Techn. 11, 3 (Mar.). Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Wu, D., Hou, Y., Zhu, W., Lee, H., Chiang, T., Zhang, Y., and Chao, H. 2000. On end-to-end architecture for transporting MPEG-4 video over the Internet. IEEE Trans. Circuits Syst. Video Techn. Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Wu, Q., Rao, N. S. V. N., and Iyengar, S. S. 2004. On measurement-based transport method for message delay minimization over wide-area networks. In Proceedings of International Conference on Computer Communications and Networks (IC3N'04).Google ScholarGoogle Scholar
  61. Yamaguchi, M., Ito, K., and Takasaki, Y. 2000. Packet loss detection scheme for retransmission-based real-time data transfer. In Proceedings of IEEE 7th International Conference on Parallel and Distributed Systems: Workshops (ICPADS'00 Workshops). Google ScholarGoogle ScholarDigital LibraryDigital Library
  62. Zimmermann, R., Fu, K., Nahata, N., and Shahabi, C. 2003. Retransmission-based error control in a many-to-many client-server environment. In Proceedings of ACM Multimedia Computing Networking Conference. Santa Clara, CA.Google ScholarGoogle Scholar
  63. Zink, M., Griwodz, C., Jonas, A., and Steinmetz, R. 2000. LC-RTP (Loss Collection RTP): Reliability for Video Caching in the Internet. In Proceedings of IEEE 7th International Conference on Parallel and Distributed Systems Workshops (ICPADS'00 Workshops). Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Zink, M., Schmitt, J., and Steinmetz, R. 2002. Retransmission scheduling in layered Video Caches. In Proceedings of IEEE International Conference on Communications 2002 (ICC'2002), 2474--2478.Google ScholarGoogle Scholar

Index Terms

  1. Cache architecture for on-demand streaming on the Web

            Recommendations

            Reviews

            Fjodor J. Ruzic

            This paper discusses new Web caching strategies, analyzes cache performance, and describes how to model the Web cache architecture for video on-demand streaming. The authors clearly distinguish between semi and real on-demand streaming, each of which requires different bandwidth levels. It is worth mentioning that the authors' Web caching architecture consists of two components: a remote-server application and an edge-cache server application. The architecture is modeled and the performance is assessed using probabilistic analysis and system simulations. The authors propose a remote streaming architecture based on real-time streaming protocol (RTSP) channels, where actual video transmission occurs over user datagram protocol (UDP) channels using real-time transport protocols/real-time transport control protocols (RTP)/(RTCP). This way, the streaming session has a persistent connection that connects the remote server and edge cache server. Besides the clear description of each part of this architecture, the authors provide basic performance metrics. The authors created two models. The first one copes with probabilistic performance with two approaches-with and without retransmission, each noting quality of service (QoS) metrics. The second one is a system simulation model. This model copes with various streaming scenarios, and has to evaluate different issues, including: considering the QoS evaluation, with and without retransmission; studying the effects of control parameters on the percentage of useful retransmissions realized at the user side; and obtaining a visible relationship between two QoS simulations that can be used for setting appropriate values for the control parameters in real-world streaming sessions. Based on the system simulation model, the authors stressed the results of their findings. There are three categories of results: the effects of control parameters on QoS, the effects of control parameters on the usefulness of retransmission, and the QoS calibration curves presentation. The conclusion, which accompanies references on Web caching and Internet streaming issues, provides clear insight on the problem, and discusses streaming architecture for pure unicast streaming, using partial caching on edge-cache servers. At the same time, the authors discuss new areas for future research, aiming to provide a qualitative basis for service level agreements in the content services sector. It is certainly interesting reading. It will be a valuable source for those dealing with on-demand video content services over the Internet. Online Computing Reviews Service

            Access critical reviews of Computing literature here

            Become a reviewer for Computing Reviews.

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!