skip to main content
research-article

Rate-distortion optimized streaming of fine-grained scalable video sequences

Published:11 February 2008Publication History
Skip Abstract Section

Abstract

We present optimal schemes for allocating bits of fine-grained scalable video sequences among multiple senders streaming to a single receiver. This allocation problem is critical in optimizing the perceived quality in peer-to-peer and distributed multi-server streaming environments. Senders in such environments are heterogeneous in their outgoing bandwidth and they hold different portions of the video stream. We first formulate and optimally solve the problem for individual frames, then we generalize to the multiple frame case. Specifically, we formulate the allocation problem as an optimization problem, which is nonlinear in general. We use rate-distortion models in the formulation to achieve the minimum distortion in the rendered video, constrained by the outgoing bandwidth of senders, availability of video data at senders, and incoming bandwidth of receiver. We show how the adopted rate-distortion models transform the nonlinear problem to an integer linear programming (ILP) problem. We then design a simple rounding scheme that transforms the ILP problem to a linear programming (LP) one, which can be solved efficiently using common optimization techniques such as the Simplex method. We prove that our rounding scheme always produces a feasible solution, and the solution is within a negligible margin from the optimal solution. We also propose a new algorithm (FGSAssign) for the single-frame allocation problem that runs in O(nlog n) steps, where n is the number of senders. We prove that FGSAssign is optimal. Furthermore, we propose a heuristic algorithm (mFGSAssign) that produces near-optimal solutions for the multiple-frame case, and runs an order of magnitude faster than the optimal one. Because of its short running time, mFGSAssign can be used in real time. Our experimental study validates our analytical analysis and shows the effectiveness of our allocation algorithms in improving the video quality.

References

  1. Begen, A., Altunbasak, Y., and Begen, M. 2003. Rate-distortion optimized on-demand media streaming with server diversity. In Proceedings of the IEEE International Conference on Image Processing (ICIP'03) (Barcelona, Spain). IEEE Computer Society Press, Los Alamitos, CA.Google ScholarGoogle Scholar
  2. Chakareski, J. and Girod, B. 2003. Rate-distortion optimized packet scheduling and routing for media streaming with path diversity. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT). Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Chou, P. and Miao, Z. 2006. Rate-distortion optimized streaming of packetized media. IEEE Trans. Multimed. 8, 2 (Apr.), 390--404. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Cormen, T., Leiserson, C., Rivest, R., and Stein, C. 2001. Introduction to Algorithms, 2nd ed. MIT Press, Cambridge, MA. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Cui, Y. and Nahrstedt, K. 2003. Layered peer-to-peer streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03) (Monterey, CA). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Dai, M. and Loguinov, D. 2003. Analysis of rate-distortion functions and congestion control in scalable Internet video streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03). (Monterey, CA). ACM, New York. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Dai, M., Loguinov, D., and Radha, H. 2004. Rate-distortion modeling of scalable video coders. In Proceedings of the IEEE International Conference on Image Processing (ICIP'04) (Singapore). IEEE Computer Society Press, Los Alamitos, CA.Google ScholarGoogle Scholar
  8. de Cuetos, P., Seeling, P., Reisslein, M., and Ross, K. 2005. Comparing the streaming of FGS encoded video at different aggregation levels: frame, GoP, and scene. Int. J. Commun. Syst. 18, 5 (June), 449--464. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Goldfarb, D. and Todd, M. 1989. Linear programming. Handbook Oper. Res. Manage. Sci. Optimiz. 1, 73--170. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Hefeeda, M., Habib, A., Xu, D., Bhargava, B., and Botev, B. 2005. CollectCast: A peer-to-peer service for media streaming. ACM/Springer Multimed. Syst. J. 11, 1 (Nov.), 68--81.Google ScholarGoogle Scholar
  11. Hsu, C. and Hefeeda, M. 2006a. On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences. Tech. Rep. TR 2006-12, Simon Fraser University. (Aug.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)Google ScholarGoogle Scholar
  12. Hsu, C. and Hefeeda, M. 2006b. Optimal bit allocation for fine-grained scalable video sequences in distributed streaming environments. Tech. Rep. TR 2006-20, Simon Fraser University. (July.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)Google ScholarGoogle Scholar
  13. ISO/IEC 14496-2. 2004. Coding of audio-visual objects - Part 2: Visual.Google ScholarGoogle Scholar
  14. ISO/IEC 14496-5. 2004. MPEG-4 Visual reference software.Google ScholarGoogle Scholar
  15. Li, W. 2001. Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans. Circ. Syst. Video Tech. 11, 3 (Mar.), 301--317. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Magharei, N. and Rejaie, R. 2006. Adaptive receiver-driven streaming from multiple senders. ACM/Springer Multimed. Syst. J. 11, 6 (Apr.), 1--18.Google ScholarGoogle Scholar
  17. Marler, R. and Arora, J. 2004. Survey of multi-objective optimization methods for engineering. Struct. Multidisc. Optimiz. 26, 6 (Apr.), 369--395.Google ScholarGoogle ScholarCross RefCross Ref
  18. Nguyen, T. and Zakhor, A. 2002. Distributed video streaming over Internet. In Proceedings of the Multimedia Computing and Networking (MMCN'02) (San Jose, CA).Google ScholarGoogle Scholar
  19. Papadimitriou, C. and Steiglitz, K. 1998. Combinatorial Optimization: Algorithms and Complexity, 1st ed. Dover. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Radha, H., van der Schaar, M., and Chen, Y. 2001. The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP. IEEE Trans. Multimed. 3, 1 (Mar.), 53--68. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Schwarz, H., Marpe, D., and Wiegand, T. 2006. The scalable H.264/MPEG4-AVC extension: Technology and applications. In Proceedings of the European Symposium on Mobile Media Delivery (EuMob'06) (Sardinia, Italy).Google ScholarGoogle Scholar
  22. Sermadevi, Y. and Hemami, S. 2003. Linear programming optimization for video coding under multiple constraints. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Su, X. and Wang, T. 2006. Sequence of linear programming for transmission of fine-scalable coded content in bandwidth-limited environments. ACM/Springer Multimed. Syst. J. 11, 5 (June), 455--466.Google ScholarGoogle Scholar
  24. Sun, J., Gao, W., Zhao, D., and Huang, Q. 2005. Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos. In Proceedings of the SPIE International Conference on Visual Communication and Image Processing (VCIP'05) (Beijing, China).Google ScholarGoogle Scholar
  25. Wang, Y., Ostermann, J., and Zhang, Y. 2002. Video Processing and Communications. Prentice Hall, Englewood Cliffs, NJ. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Web Page of Network Systems Lab. 2006. http://nsl.cs.surrey.sfu.ca/projects/fgs/.Google ScholarGoogle Scholar
  27. Zhang, X., Vetro, A., Shi, Y., and Sun, H. 2003. Constant quality constrained rate allocation for FGS-coded video. IEEE Trans. Circ. Syst. Video Tech. 13, 2 (Feb.), 121--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Zink, M., Künzel, O., Schmitt, J., and Steinmetz, R. 2003. Subjective impression of variations in layer encoded videos. In Proceedings of the the IEEE International Workshop on Quality of Service (IWQoS'03) (Monterey, CA). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Rate-distortion optimized streaming of fine-grained scalable video sequences

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!