Abstract
We present optimal schemes for allocating bits of fine-grained scalable video sequences among multiple senders streaming to a single receiver. This allocation problem is critical in optimizing the perceived quality in peer-to-peer and distributed multi-server streaming environments. Senders in such environments are heterogeneous in their outgoing bandwidth and they hold different portions of the video stream. We first formulate and optimally solve the problem for individual frames, then we generalize to the multiple frame case. Specifically, we formulate the allocation problem as an optimization problem, which is nonlinear in general. We use rate-distortion models in the formulation to achieve the minimum distortion in the rendered video, constrained by the outgoing bandwidth of senders, availability of video data at senders, and incoming bandwidth of receiver. We show how the adopted rate-distortion models transform the nonlinear problem to an integer linear programming (ILP) problem. We then design a simple rounding scheme that transforms the ILP problem to a linear programming (LP) one, which can be solved efficiently using common optimization techniques such as the Simplex method. We prove that our rounding scheme always produces a feasible solution, and the solution is within a negligible margin from the optimal solution. We also propose a new algorithm (FGSAssign) for the single-frame allocation problem that runs in O(nlog n) steps, where n is the number of senders. We prove that FGSAssign is optimal. Furthermore, we propose a heuristic algorithm (mFGSAssign) that produces near-optimal solutions for the multiple-frame case, and runs an order of magnitude faster than the optimal one. Because of its short running time, mFGSAssign can be used in real time. Our experimental study validates our analytical analysis and shows the effectiveness of our allocation algorithms in improving the video quality.
- Begen, A., Altunbasak, Y., and Begen, M. 2003. Rate-distortion optimized on-demand media streaming with server diversity. In Proceedings of the IEEE International Conference on Image Processing (ICIP'03) (Barcelona, Spain). IEEE Computer Society Press, Los Alamitos, CA.Google Scholar
- Chakareski, J. and Girod, B. 2003. Rate-distortion optimized packet scheduling and routing for media streaming with path diversity. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT). Google Scholar
Digital Library
- Chou, P. and Miao, Z. 2006. Rate-distortion optimized streaming of packetized media. IEEE Trans. Multimed. 8, 2 (Apr.), 390--404. Google Scholar
Digital Library
- Cormen, T., Leiserson, C., Rivest, R., and Stein, C. 2001. Introduction to Algorithms, 2nd ed. MIT Press, Cambridge, MA. Google Scholar
Digital Library
- Cui, Y. and Nahrstedt, K. 2003. Layered peer-to-peer streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03) (Monterey, CA). ACM, New York. Google Scholar
Digital Library
- Dai, M. and Loguinov, D. 2003. Analysis of rate-distortion functions and congestion control in scalable Internet video streaming. In Proceedings of the ACM International Workshop on Network and Operating Systems Support for Digital Audio and Video (NOSSDAV'03). (Monterey, CA). ACM, New York. Google Scholar
Digital Library
- Dai, M., Loguinov, D., and Radha, H. 2004. Rate-distortion modeling of scalable video coders. In Proceedings of the IEEE International Conference on Image Processing (ICIP'04) (Singapore). IEEE Computer Society Press, Los Alamitos, CA.Google Scholar
- de Cuetos, P., Seeling, P., Reisslein, M., and Ross, K. 2005. Comparing the streaming of FGS encoded video at different aggregation levels: frame, GoP, and scene. Int. J. Commun. Syst. 18, 5 (June), 449--464. Google Scholar
Digital Library
- Goldfarb, D. and Todd, M. 1989. Linear programming. Handbook Oper. Res. Manage. Sci. Optimiz. 1, 73--170. Google Scholar
Digital Library
- Hefeeda, M., Habib, A., Xu, D., Bhargava, B., and Botev, B. 2005. CollectCast: A peer-to-peer service for media streaming. ACM/Springer Multimed. Syst. J. 11, 1 (Nov.), 68--81.Google Scholar
- Hsu, C. and Hefeeda, M. 2006a. On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences. Tech. Rep. TR 2006-12, Simon Fraser University. (Aug.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)Google Scholar
- Hsu, C. and Hefeeda, M. 2006b. Optimal bit allocation for fine-grained scalable video sequences in distributed streaming environments. Tech. Rep. TR 2006-20, Simon Fraser University. (July.) (Available online at http://nsl.cs.surrey.sfu.ca/projects/fgs/.)Google Scholar
- ISO/IEC 14496-2. 2004. Coding of audio-visual objects - Part 2: Visual.Google Scholar
- ISO/IEC 14496-5. 2004. MPEG-4 Visual reference software.Google Scholar
- Li, W. 2001. Overview of fine granularity scalability in MPEG-4 video standard. IEEE Trans. Circ. Syst. Video Tech. 11, 3 (Mar.), 301--317. Google Scholar
Digital Library
- Magharei, N. and Rejaie, R. 2006. Adaptive receiver-driven streaming from multiple senders. ACM/Springer Multimed. Syst. J. 11, 6 (Apr.), 1--18.Google Scholar
- Marler, R. and Arora, J. 2004. Survey of multi-objective optimization methods for engineering. Struct. Multidisc. Optimiz. 26, 6 (Apr.), 369--395.Google Scholar
Cross Ref
- Nguyen, T. and Zakhor, A. 2002. Distributed video streaming over Internet. In Proceedings of the Multimedia Computing and Networking (MMCN'02) (San Jose, CA).Google Scholar
- Papadimitriou, C. and Steiglitz, K. 1998. Combinatorial Optimization: Algorithms and Complexity, 1st ed. Dover. Google Scholar
Digital Library
- Radha, H., van der Schaar, M., and Chen, Y. 2001. The MPEG-4 fine-grained scalable video coding method for multimedia streaming over IP. IEEE Trans. Multimed. 3, 1 (Mar.), 53--68. Google Scholar
Digital Library
- Schwarz, H., Marpe, D., and Wiegand, T. 2006. The scalable H.264/MPEG4-AVC extension: Technology and applications. In Proceedings of the European Symposium on Mobile Media Delivery (EuMob'06) (Sardinia, Italy).Google Scholar
- Sermadevi, Y. and Hemami, S. 2003. Linear programming optimization for video coding under multiple constraints. In Proceedings of the Data Compression Conference (DCC'03) (Snowbird, UT). Google Scholar
Digital Library
- Su, X. and Wang, T. 2006. Sequence of linear programming for transmission of fine-scalable coded content in bandwidth-limited environments. ACM/Springer Multimed. Syst. J. 11, 5 (June), 455--466.Google Scholar
- Sun, J., Gao, W., Zhao, D., and Huang, Q. 2005. Statistical model, analysis and approximation of rate-distortion function in MPEG-4 FGS videos. In Proceedings of the SPIE International Conference on Visual Communication and Image Processing (VCIP'05) (Beijing, China).Google Scholar
- Wang, Y., Ostermann, J., and Zhang, Y. 2002. Video Processing and Communications. Prentice Hall, Englewood Cliffs, NJ. Google Scholar
Digital Library
- Web Page of Network Systems Lab. 2006. http://nsl.cs.surrey.sfu.ca/projects/fgs/.Google Scholar
- Zhang, X., Vetro, A., Shi, Y., and Sun, H. 2003. Constant quality constrained rate allocation for FGS-coded video. IEEE Trans. Circ. Syst. Video Tech. 13, 2 (Feb.), 121--130. Google Scholar
Digital Library
- Zink, M., Künzel, O., Schmitt, J., and Steinmetz, R. 2003. Subjective impression of variations in layer encoded videos. In Proceedings of the the IEEE International Workshop on Quality of Service (IWQoS'03) (Monterey, CA). Google Scholar
Digital Library
Index Terms
Rate-distortion optimized streaming of fine-grained scalable video sequences
Recommendations
SSIM-based error-resilient rate-distortion optimization of H.264/AVC video coding for wireless streaming
The SSIM-based rate-distortion optimization (RDO) has been verified to be an effective tool for H.264/AVC to promote the perceptual video coding performance. However, the current SSIM-based RDO is not efficient for improving the perceptual quality of ...
Analysis of rate-distortion functions and congestion control in scalable internet video streaming
NOSSDAV '03: Proceedings of the 13th international workshop on Network and operating systems support for digital audio and videoInternet streaming applications usually have strict requirements on bandwidth, delay, and packet loss, while the current best-effort Internet does not provide any Quality-of-Service (QoS) guarantees to end flows. To achieve a higher level of QoS for the ...
On the accuracy and complexity of rate-distortion models for fine-grained scalable video sequences
Rate-distortion (R-D) models are functions that describe the relationship between the bitrate and expected level of distortion in the reconstructed video stream. R-D models enable optimization of the received video quality in different network ...






Comments