Online learning for low-latency adaptive streaming

ABSTRACT

Achieving low-latency is paramount for live streaming scenarios, that are now-days becoming increasingly popular. In this paper, we propose a novel algorithm for bitrate adaptation in HTTP Adaptive Streaming (HAS), based on Online Convex Optimization (OCO). The proposed algorithm, named Learn2Adapt-LowLatency (L2A-LL), is shown to provide a robust adaptation strategy which, unlike most of the state-of-the-art techniques, does not require parameter tuning, channel model assumptions, throughput estimation or application-specific adjustments. These properties make it very suitable for users who typically experience fast variations in channel characteristics. The proposed algorithm has been implemented in DASH-IF's reference video player (dash.js) and has been made publicly available for research purposes at [22]. Real experiments show that L2A-LL reduces latency significantly, while providing a high average streaming bit-rate, without impairing the overall Quality of Experience (QoE); a result that is independent of the channel and application scenarios. The presented optimization framework, is robust due to its design principle; its ability to learn and allows for modular QoE prioritization, while it facilitates easy adjustments to consider applications beyond live streaming and/or multiple user classes.

References

1. [n.d.]. dash.js. https://github.com/Dash-Industry-Forum/dash.js
2. MMSys 2020. 2020. Grand Challenge on Adaptation Algorithms for Near-Second Latency - Test environment. https://github.com/twitchtv/acm-mmsys-2020-grand-challenge
3. Elena Veronica Belmega, Panayotis Mertikopoulos, Romain Negrel, and Luca Sanguinetti. 2018. Online convex optimization and no-regret learning: Algorithms, guarantees and applications. arXiv e-prints (2018).
4. Abdelhak Bentaleb, Christian Timmerer, Ali C. Begen, and Roger Zimmermann. 2019. Bandwidth Prediction in Low-Latency Chunked Streaming. In Proceedings of the 29th ACM Workshop on Network and Operating Systems Support for Digital Audio and Video (Amherst, Massachusetts) (NOSSDAV '19). Association for Computing Machinery, New York, NY, USA, 7--13.
5. T. Chen, Q. Ling, and G. B. Giannakis. 2017. An Online Convex Optimization Approach to Proactive Network Resource Allocation. IEEE Transactions on Signal Processing 65, 24 (Dec 2017).
6. Cisco Visual Networking Index. 2019. Forecast and Trends, 2017--2022. White Paper (Feb. 2019).
7. DASH-IF. 2020. DASH-IF Change Request: Live Services DASH-IF Live services. Agreed CR (March 2020).
8. ETSI. 2020. ETSI TS 103 285 V1.3.1 (2020-02) DVB-DASH). International Standard TS 103 285 (Feb. 2020).
9. Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014. A Buffer-based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proc. of ACM Conf. on SIGCOMM.
10. ISO/IEC. 2014. Dynamic adaptive streaming over HTTP (DASH). International Standard 23009-1:2014 (May 2014).
11. ISO/IEC. 2018. Common Media Application Format CMAF). International Standard 23000-19:2018 (Jan. 2018).
12. T. Karagkioules, C. Concolato, D. Tsilimantos, and S. Valentin. 2017. A Comparative Case Study of HTTP Adaptive Streaming Algorithms in Mobile Networks. In Proc. ACM NOSSDAV. 1--6.
13. M. Katsarakis, R. C. Teixeira, M. Papadopouli, and V. Christophides. 2016. Towards a Causal Analysis of Video QoE from Network and Application QoS. In Proc. ACM Internet-QoE. 31--36.
14. Z. Li, X. Zhu, J. Gahm, R. Pan, H. Hu, A. C. Begen, and D. Oran. 2014. Probe and Adapt: Rate Adaptation for HTTP Video Streaming At Scale. IEEE Journal on Selected Areas of Communication (April 2014).
15. Nikolaos Liakopoulos, Apostolos Destounis, Georgios Paschos, Thrasyvoulos Spyropoulos, and Panayotis Mertikopoulos. 2019. Cautious Regret Minimization: Online Optimization with Long-Term Budget Constraints. In Proc. of ICML (Long Beach, CA, USA).
16. Nikolaos Liakopoulos, Georgios Paschos, and Thrasyvoulos Spyropoulos. 2019. No Regret in Cloud Resources Reservation with Violation Guarantees. In Proc. IEEE INFOCOM (Paris, France).
17. Michael J. Neely and Hao Yu. 2017. Online Convex Optimization with Time-Varying Constraints. arXiv e-prints (Feb. 2017).
18. R. Pantos and W. May. 2018. RFC 8216 HTTP live streaming. IETF, Request for Comments (Aug. 2018).
19. M. Seufert, S. Egger, M. Slanina, T. Zinner, T. Hoßfeld, and P. Tran-Gia. 2015. A Survey on Quality of Experience of HTTP Adaptive Streaming. IEEE Communications Surveys Tutorials 17, 1 (Firstquarter 2015).
20. Shai Shalev-Shwartz. 2012. Online Learning and Online Convex Optimization. Foundations and Trends on Machine Learning (Feb. 2012).
21. K. Spiteri, R. Urgaonkar, and R. K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM.
22. T. Karagkioules et al. 2020. Learn2Adapt-LowLatency. Retrieved April 6, 2020 from https://github.com/unifiedstreaming/Learn2Adapt-LowLatency
23. Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proc. ACM Int. Conf. on SIGCOMM. 14.
24. C. Zhou, C. Lin, and Z. Guo. 2016. mDASH: A Markov Decision-Based Rate Adaptation Approach for Dynamic HTTP Streaming. IEEE Transactions on Multimedia (April 2016).
25. Martin Zinkevich. 2003. Online Convex Programming and Generalized Infinitesimal Gradient Ascent. In Proc. of ICML.

Index Terms

• Information systems

  • Information systems applications

    • Multimedia information systems

      • Multimedia streaming