Abstract
With the advent of 5G, supporting high-quality game streaming applications on edge devices has become a reality. This is evidenced by a recent surge in cloud gaming applications on mobile devices. In contrast to video streaming applications, interactive games require much more compute power for supporting improved rendering (such as 4K streaming) with the stipulated frames-per second (FPS) constraints. This in turn consumes more battery power in a power-constrained mobile device. Thus, the state-of-the-art gaming applications suffer from lower video quality (QoS) and/or energy efficiency. While there has been a plethora of recent works on optimizing game streaming applications, to our knowledge, there is no study that systematically investigates the <QoS, Energy> design pairs on the end-to-end game streaming pipeline across the cloud, network, and edge devices to understand the individual contributions of the different stages of the pipeline for improving the overall QoS and energy efficiency. In this context, this paper presents a comprehensive performance and power analysis of the entire game streaming pipeline consisting of the server/cloud side, network, and edge. Through extensive measurements with a high-end workstation mimicking the cloud end, an open-source platform (Moonlight-GameStreaming) emulating the edge device/mobile platform, and two network settings (WiFi and 5G) we conduct a detailed measurement-based study with seven representative games with different characteristics. We characterize the performance in terms of frame latency, QoS, bitrate, and energy consumption for different stages of the gaming pipeline. Our study shows that the rendering stage and the encoding stage at the cloud end are the bottlenecks to support 4K streaming. While 5G is certainly more suitable for supporting enhanced video quality with 4K streaming, it is more expensive in terms of power consumption compared to WiFi. Further, fluctuations in 5G network quality can lead to huge frame drops thus affecting QoS, which needs to be addressed by a coordinated design between the edge device and the server. Finally, the network interface and the decoder units in a mobile platform need more energy-efficient design to support high quality games at a lower cost. These observations should help in designing more cost-effective future cloud gaming platforms.
- NVIDIA Corporation. 2021. GeForce Now . "https://www.nvidia.com/en-us/geforce-now/" .Google Scholar
- Amazon.com, Inc. 2020. Amazon Luna . "https://www.amazon.com/luna/landing-page" .Google Scholar
- Andrew Burnes. 2020. FrameView Performance and Power Benchmarking App: Free Download Available Now . "https://www.nvidia.com/en-us/geforce/news/nvidia-frameview-power-and-performance-benchmarking-app-download/" .Google Scholar
- Amit Ahlawat Anju. 2016. Performance Analysis of Image Compression Technique. Image (2016), 107--111.Google Scholar
- Anritsu. 2020. Measuring Path Loss of 5G FR2 Transmissions Through Common Materials Found in the Signal Path . "https://dl.cdn-anritsu.com/en-us/test-measurement/files/Application-Notes/Application-Note/11410-01189A.pdf" .Google Scholar
- Niranjan Balasubramanian, Aruna Balasubramanian, and Arun Venkataramani. 2009. Energy Consumption in Mobile Phones: A Measurement Study and Implications for Network Applications. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement. Association for Computing Machinery, New York, NY, USA, 280--293.Google Scholar
Digital Library
- Bethesda Softworks LLC. 2021. Skyrim . "https://elderscrolls.bethesda.net/en/skyrim" .Google Scholar
- Bethesda Softworks LLC. 2022. Return to Castle Wolfenstein . "https://store.steampowered.com/app/9010/Return_to_Castle_Wolfenstein/" .Google Scholar
- Bungie, Inc. 2021. Destiny 2 . "https://www.bungie.net/en/pub/aboutdestiny" .Google Scholar
- Wei Cai, Zhen Hong, Xiaofei Wang, Henry C. B. Chan, and Victor C. M. Leung. 2015. Quality-of-Experience Optimization for a Cloud Gaming System With Ad Hoc Cloudlet Assistance. IEEE Transactions on Circuits and Systems for Video Technology (2015), 2092--2104.Google Scholar
- Wei Cai, Ryan Shea, Chun-Ying Huang, Kuan-Ta Chen, Jiangchuan Liu, Victor C. M. Leung, and Cheng-Hsin Hsu. 2016. A Survey on Cloud Gaming: Future of Computer Games. IEEE Access (2016), 7605--7620.Google Scholar
- Cameron Gutman, Diego Waxemberg, Aaron Neyer, Andrew Hennessy. 2013. Moonlight Android . "https://github.com/moonlight-stream/moonlight-android" .Google Scholar
- Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2013. Moonlight . "https://moonlight-stream.org/" .Google Scholar
- Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2021. Moonlight Internet Hosting Tool . "https://github.com/moonlight-stream/Internet-Hosting-Tool" .Google Scholar
- Aaron Carroll and Gernot Heiser. 2010. An Analysis of Power Consumption in a Smartphone. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference. USENIX Association, USA, 21.Google Scholar
Digital Library
- Kuan-Ta Chen, Yu-Chun Chang, Hwai-Jung Hsu, De-Yu Chen, Chun-Ying Huang, and Cheng-Hsin Hsu. 2014. On the Quality of Service of Cloud Gaming Systems. IEEE Transactions on Multimedia (2014), 480--495.Google Scholar
Digital Library
- Nachiappan Chidambaram Nachiappan, Praveen Yedlapalli, Niranjan Soundararajan, Mahmut Taylan Kandemir, Anand Sivasubramaniam, and Chita R. Das. 2014. GemDroid: A Framework to Evaluate Mobile Platforms. In The 2014 ACM International Conference on Measurement and Modeling of Computer Systems . Association for Computing Machinery, New York, NY, USA, 355--366.Google Scholar
- Philip A Chou and Zhourong Miao. 2006. Rate-distortion Optimized Streaming of Packetized Media . IEEE Transactions on Multimedia (2006), 390--404.Google Scholar
Digital Library
- Dean Takahashi. 2021. Newzoo: Cloud gaming will reach 23.7M paying users and generate $1.6B in 2021 . "https://venturebeat.com/2021/08/26/newzoo-cloud-gaming-will-reach-23--7m-paying-users-and-generate-1--6b-in-2021/" .Google Scholar
- Dror Gill. 2019. How To Cut Cloud Gaming Bitrates In Half So That Twice As Many Users Can Play . "https://blog.beamr.com/2019/11/19/how-to-cut-cloud-gaming-bitrates-in-half-so-that-twice-as-many-users-can-play/" .Google Scholar
- Epic Games, Inc. 2021. Fortnite . "https://www.epicgames.com/fortnite/en-US/home" .Google Scholar
- Fernando A. Fardo, Victor H. Conforto, Francisco C. de Oliveira, and Paulo S. Rodrigues. 2016. A Formal Evaluation of PSNR as Quality Measuremen Parameter for Image Segmentation Algorithms. CoRR (2016), arXiv:1605.07116.Google Scholar
- Nick Feamster and Hari Balakrishnan. 2002. Packet Loss Recovery For Streaming Video. In 12th International Packet Video Workshop. PA: Pittsburgh, 9--16.Google Scholar
- FFmpeg team. 2000. FFmpeg . "https://www.ffmpeg.org/" .Google Scholar
- Sebastian Flinck Lindström, Markus Wetterberg, and Niklas Carlsson. 2020. Cloud Gaming: A QoE Study of Fast-paced Single-player and Multiplayer Gaming. In 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC). 34--45.Google Scholar
- Fredrik Fornwall. 2021. Termux . "https://termux.com/" .Google Scholar
- Google. 2019. Stadia - One place for all the ways we play . "https://stadia.google.com/" .Google Scholar
- Habtegebreil Haile, Karl-Johan Grinnemo, Simone Ferlin, Per Hurtig, and Anna Brunstrom. 2021. End-to-end Congestion Control Approaches for High Throughput and Low Delay in 4G/5G Cellular Networks . Computer Networks (2021), 107692.Google Scholar
- Wenjie Hu and Guohong Cao. 2015. Energy-aware video streaming on smartphones. In 2015 IEEE Conference on Computer Communications (INFOCOM). Institute of Electrical and Electronics Engineers Inc., United States, 1185--1193.Google Scholar
Cross Ref
- Chun-Ying Huang, Kuan-Ta Chen, De-Yu Chen, Hwai-Jung Hsu, and Cheng-Hsin Hsu. 2014a. GamingAnywhere: The First Open Source Cloud Gaming System. ACM Trans. Multimedia Comput. Commun. Appl. (2014).Google Scholar
- Chun-Ying Huang, Cheng-Hsin Hsu, Yu-Chun Chang, and Kuan-Ta Chen. 2013. GamingAnywhere: An Open Cloud Gaming System. In Proceedings of the 4th ACM Multimedia Systems Conference. Association for Computing Machinery, New York, NY, USA, 36--47.Google Scholar
Digital Library
- Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014b. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the 2014 ACM Conference on SIGCOMM. Association for Computing Machinery, New York, NY, USA, 187--198.Google Scholar
Digital Library
- Yiming Huo, Xiaodai Dong, and Wei Xu. 2017. 5G Cellular User Equipment: From Theory to Practical Hardware Design . IEEE Access (2017), 13992--14010.Google Scholar
- Mikel Irazabal Bengoa. 2021. Enhanced Quality of Service Mechanisms for 5G Networks . (2021).Google Scholar
- Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando Kuipers, and Gil Zussman. 2018. Performance Evaluation of WebRTC-Based Video Conferencing. SIGMETRICS Perform. Eval. Rev. (2018), 56--68.Google Scholar
- Junchen Jiang, Vyas Sekar, and Hui Zhang. 2012. Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming with FESTIVE. In Proceedings of the 8th International Conference on Emerging Networking Experiments and Technologies . Association for Computing Machinery, New York, NY, USA, 97--108.Google Scholar
Digital Library
- Julz. 2021. What's the Best Frame Rate for Gaming ? "https://www.build-gaming-computers.com/best-frame-rate-for-pc-gaming.html" .Google Scholar
- Mark Kalman, Eckehard Steinbach, and Bernd Girod. 2002. Rate-distortion Optimized Video Streaming with Adaptive Playout. In Proceedings. International Conference on Image Processing. IEEE, III--III.Google Scholar
Cross Ref
- Kuba Kaszyk, Harry Wagstaff, Tom Spink, Björn Franke, Mike O'Boyle, Bruno Bodin, and Henrik Uhrenholt. 2019. Full-System Simulation of Mobile CPU/GPU Platforms. In 2019 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) . IEEE Computer Society, Los Alamitos, CA, USA, 68--78.Google Scholar
- Kozakoff,Dennis J. and Corallo, Carlo A. and Petra, D. and Roovers, Wilhelmus Cornelus Wal. 2016. 5G Cellular Electromagnetic Window Considerations . "https://www.dsm.com/content/dam/dsm/dyneema/en_GB/Downloads/Researchpapers/5G_Cellular_article.pdf" .Google Scholar
- KRAFTON, Inc. 2021. PUBG Mobile . "https://www.pubgmobile.com/en-US/home.shtml" .Google Scholar
- KRAFTON, Inc. 2022. PUBG: Battlegrounds . "https://store.steampowered.com/app/578080/PUBG_BATTLEGROUNDS/" .Google Scholar
- Xin Li, Mian Dong, Zhan Ma, and Felix C.A. Fernandes. 2012. GreenTube: Power Optimization for Mobile Videostreaming via Dynamic Cache Management. In Proceedings of the 20th ACM International Conference on Multimedia. Association for Computing Machinery, New York, NY, USA, 279--288.Google Scholar
- Licidy. 2019. Known Issue: Performance Issues with Low FPS . "https://forums.ageofempires.com/t/known-issue-performance-issues-with-low-fps/60111" .Google Scholar
- Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. Association for Computing Machinery, New York, NY, USA, 197--210.Google Scholar
Digital Library
- Marshall Honorof. 2021. Can't find a PS5, Xbox Series X or GPU? Embrace it . "https://www.tomsguide.com/news/ps5-xbox-series-x-gpu-semiconductor-shortage" .Google Scholar
- Microsoft. 2021 a. Age of Empires-uppercaseexpandafterromannumeral2: Definitive Edition. "https://www.ageofempires.com/games/aoeiide/" .Google Scholar
- Microsoft. 2021 b. Age of Empires-uppercaseexpandafterromannumeral3: Definitive Edition. "https://www.ageofempires.com/games/aoeiiide" .Google Scholar
- Microsoft. 2021 c. Xbox Cloud Gaming (Beta) with Xbox Game Pass . "https://www.xbox.com/en-US/xbox-game-pass/cloud-gaming" .Google Scholar
- Mojang Studios. 2011. Minecraft . "https://www.minecraft.net/en-us" .Google Scholar
- Mordor Intelligence. 2021. Cloud Gaming Market - Growth, Trends, COVID-19 Impact, and Forecasts (2021 - 2026) . "https://www.mordorintelligence.com/industry-reports/cloud-gaming-market" .Google Scholar
- Motion Twin. 2021. Dead CellS . "https://dead-cells.com/" .Google Scholar
- Nachiket Mhatre. 2021. Here's What Caused The Ongoing Global Chip Shortage & Why It Will Only Get Worse . "https://onsitego.com/blog/global-chip-shortage-explained-causes-future/" .Google Scholar
- Arvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan, Shuowei Jin, Xiao Zhu, Xiaoxuan Zhang, Denis Rybkin, Zhengxuan Yang, Zhuoqing Morley Mao, Feng Qian, and Zhi-Li Zhang. 2021. A Variegated Look at 5G in the Wild: Performance, Power, and QoE Implications. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 610--625.Google Scholar
Digital Library
- NVIDIA Corporation. 2019. An Introduction to the NVIDIA Optical Flow SDK . "https://developer.nvidia.com/blog/an-introduction-to-the-nvidia-optical-flow-sdk/" .Google Scholar
- NVIDIA Corporation. 2021 a. GeForce Experience . "https://www.nvidia.com/en-us/geforce/geforce-experience/" .Google Scholar
- NVIDIA Corporation. 2021 b. NVIDIA GameStream . "https://www.nvidia.com/en-us/shield/support/shield-tv/gamestream/" .Google Scholar
- NVIDIA Corporation. 2021 c. ShadowPlay: Record, Share Game Videos & Screenshots . "https://www.nvidia.com/en-us/geforce/geforce-experience/shadowplay/" .Google Scholar
- Opensignal. 2021. Opensignal - 5G, 4G, 3G Internet & WiFi Speed Test . "https://play.google.com/store/apps/details?id=com.staircase3.opensignal&hl=en_US&gl=US" .Google Scholar
- Junho Park, Heechang Seong, Yong Nam Whang, and Wonbin Hong. 2019. Energy-efficient 5G Phased Arrays Incorporating Vertically Polarized Endfire Planar Folded Slot Antenna for mmWave Mobile Terminals . IEEE Transactions on Antennas and Propagation (2019), 230--241.Google Scholar
- Pelham Smithers, Omri Wallach, Clayton Wodsworth. 2020. The Rise Of Gaming Revenue Visualized . "https://www.visualcapitalist.com/wp-content/uploads/2020/11/history-of-gaming-by-revenue-share-full-size.html" .Google Scholar
- Oswaldo Sebastian Peñaherrera-Pulla, Carlos Baena, Sergio Fortes, Eduardo Baena, and Raquel Barco. 2021. Measuring Key Quality Indicators in Cloud Gaming: Framework and Assessment Over Wireless Networks. Sensors (2021).Google Scholar
- Qualcomm Technologies Inc. 2018. First 5G mmWave Antenna Module for Smartphones . "https://www.microwavejournal.com/articles/31448-first-5g-mmwave-antenna-module-for-smartphones" .Google Scholar
- Eman Ramadan, Arvind Narayanan, Udhaya Kumar Dayalan, Rostand AK Fezeu, Feng Qian, and Zhi-Li Zhang. 2021. Case for 5G-aware video streaming applications . In Proceedings of the 1st Workshop on 5G Measurements, Modeling, and Use Cases. Association for Computing Machinery, 27--34.Google Scholar
Digital Library
- Sam Desatoff. 2021. Report: Cloud gaming market to reach $6.5 billion by 2024 (Newzoo) . "https://gamedaily.biz/article/2143/report-cloud-gaming-market-to-reach-65-billion-by-2024-newzoo" .Google Scholar
- Aaron Schulman, Vishnu Navda, Ran Ramjee, Neil Spring, Pralhad Deshp, Calvin Grunewald, Kamal Jain, and Venkata N. Padmanabhan. 2010. Bartendr: A Practical Approach to Energy-aware Cellular Data Scheduling. In Proceedings of the Sixteenth Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, USA, 85--96.Google Scholar
- Sony Interactive Entertainment LLC. 2021. PlayStation Now . "https://www.playstation.com/en-us/ps-now/" .Google Scholar
- Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications . IEEE Press, 1--9.Google Scholar
- Team Cherry. 2021. Hollow Knight . "https://www.hollowknight.com/" .Google Scholar
- Ninad Warty, Ramanujan K. Sheshadri, Wei Zheng, and Dimitrios Koutsonikolas. 2012. A First Look at 802.11n Power Consumption in Smartphones. In Proceedings of the First ACM International Workshop on Practical Issues and Applications in next Generation Wireless Networks. Association for Computing Machinery, New York, NY, USA, 27--32.Google Scholar
Digital Library
- Wikipedia Contributor. 2021. Games as a service . "https://en.wikipedia.org/wiki/Games_as_a_service" .Google Scholar
- Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020. Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 479--494.Google Scholar
Digital Library
- Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han. 2020. NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking . Association for Computing Machinery, New York, NY, USA, bibinfonumpages14 pages.Google Scholar
Digital Library
- Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication . Association for Computing Machinery, New York, NY, USA, 325--338.Google Scholar
Digital Library
- Chanmin Yoon, Dongwon Kim, Wonwoo Jung, Chulkoo Kang, and Hojung Cha. 2012. AppScope: Application Energy Metering Framework for Android Smartphone Using Kernel Activity Monitoring. In 2012 USENIX Annual Technical Conference (USENIX ATC 12). USENIX Association, Boston, MA, 387--400.Google Scholar
- ZeroTier, Inc. 2021. ZeroTier . "https://www.zerotier.com/" .Google Scholar
- Haibo Zhang, Prasanna Venkatesh Rengasamy, Shulin Zhao, Nachiappan Chidambaram Nachiappan, Anand Sivasubramaniam, Mahmut T. Kandemir, Ravi Iyer, and Chita R. Das. 2017. Race-to-SleepGoogle Scholar
- Content CachingGoogle Scholar
- Display Caching: A Recipe for Energy-Efficient Video Streaming on Handhelds. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture . Association for Computing Machinery, New York, NY, USA, 517--531.Google Scholar
Index Terms
End-to-end Characterization of Game Streaming Applications on Mobile Platforms
Recommendations
End-to-end Characterization of Game Streaming Applications on Mobile Platforms
SIGMETRICS/PERFORMANCE '22: Abstract Proceedings of the 2022 ACM SIGMETRICS/IFIP PERFORMANCE Joint International Conference on Measurement and Modeling of Computer SystemsWith the advent of 5G, hosting high-quality game streaming applications on mobile devices has become a reality. To our knowledge, no prior study systematically investigates the < QoS, Energy > tuple on the end-to-end game streaming pipeline across the ...
End-to-end Characterization of Game Streaming Applications on Mobile Platforms
SIGMETRICS '22With the advent of 5G, hosting high-quality game streaming applications on mobile devices has become a reality. To our knowledge, no prior study systematically investigates the < QoS, Energy > tuple on the end-to-end game streaming pipeline across the ...
Video Streaming for Multi-cloud Game
Proceedings, Part II, of the 16th Pacific-Rim Conference on Advances in Multimedia Information Processing -- PCM 2015 - Volume 9315Depending on the development of the game industry, required hardware performance rises steadily. High-end game cannot be enjoyed by outmoded computer or smart mobile device. As a way to solve this problem, studies on the cloud gaming being actively ...






Comments