skip to main content
research-article
Public Access

End-to-end Characterization of Game Streaming Applications on Mobile Platforms

Authors Info & Claims
Published:28 February 2022Publication History
Skip Abstract Section

Abstract

With the advent of 5G, supporting high-quality game streaming applications on edge devices has become a reality. This is evidenced by a recent surge in cloud gaming applications on mobile devices. In contrast to video streaming applications, interactive games require much more compute power for supporting improved rendering (such as 4K streaming) with the stipulated frames-per second (FPS) constraints. This in turn consumes more battery power in a power-constrained mobile device. Thus, the state-of-the-art gaming applications suffer from lower video quality (QoS) and/or energy efficiency. While there has been a plethora of recent works on optimizing game streaming applications, to our knowledge, there is no study that systematically investigates the <QoS, Energy> design pairs on the end-to-end game streaming pipeline across the cloud, network, and edge devices to understand the individual contributions of the different stages of the pipeline for improving the overall QoS and energy efficiency. In this context, this paper presents a comprehensive performance and power analysis of the entire game streaming pipeline consisting of the server/cloud side, network, and edge. Through extensive measurements with a high-end workstation mimicking the cloud end, an open-source platform (Moonlight-GameStreaming) emulating the edge device/mobile platform, and two network settings (WiFi and 5G) we conduct a detailed measurement-based study with seven representative games with different characteristics. We characterize the performance in terms of frame latency, QoS, bitrate, and energy consumption for different stages of the gaming pipeline. Our study shows that the rendering stage and the encoding stage at the cloud end are the bottlenecks to support 4K streaming. While 5G is certainly more suitable for supporting enhanced video quality with 4K streaming, it is more expensive in terms of power consumption compared to WiFi. Further, fluctuations in 5G network quality can lead to huge frame drops thus affecting QoS, which needs to be addressed by a coordinated design between the edge device and the server. Finally, the network interface and the decoder units in a mobile platform need more energy-efficient design to support high quality games at a lower cost. These observations should help in designing more cost-effective future cloud gaming platforms.

References

  1. NVIDIA Corporation. 2021. GeForce Now . "https://www.nvidia.com/en-us/geforce-now/" .Google ScholarGoogle Scholar
  2. Amazon.com, Inc. 2020. Amazon Luna . "https://www.amazon.com/luna/landing-page" .Google ScholarGoogle Scholar
  3. Andrew Burnes. 2020. FrameView Performance and Power Benchmarking App: Free Download Available Now . "https://www.nvidia.com/en-us/geforce/news/nvidia-frameview-power-and-performance-benchmarking-app-download/" .Google ScholarGoogle Scholar
  4. Amit Ahlawat Anju. 2016. Performance Analysis of Image Compression Technique. Image (2016), 107--111.Google ScholarGoogle Scholar
  5. Anritsu. 2020. Measuring Path Loss of 5G FR2 Transmissions Through Common Materials Found in the Signal Path . "https://dl.cdn-anritsu.com/en-us/test-measurement/files/Application-Notes/Application-Note/11410-01189A.pdf" .Google ScholarGoogle Scholar
  6. Niranjan Balasubramanian, Aruna Balasubramanian, and Arun Venkataramani. 2009. Energy Consumption in Mobile Phones: A Measurement Study and Implications for Network Applications. In Proceedings of the 9th ACM SIGCOMM Conference on Internet Measurement. Association for Computing Machinery, New York, NY, USA, 280--293.Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Bethesda Softworks LLC. 2021. Skyrim . "https://elderscrolls.bethesda.net/en/skyrim" .Google ScholarGoogle Scholar
  8. Bethesda Softworks LLC. 2022. Return to Castle Wolfenstein . "https://store.steampowered.com/app/9010/Return_to_Castle_Wolfenstein/" .Google ScholarGoogle Scholar
  9. Bungie, Inc. 2021. Destiny 2 . "https://www.bungie.net/en/pub/aboutdestiny" .Google ScholarGoogle Scholar
  10. Wei Cai, Zhen Hong, Xiaofei Wang, Henry C. B. Chan, and Victor C. M. Leung. 2015. Quality-of-Experience Optimization for a Cloud Gaming System With Ad Hoc Cloudlet Assistance. IEEE Transactions on Circuits and Systems for Video Technology (2015), 2092--2104.Google ScholarGoogle Scholar
  11. Wei Cai, Ryan Shea, Chun-Ying Huang, Kuan-Ta Chen, Jiangchuan Liu, Victor C. M. Leung, and Cheng-Hsin Hsu. 2016. A Survey on Cloud Gaming: Future of Computer Games. IEEE Access (2016), 7605--7620.Google ScholarGoogle Scholar
  12. Cameron Gutman, Diego Waxemberg, Aaron Neyer, Andrew Hennessy. 2013. Moonlight Android . "https://github.com/moonlight-stream/moonlight-android" .Google ScholarGoogle Scholar
  13. Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2013. Moonlight . "https://moonlight-stream.org/" .Google ScholarGoogle Scholar
  14. Cameron Gutman, Diego Waxemberg, Aaron Neyer, Michelle Bergeron, Andrew Hennessy, Aidan Campbell. 2021. Moonlight Internet Hosting Tool . "https://github.com/moonlight-stream/Internet-Hosting-Tool" .Google ScholarGoogle Scholar
  15. Aaron Carroll and Gernot Heiser. 2010. An Analysis of Power Consumption in a Smartphone. In Proceedings of the 2010 USENIX Conference on USENIX Annual Technical Conference. USENIX Association, USA, 21.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Kuan-Ta Chen, Yu-Chun Chang, Hwai-Jung Hsu, De-Yu Chen, Chun-Ying Huang, and Cheng-Hsin Hsu. 2014. On the Quality of Service of Cloud Gaming Systems. IEEE Transactions on Multimedia (2014), 480--495.Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Nachiappan Chidambaram Nachiappan, Praveen Yedlapalli, Niranjan Soundararajan, Mahmut Taylan Kandemir, Anand Sivasubramaniam, and Chita R. Das. 2014. GemDroid: A Framework to Evaluate Mobile Platforms. In The 2014 ACM International Conference on Measurement and Modeling of Computer Systems . Association for Computing Machinery, New York, NY, USA, 355--366.Google ScholarGoogle Scholar
  18. Philip A Chou and Zhourong Miao. 2006. Rate-distortion Optimized Streaming of Packetized Media . IEEE Transactions on Multimedia (2006), 390--404.Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Dean Takahashi. 2021. Newzoo: Cloud gaming will reach 23.7M paying users and generate $1.6B in 2021 . "https://venturebeat.com/2021/08/26/newzoo-cloud-gaming-will-reach-23--7m-paying-users-and-generate-1--6b-in-2021/" .Google ScholarGoogle Scholar
  20. Dror Gill. 2019. How To Cut Cloud Gaming Bitrates In Half So That Twice As Many Users Can Play . "https://blog.beamr.com/2019/11/19/how-to-cut-cloud-gaming-bitrates-in-half-so-that-twice-as-many-users-can-play/" .Google ScholarGoogle Scholar
  21. Epic Games, Inc. 2021. Fortnite . "https://www.epicgames.com/fortnite/en-US/home" .Google ScholarGoogle Scholar
  22. Fernando A. Fardo, Victor H. Conforto, Francisco C. de Oliveira, and Paulo S. Rodrigues. 2016. A Formal Evaluation of PSNR as Quality Measuremen Parameter for Image Segmentation Algorithms. CoRR (2016), arXiv:1605.07116.Google ScholarGoogle Scholar
  23. Nick Feamster and Hari Balakrishnan. 2002. Packet Loss Recovery For Streaming Video. In 12th International Packet Video Workshop. PA: Pittsburgh, 9--16.Google ScholarGoogle Scholar
  24. FFmpeg team. 2000. FFmpeg . "https://www.ffmpeg.org/" .Google ScholarGoogle Scholar
  25. Sebastian Flinck Lindström, Markus Wetterberg, and Niklas Carlsson. 2020. Cloud Gaming: A QoE Study of Fast-paced Single-player and Multiplayer Gaming. In 2020 IEEE/ACM 13th International Conference on Utility and Cloud Computing (UCC). 34--45.Google ScholarGoogle Scholar
  26. Fredrik Fornwall. 2021. Termux . "https://termux.com/" .Google ScholarGoogle Scholar
  27. Google. 2019. Stadia - One place for all the ways we play . "https://stadia.google.com/" .Google ScholarGoogle Scholar
  28. Habtegebreil Haile, Karl-Johan Grinnemo, Simone Ferlin, Per Hurtig, and Anna Brunstrom. 2021. End-to-end Congestion Control Approaches for High Throughput and Low Delay in 4G/5G Cellular Networks . Computer Networks (2021), 107692.Google ScholarGoogle Scholar
  29. Wenjie Hu and Guohong Cao. 2015. Energy-aware video streaming on smartphones. In 2015 IEEE Conference on Computer Communications (INFOCOM). Institute of Electrical and Electronics Engineers Inc., United States, 1185--1193.Google ScholarGoogle ScholarCross RefCross Ref
  30. Chun-Ying Huang, Kuan-Ta Chen, De-Yu Chen, Hwai-Jung Hsu, and Cheng-Hsin Hsu. 2014a. GamingAnywhere: The First Open Source Cloud Gaming System. ACM Trans. Multimedia Comput. Commun. Appl. (2014).Google ScholarGoogle Scholar
  31. Chun-Ying Huang, Cheng-Hsin Hsu, Yu-Chun Chang, and Kuan-Ta Chen. 2013. GamingAnywhere: An Open Cloud Gaming System. In Proceedings of the 4th ACM Multimedia Systems Conference. Association for Computing Machinery, New York, NY, USA, 36--47.Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Te-Yuan Huang, Ramesh Johari, Nick McKeown, Matthew Trunnell, and Mark Watson. 2014b. A Buffer-Based Approach to Rate Adaptation: Evidence from a Large Video Streaming Service. In Proceedings of the 2014 ACM Conference on SIGCOMM. Association for Computing Machinery, New York, NY, USA, 187--198.Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Yiming Huo, Xiaodai Dong, and Wei Xu. 2017. 5G Cellular User Equipment: From Theory to Practical Hardware Design . IEEE Access (2017), 13992--14010.Google ScholarGoogle Scholar
  34. Mikel Irazabal Bengoa. 2021. Enhanced Quality of Service Mechanisms for 5G Networks . (2021).Google ScholarGoogle Scholar
  35. Bart Jansen, Timothy Goodwin, Varun Gupta, Fernando Kuipers, and Gil Zussman. 2018. Performance Evaluation of WebRTC-Based Video Conferencing. SIGMETRICS Perform. Eval. Rev. (2018), 56--68.Google ScholarGoogle Scholar
  36. Junchen Jiang, Vyas Sekar, and Hui Zhang. 2012. Improving Fairness, Efficiency, and Stability in HTTP-Based Adaptive Video Streaming with FESTIVE. In Proceedings of the 8th International Conference on Emerging Networking Experiments and Technologies . Association for Computing Machinery, New York, NY, USA, 97--108.Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Julz. 2021. What's the Best Frame Rate for Gaming ? "https://www.build-gaming-computers.com/best-frame-rate-for-pc-gaming.html" .Google ScholarGoogle Scholar
  38. Mark Kalman, Eckehard Steinbach, and Bernd Girod. 2002. Rate-distortion Optimized Video Streaming with Adaptive Playout. In Proceedings. International Conference on Image Processing. IEEE, III--III.Google ScholarGoogle ScholarCross RefCross Ref
  39. Kuba Kaszyk, Harry Wagstaff, Tom Spink, Björn Franke, Mike O'Boyle, Bruno Bodin, and Henrik Uhrenholt. 2019. Full-System Simulation of Mobile CPU/GPU Platforms. In 2019 IEEE International Symposium on Performance Analysis of Systems and Software (ISPASS) . IEEE Computer Society, Los Alamitos, CA, USA, 68--78.Google ScholarGoogle Scholar
  40. Kozakoff,Dennis J. and Corallo, Carlo A. and Petra, D. and Roovers, Wilhelmus Cornelus Wal. 2016. 5G Cellular Electromagnetic Window Considerations . "https://www.dsm.com/content/dam/dsm/dyneema/en_GB/Downloads/Researchpapers/5G_Cellular_article.pdf" .Google ScholarGoogle Scholar
  41. KRAFTON, Inc. 2021. PUBG Mobile . "https://www.pubgmobile.com/en-US/home.shtml" .Google ScholarGoogle Scholar
  42. KRAFTON, Inc. 2022. PUBG: Battlegrounds . "https://store.steampowered.com/app/578080/PUBG_BATTLEGROUNDS/" .Google ScholarGoogle Scholar
  43. Xin Li, Mian Dong, Zhan Ma, and Felix C.A. Fernandes. 2012. GreenTube: Power Optimization for Mobile Videostreaming via Dynamic Cache Management. In Proceedings of the 20th ACM International Conference on Multimedia. Association for Computing Machinery, New York, NY, USA, 279--288.Google ScholarGoogle Scholar
  44. Licidy. 2019. Known Issue: Performance Issues with Low FPS . "https://forums.ageofempires.com/t/known-issue-performance-issues-with-low-fps/60111" .Google ScholarGoogle Scholar
  45. Hongzi Mao, Ravi Netravali, and Mohammad Alizadeh. 2017. Neural Adaptive Video Streaming with Pensieve. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication. Association for Computing Machinery, New York, NY, USA, 197--210.Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Marshall Honorof. 2021. Can't find a PS5, Xbox Series X or GPU? Embrace it . "https://www.tomsguide.com/news/ps5-xbox-series-x-gpu-semiconductor-shortage" .Google ScholarGoogle Scholar
  47. Microsoft. 2021 a. Age of Empires-uppercaseexpandafterromannumeral2: Definitive Edition. "https://www.ageofempires.com/games/aoeiide/" .Google ScholarGoogle Scholar
  48. Microsoft. 2021 b. Age of Empires-uppercaseexpandafterromannumeral3: Definitive Edition. "https://www.ageofempires.com/games/aoeiiide" .Google ScholarGoogle Scholar
  49. Microsoft. 2021 c. Xbox Cloud Gaming (Beta) with Xbox Game Pass . "https://www.xbox.com/en-US/xbox-game-pass/cloud-gaming" .Google ScholarGoogle Scholar
  50. Mojang Studios. 2011. Minecraft . "https://www.minecraft.net/en-us" .Google ScholarGoogle Scholar
  51. Mordor Intelligence. 2021. Cloud Gaming Market - Growth, Trends, COVID-19 Impact, and Forecasts (2021 - 2026) . "https://www.mordorintelligence.com/industry-reports/cloud-gaming-market" .Google ScholarGoogle Scholar
  52. Motion Twin. 2021. Dead CellS . "https://dead-cells.com/" .Google ScholarGoogle Scholar
  53. Nachiket Mhatre. 2021. Here's What Caused The Ongoing Global Chip Shortage & Why It Will Only Get Worse . "https://onsitego.com/blog/global-chip-shortage-explained-causes-future/" .Google ScholarGoogle Scholar
  54. Arvind Narayanan, Xumiao Zhang, Ruiyang Zhu, Ahmad Hassan, Shuowei Jin, Xiao Zhu, Xiaoxuan Zhang, Denis Rybkin, Zhengxuan Yang, Zhuoqing Morley Mao, Feng Qian, and Zhi-Li Zhang. 2021. A Variegated Look at 5G in the Wild: Performance, Power, and QoE Implications. In Proceedings of the 2021 ACM SIGCOMM 2021 Conference (SIGCOMM '21). Association for Computing Machinery, New York, NY, USA, 610--625.Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. NVIDIA Corporation. 2019. An Introduction to the NVIDIA Optical Flow SDK . "https://developer.nvidia.com/blog/an-introduction-to-the-nvidia-optical-flow-sdk/" .Google ScholarGoogle Scholar
  56. NVIDIA Corporation. 2021 a. GeForce Experience . "https://www.nvidia.com/en-us/geforce/geforce-experience/" .Google ScholarGoogle Scholar
  57. NVIDIA Corporation. 2021 b. NVIDIA GameStream . "https://www.nvidia.com/en-us/shield/support/shield-tv/gamestream/" .Google ScholarGoogle Scholar
  58. NVIDIA Corporation. 2021 c. ShadowPlay: Record, Share Game Videos & Screenshots . "https://www.nvidia.com/en-us/geforce/geforce-experience/shadowplay/" .Google ScholarGoogle Scholar
  59. Opensignal. 2021. Opensignal - 5G, 4G, 3G Internet & WiFi Speed Test . "https://play.google.com/store/apps/details?id=com.staircase3.opensignal&hl=en_US&gl=US" .Google ScholarGoogle Scholar
  60. Junho Park, Heechang Seong, Yong Nam Whang, and Wonbin Hong. 2019. Energy-efficient 5G Phased Arrays Incorporating Vertically Polarized Endfire Planar Folded Slot Antenna for mmWave Mobile Terminals . IEEE Transactions on Antennas and Propagation (2019), 230--241.Google ScholarGoogle Scholar
  61. Pelham Smithers, Omri Wallach, Clayton Wodsworth. 2020. The Rise Of Gaming Revenue Visualized . "https://www.visualcapitalist.com/wp-content/uploads/2020/11/history-of-gaming-by-revenue-share-full-size.html" .Google ScholarGoogle Scholar
  62. Oswaldo Sebastian Peñaherrera-Pulla, Carlos Baena, Sergio Fortes, Eduardo Baena, and Raquel Barco. 2021. Measuring Key Quality Indicators in Cloud Gaming: Framework and Assessment Over Wireless Networks. Sensors (2021).Google ScholarGoogle Scholar
  63. Qualcomm Technologies Inc. 2018. First 5G mmWave Antenna Module for Smartphones . "https://www.microwavejournal.com/articles/31448-first-5g-mmwave-antenna-module-for-smartphones" .Google ScholarGoogle Scholar
  64. Eman Ramadan, Arvind Narayanan, Udhaya Kumar Dayalan, Rostand AK Fezeu, Feng Qian, and Zhi-Li Zhang. 2021. Case for 5G-aware video streaming applications . In Proceedings of the 1st Workshop on 5G Measurements, Modeling, and Use Cases. Association for Computing Machinery, 27--34.Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Sam Desatoff. 2021. Report: Cloud gaming market to reach $6.5 billion by 2024 (Newzoo) . "https://gamedaily.biz/article/2143/report-cloud-gaming-market-to-reach-65-billion-by-2024-newzoo" .Google ScholarGoogle Scholar
  66. Aaron Schulman, Vishnu Navda, Ran Ramjee, Neil Spring, Pralhad Deshp, Calvin Grunewald, Kamal Jain, and Venkata N. Padmanabhan. 2010. Bartendr: A Practical Approach to Energy-aware Cellular Data Scheduling. In Proceedings of the Sixteenth Annual International Conference on Mobile Computing and Networking. Association for Computing Machinery, New York, NY, USA, 85--96.Google ScholarGoogle Scholar
  67. Sony Interactive Entertainment LLC. 2021. PlayStation Now . "https://www.playstation.com/en-us/ps-now/" .Google ScholarGoogle Scholar
  68. Kevin Spiteri, Rahul Urgaonkar, and Ramesh K. Sitaraman. 2016. BOLA: Near-optimal bitrate adaptation for online videos. In IEEE INFOCOM 2016 - The 35th Annual IEEE International Conference on Computer Communications . IEEE Press, 1--9.Google ScholarGoogle Scholar
  69. Team Cherry. 2021. Hollow Knight . "https://www.hollowknight.com/" .Google ScholarGoogle Scholar
  70. Ninad Warty, Ramanujan K. Sheshadri, Wei Zheng, and Dimitrios Koutsonikolas. 2012. A First Look at 802.11n Power Consumption in Smartphones. In Proceedings of the First ACM International Workshop on Practical Issues and Applications in next Generation Wireless Networks. Association for Computing Machinery, New York, NY, USA, 27--32.Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Wikipedia Contributor. 2021. Games as a service . "https://en.wikipedia.org/wiki/Games_as_a_service" .Google ScholarGoogle Scholar
  72. Dongzhu Xu, Anfu Zhou, Xinyu Zhang, Guixian Wang, Xi Liu, Congkai An, Yiming Shi, Liang Liu, and Huadong Ma. 2020. Understanding Operational 5G: A First Measurement Study on Its Coverage, Performance and Energy Consumption. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 479--494.Google ScholarGoogle ScholarDigital LibraryDigital Library
  73. Hyunho Yeo, Chan Ju Chong, Youngmok Jung, Juncheol Ye, and Dongsu Han. 2020. NEMO: Enabling Neural-Enhanced Video Streaming on Commodity Mobile Devices. In Proceedings of the 26th Annual International Conference on Mobile Computing and Networking . Association for Computing Machinery, New York, NY, USA, bibinfonumpages14 pages.Google ScholarGoogle ScholarDigital LibraryDigital Library
  74. Xiaoqi Yin, Abhishek Jindal, Vyas Sekar, and Bruno Sinopoli. 2015. A Control-Theoretic Approach for Dynamic Adaptive Video Streaming over HTTP. In Proceedings of the 2015 ACM Conference on Special Interest Group on Data Communication . Association for Computing Machinery, New York, NY, USA, 325--338.Google ScholarGoogle ScholarDigital LibraryDigital Library
  75. Chanmin Yoon, Dongwon Kim, Wonwoo Jung, Chulkoo Kang, and Hojung Cha. 2012. AppScope: Application Energy Metering Framework for Android Smartphone Using Kernel Activity Monitoring. In 2012 USENIX Annual Technical Conference (USENIX ATC 12). USENIX Association, Boston, MA, 387--400.Google ScholarGoogle Scholar
  76. ZeroTier, Inc. 2021. ZeroTier . "https://www.zerotier.com/" .Google ScholarGoogle Scholar
  77. Haibo Zhang, Prasanna Venkatesh Rengasamy, Shulin Zhao, Nachiappan Chidambaram Nachiappan, Anand Sivasubramaniam, Mahmut T. Kandemir, Ravi Iyer, and Chita R. Das. 2017. Race-to-SleepGoogle ScholarGoogle Scholar
  78. Content CachingGoogle ScholarGoogle Scholar
  79. Display Caching: A Recipe for Energy-Efficient Video Streaming on Handhelds. In Proceedings of the 50th Annual IEEE/ACM International Symposium on Microarchitecture . Association for Computing Machinery, New York, NY, USA, 517--531.Google ScholarGoogle Scholar

Index Terms

  1. End-to-end Characterization of Game Streaming Applications on Mobile Platforms

          Recommendations

          Comments

          Login options

          Check if you have access through your login credentials or your institution to get full access on this article.

          Sign in

          Full Access

          PDF Format

          View or Download as a PDF file.

          PDF

          eReader

          View online with eReader.

          eReader
          About Cookies On This Site

          We use cookies to ensure that we give you the best experience on our website.

          Learn more

          Got it!