An Open Dataset of Operational Mobile Networks

ABSTRACT

Mobile networks have become ubiquitous and the primary means to access the Internet, and the traffic they generate has rapidly increased over the last years. The technology and service diversity in mobile networks call for extensive and accurate measurements to ensure the proper functioning of the networks and rapidly spot impairments. However, the measurement of mobile networks is complicated by their scale, and, thus, expensive, especially due to the diversity of deployments, technologies, and web services. In this paper, we present and provide access to the largest open international mobile network dataset collected using the MONROE platform spanning six countries, 27 mobile network operators, and 120 measurement nodes. We use them to run measurements targeting several web services from January 2018 to December 2019, collecting millions of TCP and UDP flows using these commercial mobile networks. We illustrate the data collection platforms and describe some of the main experiments. Besides a high-level overview of the dataset, we provide two practical use cases. First, we show how our data can be used as a proxy for web service performance. Second, we study the content delivery infrastructure of Facebook.

References

1. [n.d.]. MONROE-Browsertime. https://github.com/MONROE-PROJECT/Experiments/. [Online; accessed 18-Jul-2020].
2. [n.d.]. sitespeedio/browsertime: Your browser, your page, your scripts! https://github.com/sitespeedio/browsertime. [Online; accessed 20-Feb-2019].
3. [n.d.]. Xvfb manual. https://goo.gl/EPBtpt. [Online; accessed 20-Feb-2019].
4. Ö. Alay, A. Lutu, M. Peón-Quirós, V. Mancuso, T. Hirsch, K. Evensen, A. Hansen, S. Alfredsson, J. Karlsson, A. Brunstrom, A. Safari Khatouni, M. Mellia, and M. Ajmone Marsan. 2017. Experience: An Open Platform for Experimentation with Commercial Mobile Broadband Networks. Proc. ACM MobiCom '17 (2017), 70--78. https://doi.org/10.1145/3117811.3117812
5. Alexa. 2017. The top sites on the web. https://www.alexa.com/topsites. [Online; accessed 24-Jul-2020].
6. Daniele Apiletti, Elena Baralis, Tania Cerquitelli, Paolo Garza, Danilo Giordano, Marco Mellia, and Luca Venturini. 2016. SeLINA: A self-learning insightful network analyzer. IEEE Transactions on Network and Service Management, Vol. 13, 3 (2016), 696--710.
7. T Barnett, S Jain, U Andra, and T Khurana. 2018. Cisco Visual Networking Index (VNI), Complete Forecast Update, 2017--2022. Americas/EMEAR Cisco Knowledge Network (CKN) Presentation (2018).
8. M. Belshe, R. Peon, and M. Thomson. 2015. Hypertext Transfer Protocol Version 2 (HTTP/2). RFC 7540 (Proposed Standard).
9. Ignacio Bermudez, Marco Mellia, Maurizio M. Munafò, Ram Keralapura, and Antonio Nucci. 2012. DNS to the Rescue: Discerning Content and Services in a Tangled Web. In Proceedings of the ACM SIGCOMM Internet Measurement Conference (IMC'12). 413--426. http://doi.acm.org/10.1145/2398776.2398819
10. Enrico Bocchi, Luca De Cicco, and Dario Rossi. 2016. Measuring the Quality of Experience of Web users. ACM SIGCOMM Computer Communication Review, Vol. 46, 4 (2016), 8--13.
11. FCC. 2013. 2013 Measuring Broadband America February Report. Technical Report. FCC's Office of Engineering and Technology and Consumer and Governmental Affairs Bureau.
12. R. Fielding et al. 1999. Hypertext Transfer Protocol -- HTTP/1.1. RFC 2616 (Draft Standard).
13. Danilo Giordano, Stefano Traverso, Luigi Grimaudo, Marco Mellia, Elena Baralis, Alok Tongaonkar, and Sabyasachi Saha. 2015a. YouLighter: A cognitive approach to unveil YouTube CDN and changes. IEEE Transactions on Cognitive Communications and Networking, Vol. 1, 2 (2015), 161--174.
14. Danilo Giordano, Stefano Traverso, Luigi Grimaudo, Marco Mellia, Elena Baralis, Alok Tongaonkar, and Sabyasachi Saha. 2015b. Youlighter: An unsupervised methodology to unveil youtube cdn changes. In 2015 27th International Teletraffic Congress. IEEE, 19--27.
15. Rick Hofstede, Pavel v Celeda, Brian Trammell, Idilio Drago, Ramin Sadre, Anna Sperotto, and Aiko Pras. 2014. Flow Monitoring Explained: From Packet Capture to Data Analysis with NetFlow and IPFIX. Commun. Surveys Tuts., Vol. 16, 4 (2014), 2037--2064.
16. Ali Safari Khatouni, Marco Ajmone Marsan, Marco Mellia, and Reza Rejaie. 2018. Deadline-constrained content upload from multihomed devices: Formulations and algorithms. Computer Networks, Vol. 142 (2018), 76 -- 92. https://doi.org/10.1016/j.comnet.2018.06.008
17. Ali Safari Khatouni, Marco Mellia, Marco Ajmone Marsan, Stefan Alfredsson, Jonas Karlsson, Anna Brunstrom, Ozgu Alay, Andra Lutu, Cise Midoglu, and Vincenzo Mancuso. 2017a. Speedtest-like Measurements in 3G/4G Networks: The MONROE Experience. In Teletraffic Congress (ITC 29), 2017 29th International, Vol. 1. IEEE, 169--177.
18. Ali Safari Khatouni, Martino Trevisan, Leonardo Regano, and Alessio Viticchié. 2017b. Privacy issues of isps in the modern web. In 2017 8th IEEE Annual Information Technology, Electronics and Mobile Communication Conference (IEMCON). IEEE, 588--594.
19. Adam Langley, Alistair Riddoch, Alyssa Wilk, Antonio Vicente, Charles Krasic, Dan Zhang, Fan Yang, Fedor Kouranov, Ian Swett, Janardhan Iyengar, Jeff Bailey, Jeremy Dorfman, Jim Roskind, Joanna Kulik, Patrik Westin, Raman Tenneti, Robbie Shade, Ryan Hamilton, Victor Vasiliev, Wan-Teh Chang, and Zhongyi Shi. 2017. The QUIC Transport Protocol: Design and Internet-Scale Deployment. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (Los Angeles, CA, USA) (SIGCOMM '17). ACM, New York, NY, USA, 183--196. https://doi.org/10.1145/3098822.3098842
20. Vincenzo Mancuso and et al. 2019. Results from running an experiment as a service platform for mobile broadband networks in Europe. Computer Communications, Vol. 133 (2019), 89 -- 101.
21. Anna Maria Mandalari, Andra Lutu, Ana Custura, Ali Safari Khatouni, Özgü Alay, Marcelo Bagnulo, Vaibhav Bajpai, Anna Brunstrom, Jörg Ott, Marco Mellia, and Gorry Fairhurst. 2018. Experience: Implications of Roaming in Europe. In Proceedings of the 24th Annual International Conference on Mobile Computing and Networking (New Delhi, India) (MobiCom '18). Association for Computing Machinery, New York, NY, USA, 179--189. https://doi.org/10.1145/3241539.3241577
22. Cise Midoglu. 2020. Large Scale Speedtest Experimentation in Mobile Broadband Networks. https://mosaic-simulamet.com/large-scale-speedtest-experimentation-in- mobile-broadband-networks/. [Online; accessed 24-Jul-2020].
23. Cise Midoglu, Leonhard Wimmer, Andra Lutu, Özgü Alay, and Carsten Griwodz. 2018. MONROE-Nettest: A configurable tool for dissecting speed measurements in mobile broadband networks. In IEEE INFOCOM 2018 - IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). 342--347.
24. Miguel Peón-Quirós, Vincenzo Mancuso, Vincenzo Comite, Andra Lutu, Özgü Alay, Stefan Alfredsson, Jonas Karlsson, Anna Brunstrom, Marco Mellia, Ali Safari Khatouni, and Thomas Hirsch. 2017. Results from Running an Experiment as a Service Platform for Mobile Networks. In Proceedings of the 11th Workshop on Wireless Network Testbeds, Experimental Evaluation & CHaracterization (Snowbird, Utah, USA) (WiNTECH '17). Association for Computing Machinery, New York, NY, USA, 9--16. https://doi.org/10.1145/3131473.3131485
25. Mohammad Rajiullah, Andra Lutu, Ali Safari Khatouni, Mah-Rukh Fida, Marco Mellia, Anna Brunstrom, Ozgu Alay, Stefan Alfredsson, and Vincenzo Mancuso. 2019. Web Experience in Mobile Networks: Lessons from Two Million Page Visits. In The World Wide Web Conference (San Francisco, CA, USA) (WWW '19). Association for Computing Machinery, New York, NY, USA, 1532--1543. https://doi.org/10.1145/3308558.3313606
26. Jingjing Ren, Daniel J. Dubois, David Choffnes, Anna Maria Mandalari, Roman Kolcun, and Hamed Haddadi. 2019. Information Exposure for Consumer IoT Devices: A Multidimensional, Network-Informed Measurement Approach. In Proc. of the Internet Measurement Conference (IMC) .
27. Ali Safari Khatouni, Francesca Soro, and Danilo Giordano. 2019. A Machine Learning Application for Latency Prediction in Operational 4G Networks. In 2019 IFIP/IEEE Symposium on Integrated Network and Service Management (IM). 71--74.
28. Arunan Sivanathan, Hassan Habibi Gharakheili, Franco Loi, Adam Radford, Chamith Wijenayake, Arun Vishwanath, and Vijay Sivaraman. 2018. Classifying IoT devices in smart environments using network traffic characteristics. IEEE Transactions on Mobile Computing, Vol. 18, 8 (2018), 1745--1759.
29. Srikanth Sundaresan, Walter Donato, Nick Feamster, Renata Teixeira, Sam Crawford, and Antonio Pescape. 2012. Measuring Home Broadband Performance. Commun. ACM, Vol. 55 (11 2012), 100--109. https://doi.org/10.1145/2366316.2366337
30. Martino Trevisan, Idilio Drago, Marco Mellia, and Maurizio M. Munafò. 2016. Towards Web Service Classification using Addresses and DNS. In Proceedings of the 7th International Workshop on Traffic Analysis and Characterization (TRAC'16). 38--43. https://ieeexplore.ieee.org/document/7577030/
31. Martino Trevisan, Alessandro Finamore, Marco Mellia, Maurizio Munafo, and Dario Rossi. 2017. Traffic analysis with off-the-shelf hardware: Challenges and lessons learned. IEEE Communications Magazine, Vol. 55, 3 (2017), 163--169.
32. Martino Trevisan, Danilo Giordano, Idilio Drago, Maurizio Munafò, and Marco Mellia. 2020. Five Years at the Edge: Watching Internet From the ISP Network. IEEE/ACM Transactions on Networking, Vol. 28, 2 (2020), 561--574.
33. Martino Trevisan, Ali Safari Khatouni, and Danilo Giordano. 2020. ERRANT: Realistic emulation of radio access networks. Computer Networks, Vol. 176 (2020), 107289. https://doi.org/10.1016/j.comnet.2020.107289

Index Terms

• Networks

  • Network performance evaluation

    • Network experimentation

    • Network measurement

  • Network services

    • Network monitoring

  • Network types

    • Mobile networks