Measuring Latency Variation in the Internet

ABSTRACT

We analyse two complementary datasets to quantify the latency variation experienced by internet end-users: (i) a large-scale active measurement dataset (from the Measurement Lab Network Diagnostic Tool) which shed light on long-term trends and regional differences; and (ii) passive measurement data from an access aggregation link which is used to analyse the edge links closest to the user.

The analysis shows that variation in latency is both common and of significant magnitude, with two thirds of samples exceeding 100, ms of variation. The variation is seen within single connections as well as between connections to the same client. The distribution of experienced latency variation is heavy-tailed, with the most affected clients seeing an order of magnitude larger variation than the least affected. In addition, there are large differences between regions, both within and between continents. Despite consistent improvements in throughput, most regions show no reduction in latency variation over time, and in one region it even increases.

We examine load-induced queueing latency as a possible cause for the variation in latency and find that both datasets readily exhibit symptoms of queueing latency correlated with network load. Additionally, when this queueing latency does occur, it is of significant magnitude, more than 200\,ms in the median. This indicates that load-induced queueing contributes significantly to the overall latency variation.

References

1. NDT test methodology. Wiki page: https://goo.gl/KrqtbQ, 2015.
2. J. Aikat, J. Kaur, F. D. Smith, and K. Jeffay. Variability in TCP round-trip times. In 3rd ACM SIGCOMM conference on Internet measurement. ACM, 2003.
3. S. Alfredsson, G. Del Giudice, J. Garcia, A. Brunstrom, L. De Cicco, and S. Mascolo. Impact of tcp congestion control on bufferbloat in cellular networks. In IEEE 14th International Symposium and Workshops on a World of Wireless, Mobile and Multimedia Networks (WoWMoM), 2013.
4. M. Allman. Comments on bufferbloat. ACM SIGCOMM Computer Communications Review, January 2013.
5. Z. S. Bischof, J. S. Otto, and F. E. Bustamante. Up, down and around the stack: Isp characterization from network intensive applications. ACM SIGCOMM Computer Communication Review, 2012.
6. B. Briscoe, A. Brunstrom, A. Petlund, D. Hayes, D. Ros, I.-J. Tsang, S. Gjessing, G. Fairhurst, C. Griwodz, and M. Welzl. Reducing internet latency: A survey of techniques and their merits. Communications Surveys Tutorials, IEEE, 2014.
7. I. Canadi, P. Barford, and J. Sommers. Revisiting broadband performance. In 2012 ACM conference on Internet measurement. ACM, 2012.
8. M. Chetty, S. Sundaresan, S. Muckaden, N. Feamster, and E. Calandro. Measuring broadband performance in south africa. In 4th Annual Symposium on Computing for Development. ACM, 2013.
9. C. Chirichella and D. Rossi. To the moon and back: are internet bufferbloat delays really that large? In Computer Communications Workshops (INFOCOM WKSHPS), 2013 IEEE Conference on. IEEE, 2013.
10. S. Choy, B. Wong, G. Simon, and C. Rosenberg. The brewing storm in cloud gaming: A measurement study on cloud to end-user latency. In 11th annual workshop on network and systems support for games. IEEE Press, 2012.
11. M. Dischinger, A. Haeberlen, K. P. Gummadi, and S. Saroiu. Characterizing residential broadband networks. In Internet Measurement Conference, 2007.
12. C. Fraleigh, S. Moon, B. Lyles, C. Cotton, M. Khan, D. Moll, R. Rockell, T. Seely, and S. C. Diot. Packet-level traffic measurements from the sprint ip backbone. Network, IEEE, 2003.
13. F. Hernandez-Campos and M. Papadopouli. Assessing the real impact of 802.11 wlans: A large-scale comparison of wired and wireless traffic. In 14th IEEE Workshop on Local and Metropolitan Area Networks. IEEE, 2005.
14. T. Høiland-Jørgensen, P. Hurtig, and A. Brunstrom. The Good, the Bad and the WiFi: Modern AQMs in a residential setting. Computer Networks, Oct. 2015.
15. S. Jaiswal, G. Iannaccone, C. Diot, J. Kurose, and D. Towsley. Inferring tcp connection characteristics through passive measurements. In INFOCOM 2004. IEEE, 2004.
16. H. Jiang and C. Dovrolis. Passive estimation of tcp round-trip times. ACM SIGCOMM Computer Communication Review, 2002.
17. H. Jiang, Y. Wang, K. Lee, and I. Rhee. Tackling bufferbloat in 3g/4g networks. In 2012 ACM conference on Internet measurement. ACM, 2012.
18. C. Kreibich, N. Weaver, B. Nechaev, and V. Paxson. Netalyzr: illuminating the edge network. In 10th ACM SIGCOMM conference on Internet measurement. ACM, 2010.
19. M. Lab. ISP interconnection and its impact on consumer internet performance. Technical report, Measurement Lab Consortium, October 2014.
20. G. Maier, A. Feldmann, V. Paxson, and M. Allman. On dominant characteristics of residential broadband internet traffic. In 9th ACM SIGCOMM conference on Internet measurement. ACM, 2009.
21. M. Mathis, J. Heffner, and R. Raghunarayan. TCP Extended Statistics MIB. RFC 4898 (Proposed Standard), May 2007.
22. A. Pathak, M. Zhang, Y. C. Hu, R. Mahajan, and D. Maltz. Latency inflation with mpls-based traffic engineering. In 2011 ACM SIGCOMM conference on Internet measurement. ACM, 2011.
23. V. Paxson, M. Allman, J. Chu, and M. Sargent. Computing TCP's Retransmission Timer. RFC 6298 (Proposed Standard), June 2011.
24. M. A. Sánchez, J. S. Otto, Z. S. Bischof, D. R. Choffnes, F. E. Bustamante, B. Krishnamurthy, and W. Willinger. Dasu: Pushing experiments to the internet's edge. In NSDI, 2013.
25. A. Singla, B. Chandrasekaran, P. Godfrey, and B. Maggs. The internet at the speed of light. In 13th ACM Workshop on Hot Topics in Networks. ACM, 2014.
26. S. Sundaresan, W. De Donato, N. Feamster, R. Teixeira, S. Crawford, and A. Pescapè. Broadband internet performance: a view from the gateway. In ACM SIGCOMM computer communication review. ACM, 2011.
27. F. Vacirca, F. Ricciato, and R. Pilz. Large-scale RTT measurements from an operational UMTS/GPRS network. In First International Conference on Wireless Internet. IEEE, 2005.

Index Terms

• Networks

  • Network performance evaluation

    • Network measurement

    • Network performance analysis

  • Network properties

    • Network dynamics

  • Network types

    • Public Internet