skip to main content
10.1145/3517745.3561422acmconferencesArticle/Chapter ViewAbstractPublication PagesimcConference Proceedingsconference-collections
research-article

Internet scale reverse traceroute

Published: 25 October 2022 Publication History

Abstract

Knowledge of Internet paths allows operators and researchers to better understand the Internet and troubleshoot problems. Paths are often asymmetric, so measuring just the forward path only gives partial visibility. Despite the existence of Reverse Traceroute, a technique that captures reverse paths (the sequence of routers traversed by traffic from an arbitrary, uncontrolled destination to a given source), this technique did not fulfill the needs of operators and the research community, as it had limited coverage, low throughput, and inconsistent accuracy. In this paper we design, implement and evaluate revtr 2.0, an Internet-scale Reverse Traceroute system that combines novel measurement approaches and studies with a large-scale deployment to improve throughput, accuracy, and coverage, enabling the first exploration of reverse paths at Internet scale. revtr 2.0 can run 15M reverse traceroutes in one day. This scale allows us to open the system to external sources and users, and supports tasks such as traffic engineering and troubleshooting.

Supplementary Material

M4V File (70.m4v)
Presentation video

References

[1]
CAIDA Ark. https://www.caida.org/projects/ark.
[2]
iPlane Traceroute Dataset. http://web.eecs.umich.edu/~harshavm/iplane/iplane_logs/data/.
[3]
Oregon Route Views, http://www.routeviews.org/.
[4]
RFC 791, 2007. https://datatracker.ietf.org/doc/html/rfc791.
[5]
RFC 8092, 2017. https://tools.ietf.org/html/rfc8092.
[6]
CATDA Ark IPv4 Internet Topology Data Kits Dataset, 2019. https://www.caida.org/catalog/datasets/internet-topology-data-kit/.
[7]
Visible ASNs: Customer Populations Estimations, 2022. https://stats.labs.apnic.net/aspop/.
[8]
OneStep---Cogent BGP Communities, 2022. https://onestep.net/communities/as174/.
[9]
Euro IX, 2022. https://ixpdb.euro-ix.net/en/.
[10]
M-Lab Status, 2022. https://www.measurementlab.net/status/.
[11]
Peering DB, 2022. https://www.peeringdb.com/.
[12]
Reverse Traceroute Demo, 2022. https://www.revtr.ccs.neu.edu.
[13]
Reverse Traceroute MLab Data Archive, 2022. https://console.cloud.google.com/storage/browser/thirdparty-revtr-mlab-oti.
[14]
Reverse Traceroute System Code, 2022. https://github.com/NEU-SNS/ReverseTraceroutePublic.
[15]
Reverse Traceroute Vantage Point Code, 2022. https://github.com/NEU-SNS/revtrvp.
[16]
RIPE Atlas, 2022. https://atlas.ripe.net/.
[17]
Taha Albakour, Oliver Gasser, Robert Beverly, and Georgios Smaragdakis. Third Time's not a Charm: Exploiting SNMPv3 for Router Fingerprinting. In Proc. ACM IMC, 2021.
[18]
Rafael LC Almeida, Italo Cunha, Renata Teixeira, Darryl Veitch, and Christophe Diot. Classification of Load Balancing in the Internet. In Proc. IEEE INFOCOM, 2020.
[19]
Ruwaifa Anwar, Haseeb Niaz, David R. Choffnes, Italo Cunha, Phillipa Gill, and Ethan Katz-Bassett. Investigating Interdomain Routing Policies in the Wild. In Proc. ACM IMC, 2015.
[20]
Todd Arnold, Jia He, Weifan Jiang, Matt Calder, Italo Cunha, Vasileios Giotsas, and Ethan Katz-Bassett. Cloud Provider Connectivity in the Flat Internet. In Proc. ACM IMC, 2020.
[21]
Brice Augustin, Xavier Cuvellier, Benjamin Orgogozo, Fabien Viger, Timur Friedman, Matthieu Latapy, Clémence Magnien, and Renata Teixeira. Avoiding Traceroute Anomalies with Paris Traceroute. In Proc. ACM IMC, 2006.
[22]
Adam Bender, Rob Sherwood, and Neil Spring. Fixing Ally's Growing Pains with Velocity Modeling. In Proc. ACM IMC, 2008.
[23]
Robert Beverly. Yarrp'ing the Internet: Randomized High-Speed Active Topology Discovery. In Proc. ACM IMC, 2016.
[24]
Robert Beverly, Arthur Berger, and Geoffrey G Xie. Primitives for Active Internet Topology Mapping: Toward High-frequency Characterization. In Proc. ACM IMC, 2010.
[25]
Randy Bush, Olaf Maennel, Matthew Roughan, and Steve Uhlig. Internet Optometry: Assessing the Broken Glasses in Internet Reachability. In Proc. ACM IMC, 2009.
[26]
Matt Calder, Ashley Flavel, Ethan Katz-Bassett, Ratul Mahajan, and Jitendra Padhye. Analyzing the Performance of an Anycast CDN. In Proc. ACM IMC, 2015.
[27]
Yan Chen, David Bindel, Hanhee Song, and Randy H Katz. An Algebraic Approach to Practical and Scalable Overlay Network Monitoring. In Proc. ACM SIGCOMM, 2004.
[28]
Italo Cunha, Renata Teixeira, Darryl Veitch, and Christophe Diot. DTRACK: A System to Predict and Track Internet Path Changes. ACM/IEEE Transactions on Networking, 22(4):1025--1038, 2014.
[29]
Italo Cunha, Pietro Marchetta, Matt Calder, Yi-Ching Chiu, Bruno VA Machado, Antonio Pescapè, Vasileios Giotsas, Harsha V Madhyastha, and Ethan Katz-Bassett. Sibyl: A Practical Internet Route Oracle. In Proc. USENIX NSDI, 2016.
[30]
Wouter de Vries, José Jair Santanna, Anna Sperotto, and Aiko Pras. How Asymmetric is the Internet? In Proc. IFIP AIMS, 2015.
[31]
Ramakrishnan Durairajan, Sathiya Kumaran Mani, Paul Barford, Robert Nowak, and Joel Sommers. TimeWeaver: Opportunistic One Way Delay Measurement Via NTP. In Proc. IEEE ITC, 2018.
[32]
Brian Eriksson, Paul Barford, and Robert Nowak. Network Discovery from Passive Measurements. In Proc. ACM SIGCOMM, 2008.
[33]
Xun Fan and John Heidemann. Selecting Representative IP Addresses for Internet Topology Studies. In Proc. ACM IMC, 2010.
[34]
Tobias Flach, Ethan Katz-Bassett, and Ramesh Govindan. Quantifying Violations of Destination-based Forwarding on the Internet. In Proc. ACM IMC, 2012.
[35]
Ashley Flavel, Pradeepkumar Mani, David Maltz, Nick Holt, Jie Liu, Yingying Chen, and Oleg Surmachev. FastRoute: A Scalable Load-Aware Anycast Routing Architecture for Modern CDNs. In Proc. USENIX NSDI, 2015.
[36]
Osvaldo Fonseca, Ítalo Cunha, Elverton Fazzion, Wagner Meira, Ronaldo A Ferreira, Ethan Katz-Bassett, et al. Identifying Networks Vulnerable to IP Spoofing. IEEE Transactions on Network and Service Management, 2021.
[37]
Rodrigo Fonseca, George Porter, Randy Katz, Scott Shenker, and Ion Stoica. IP Options Are Not an Option. Technical report, EECS Department, University of California, Berkeley, 2005.
[38]
Vasileios Giotsas, Thomas Koch, Elverton Fazzion, Ítalo Cunha, Matt Calder, Harsha V Madhyastha, and Ethan Katz-Bassett. Reduce, Reuse, Recycle: Repurposing Existing Measurements to Identify Stale Traceroutes. In Proc. ACM IMC, 2020.
[39]
Brian J Goodchild, Yi-Ching Chiu, Rob Hansen, Haonan Lua, Matt Calder, Matthew Luckie, Wyatt Lloyd, David Choffnes, and Ethan Katz-Bassett. The Record Route Option is an Option! In Proc. ACM IMC, 2017.
[40]
Matthieu Gouel, Kevin Vermeulen, Maxime Mouchet, Justin P Rohrer, Olivier Fourmaux, and Timur Friedman. Zeph & Iris Map the Internet: A Resilient Reinforcement Learning Approach to Distributed IP Route Tracing. ACM SIGCOMM Computer Communication Review, 52(1):2--9, 2022.
[41]
Caitlin Gray, Clemens Mosig, Randy Bush, Cristel Pelsser, Matthew Roughan, Thomas C Schmidt, and Matthias Wahlisch. BGP Beacons, Network Tomography, and Bayesian Computation to Locate Route Flap Damping. In Proc. ACM IMC, 2020.
[42]
Bamba Gueye, Artur Ziviani, Mark Crovella, and Serge Fdida. Constraint-based Geolocation of Internet Hosts. IEEE/ACM Transactions on Networking, 14(6):1219--1232, 2006.
[43]
Mehmet H Gunes and Kamil Sarac. Resolving IP Aliases in Building Traceroute-based Internet Maps. IEEE/ACM Transactions on Networking, 17(6):1738--1751, 2009.
[44]
Gonca Gursun. Routing-Aware Partitioning of the Internet Address Space for Server Ranking in CDNs. Computer Communications, 106(C):86--99, July 2017.
[45]
Gonca Gürsun, Natali Ruchansky, Evimaria Terzi, and Mark Crovella. Routing State Distance: A Path-based Metric for Network Analysis. In Proc. ACM IMC, 2012.
[46]
Mohammad Javad Hajikhani, Thomas Kunz, and Howard Schwartz. A Recursive Method for Clock Synchronization in Asymmetric Packet-Based Networks. IEEE/ACM Transactions on Networking, 24(4):2332--2342, 2016.
[47]
Yihua He, Michalis Faloutsos, Srikanth Krishnamurthy, and Bradley Huffaker. On Routing Asymmetry in the Internet. In Proc. IEEE GLOBECOM, 2005.
[48]
Yuchen Huang, Michael Rabinovich, and Rami Al-Dalky. FlashRoute: Efficient Traceroute on a Massive Scale. In Proc. ACM IMC, 2020.
[49]
Umar Javed, Italo Cunha, David Choffnes, Ethan Katz-Bassett, Thomas E Anderson, and Arvind Krishnamurthy. PoiRoot: Investigating the Root Cause of Interdomain Path Changes. In Proc. ACM SIGCOMM, 2013.
[50]
Ethan Katz-Bassett, John P John, Arvind Krishnamurthy, David Wetherall, Thomas E Anderson, and Yatin Chawathe. Towards IP Geolocation Using Delay and Topology Measurements. In Proc. ACM IMC, 2006.
[51]
Ethan Katz-Bassett, Harsha V Madhyastha, John P John, Arvind Krishnamurthy, David Wetherall, and Thomas E Anderson. Studying Black Holes in the Internet with Hubble. In Proc. USENIX NSDI, 2008.
[52]
Ethan Katz-Bassett, Harsha V Madhyastha, Vijay Kumar Adhikari, Colin Scott, Justine Sherry, Peter Van Wesep, Thomas E Anderson, and Arvind Krishnamurthy. Reverse Traceroute. In Proc. USENIX NSDI, 2010.
[53]
Ethan Katz-Bassett, Colin Scott, David R Choffnes, Italo Cunha, Vytautas Valancius, Nick Feamster, Harsha V Madhyastha, Thomas E Anderson, and Arvind Krishnamurthy. LIFEGUARD: Practical Repair of Persistent Route Failures. In Proc. ACM SIGCOMM, 2012.
[54]
Ken Keys. Internet-scale IP Alias Resolution Techniques. ACM SIGCOMM Computer Communication Review, 40(1):50--55, January 2010.
[55]
Ken Keys, Young Hyun, Matthew Luckie, and Kim Claffy. Internet-scale IPv4 Alias Resolution with MIDAR. IEEE/ACM Transactions on Networking, 21(2):383--399, 2012.
[56]
Rupa Krishnan, Harsha V Madhyastha, Sridhar Srinivasan, Sushant Jain, Arvind Krishnamurthy, Thomas E Anderson, and Jie Gao. Moving beyond End-to-end Path Information to Optimize CDN Performance. In Proc. ACM IMC, 2009.
[57]
Z. Li, D. Levin, N. Spring, and B. Bhattacharjee. Internet Anycast: Performance, Problems and Potential. In Proc. ACM SIGCOMM, 2018.
[58]
Matthew Luckie, Bradley Huffaker, Amogh Dhamdhere, Vasileios Giotsas, and KC Claffy. AS Relationships, Customer Cones, and Validation. In Proc. ACM IMC, 2013.
[59]
Harsha V Madhyastha, Tomas Isdal, Michael Piatek, Colin Dixon, Thomas E Anderson, Arvind Krishnamurthy, and Arun Venkataramani. iPlane: An Information Plane for Distributed Services. In Proc. USENIX OSDI, 2006.
[60]
Harsha V Madhyastha, Ethan Katz-Bassett, Thomas E Anderson, Arvind Krishnamurthy, and Arun Venkataramani. iPlane Nano: Path Prediction for Peer-to-Peer Applications. In Proc. USENIX NSDI, 2009.
[61]
Ratul Mahajan, Neil Spring, David Wetherall, and Thomas E Anderson. User-Level Internet Path Diagnosis. In Proc. ACM SOSP, 2003.
[62]
Ratul Mahajan, Ming Zhang, Lindsey Poole, and Vivek S Pai. Uncovering Performance Differences Among Backbone ISPs with Netdiff. In Proc. USENIX NSDI, 2008.
[63]
Alexander Marder, Matthew Luckie, Amogh Dhamdhere, Bradley Huffaker, Jonathan M Smith, et al. Pushing the Boundaries with bdrmapIT: Mapping Router Ownership at Internet Scale. In Proc. ACM IMC, 2018.
[64]
Jean-Jacques Pansiot and Dominique Grad. On Routes and Multicast Trees in the Internet. ACM SIGCOMM Computer Communication Review, 28(1):41--50, 1998.
[65]
Abhinav Pathak, Himabindu Pucha, Ying Zhang, Y. Charlie Hu, and Z. Morley Mao. A Measurement Study of Internet Delay Asymmetry. In Proc. Passive and Active Measurement Conference, 2008.
[66]
Andreas Reuter, Randy Bush, Italo Cunha, Ethan Katz-Bassett, Thomas C. Schmidt, and Matthias Wahlisch. Towards a Rigorous Methodology for Measuring Adoption of RPKI Route Validation and Filtering. ACM SIGCOMM Computer Communication Review, 48(1):19--27, Jan. 2018.
[67]
Brandon Schlinker, Todd Arnold, Italo Cunha, and Ethan Katz-Bassett. PEERING: Virtualizing BGP at the Edge for Research. In Proc. ACM CoNEXT, 2019.
[68]
Justine Sherry, Ethan Katz-Bassett, Mary Pimenova, Harsha V Madhyastha, Thomas E Anderson, and Arvind Krishnamurthy. Resolving IP Aliases with Prespecified Timestamps. In Proc. ACM IMC, 2010.
[69]
Rob Sherwood and Neil Spring. Touring the Internet in a TCP Sidecar. In Proc. ACM IMC, 2006.
[70]
Rob Sherwood, Adam Bender, and Neil Spring. DisCarte: A Disjunctive Internet Cartographer. In Proc. ACM SIGCOMM, 2008.
[71]
Jared M Smith, Kyle Birkeland, Tyler McDaniel, and Max Schuchard. Withdrawing the BGP Re-Routing Curtain: Understanding the Security Impact of BGP Poisoning through Real-World Measurements. In Proc. USENIX NDSS, 2020.
[72]
Neil Spring, Ratul Mahajan, and David Wetherall. Measuring ISP Topologies with Rocketfuel. In Proc. ACM SIGCOMM, 2002.
[73]
Richard A Steenbergen. A Practical Guide to (Correctly) Troubleshooting with Traceroute. NANOG, 2009.
[74]
Peng Sun, Laurent Vanbever, and Jennifer Rexford. Scalable Programmable Inbound Traffic Engineering. In Proc. ACM SOSR, 2015.
[75]
Kevin Vermeulen, Stephen D Strowes, Olivier Fourmaux, and Timur Friedman. Multilevel MDA-Lite Paris Traceroute. In Proc. ACM IMC, 2018.
[76]
Kevin Vermeulen, Justin P Rohrer, Robert Beverly, Olivier Fourmaux, and Timur Friedman. Diamond-Miner: Comprehensive Discovery of the Internet's Topology Diamonds. In Proc. USENIX NSDI, 2020.
[77]
Florian Wohlfart, Nikolaos Chatzis, Caglar Dabanoglu, Georg Carle, and Walter Willinger. Leveraging Interconnections for Performance: The Serving Infrastructure of a Large CDN. In Proc. ACM SIGCOMM, 2018.
[78]
Bernard Wong, Aleksandrs Slivkins, and Emin Gün Sirer. Meridian: a Lightweight Network Location Service without Virtual Coordinates. In Proc. ACM SIGCOMM, 2005.
[79]
Bernard Wong, Ivan Stoyanov, and Emin Gün Sirer. Octant: A Comprehensive Framework for the Geolocalization of Internet Hosts. In Proc. USENIX NSDI, 2007.
[80]
Kok-Kiong Yap, Murtaza Motiwala, Jeremy Rahe, Steve Padgett, Matthew Holliman, Gary Baldus, Marcus Hines, Taeeun Kim, Ashok Narayanan, Ankur Jain, Victor Lin, Colin Rice, Brian Rogan, Arjun Singh, Bert Tanaka, Manish Verma, Puneet Sood, Tariq Mukarram, Matt Tierney, Dzevad Trumic, Vytautas Valancius, Calvin Ying, Mahesh Kallahalla, Bikash Koley, and Amin Vahdat. Taking the Edge off with Espresso: Scale, Reliability and Programmability for Global Internet Peering. In Proc. ACM SIGCOMM, 2017.
[81]
Ming Zhang, Chi Zhang, Vivek S Pai, Larry L Peterson, and Randolph Y Wang. PlanetSeer: Internet Path Failure Monitoring and Characterization in Wide-area Services. In Proc. USENIX OSDI, 2004.
[82]
Xiao Zhang, Tanmoy Sen, Zheyuan Zhang, Tim April, Balakrishnan Chandrasekaran, David Choffnes, Bruce M Maggs, Haiying Shen, Ramesh K Sitaraman, and Xiaowei Yang. AnyOpt: Predicting and Optimizing IP Anycast Performance. In Proc. ACM SIGCOMM, 2021.
[83]
Zheng Zhang, Ying Zhang, Y. Charlie Hu, Z. Morley Mao, and Randy Bush. iSPY: Detecting IP Prefix Hijacking on My Own. In Proc. ACM SIGCOMM, 2008.
[84]
Zhiyong Zhang, Ovidiu Mara, and Katerina Argyraki. Network Neutrality Inference. In Proc. ACM SIGCOMM, 2014.
[85]
Jiangchen Zhu, Kevin Vermeulen, Italo Cunha, Matt Calder, and Ethan Katz-Bassett. The Best of Both Worlds: High Availability CDN Routing Without Compromising Control. In Proc. ACM IMC, 2022.

Cited By

View all
  • (2024)Bad Packets Come Back, Worse Ones Don'tProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672259(311-326)Online publication date: 4-Aug-2024
  • (2024)metAScritic: Reframing AS-Level Topology Discovery as a Recommendation SystemProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688429(337-364)Online publication date: 4-Nov-2024
  • (2024)Deep Dive into NTP Pool's Popularity and MappingProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390418:1(1-30)Online publication date: 21-Feb-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
IMC '22: Proceedings of the 22nd ACM Internet Measurement Conference
October 2022
796 pages
ISBN:9781450392594
DOI:10.1145/3517745
Publication rights licensed to ACM. ACM acknowledges that this contribution was authored or co-authored by an employee, contractor or affiliate of a national government. As such, the Government retains a nonexclusive, royalty-free right to publish or reproduce this article, or to allow others to do so, for Government purposes only.

Sponsors

In-Cooperation

  • USENIX Assoc: USENIX Assoc

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 25 October 2022

Permissions

Request permissions for this article.

Check for updates

Author Tags

  1. internet measurements
  2. internet scale
  3. reverse traceroute

Qualifiers

  • Research-article

Funding Sources

  • NSF

Conference

IMC '22
IMC '22: ACM Internet Measurement Conference
October 25 - 27, 2022
Nice, France

Acceptance Rates

Overall Acceptance Rate 277 of 1,083 submissions, 26%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)309
  • Downloads (Last 6 weeks)12
Reflects downloads up to 11 Feb 2025

Other Metrics

Citations

Cited By

View all
  • (2024)Bad Packets Come Back, Worse Ones Don'tProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672259(311-326)Online publication date: 4-Aug-2024
  • (2024)metAScritic: Reframing AS-Level Topology Discovery as a Recommendation SystemProceedings of the 2024 ACM on Internet Measurement Conference10.1145/3646547.3688429(337-364)Online publication date: 4-Nov-2024
  • (2024)Deep Dive into NTP Pool's Popularity and MappingProceedings of the ACM on Measurement and Analysis of Computing Systems10.1145/36390418:1(1-30)Online publication date: 21-Feb-2024
  • (2023)Poster: Towards a Publicly Available Framework to Process Traceroutes with MetaTraceProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3625001(728-729)Online publication date: 24-Oct-2023
  • (2023)Replication: Towards a Publicly Available Internet Scale IP Geolocation DatasetProceedings of the 2023 ACM on Internet Measurement Conference10.1145/3618257.3624801(1-15)Online publication date: 24-Oct-2023

View Options

Login options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Figures

Tables

Media

Share

Share

Share this Publication link

Share on social media