skip to main content
10.1145/3405656.3418715acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Free access

NDN-DPDK: NDN Forwarding at 100 Gbps on Commodity Hardware

Published: 22 September 2020 Publication History
  • Get Citation Alerts
  • Abstract

    Since the Named Data Networking (NDN) data plane requires name-based lookup of potentially large tables using variable-length hierarchical names as well as per-packet state updates, achieving high-speed NDN forwarding remains a challenge. In order to address this gap, we developed a high-performance NDN router capable of reaching forwarding rates higher than 100 Gbps while running on commodity hardware. In this paper we present our design and discuss its tradeoffs. We achieved this performance through several optimization techniques that include adopting better algorithms and efficient data structures, as well as making use of the parallelism offered by modern multi-core CPUs and multiple hardware queues with user-space drivers for kernel bypass. Our open-source forwarder is the first software implementation of NDN to exceed 100 Gbps throughput while supporting the full protocol semantics. We also present the results of extensive benchmarking carried out to assess a number of performance dimensions and to diagnose the current bottlenecks in the packet processing pipeline for future scalability enhancements. Finally, we identify future work which includes hardware-assisted ingress traffic dispatching, dynamic load balancing across forwarding threads, and novel caching solutions to accommodate on-disk content stores.

    Supplementary Material

    MP4 File (p30-shi-presentation.mp4)

    References

    [1]
    Mohammad Alhowaidi, Byrav Ramamurthy, Brian Bockelman, and David Swanson. 2017. The case for using content-centric networking for distributing high-energy physics software. In 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS). IEEE, 2571--2572.
    [2]
    Jean-Philippe Aumasson and Daniel J Bernstein. 2012. SipHash: a fast short-input PRF. In International Conference on Cryptology in India. Springer, 489--508.
    [3]
    Mathieu Desnoyers and Paul E. McKenney. [n.d.]. Userspace RCU Implementation. Retrieved August 31, 2020 from https://liburcu.org/
    [4]
    Chengyu Fan, Susmit Shannigrahi, Steve DiBenedetto, Catherine Olschanowsky, Christos Papadopoulos, and Harvey Newman. 2015. Managing scientific data with named data networking. In Proceedings of the Fifth International Workshop on Network-Aware Data Management. 1--7.
    [5]
    Matt Fleming. 2017. A thorough introduction to eBPF. LWN.net (2017). https://lwn.net/Articles/740157/
    [6]
    Masaki Fukushima, Atsushi Tagami, and Toru Hasegawa. 2013. Efficiently looking up non-aggregatable name prefixes by reducing prefix seeking. In 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 340--344.
    [7]
    JJ Garcia-Luna-Aceves and Maziar Mirzazad Barijough. 2016. Content-centric networking using anonymous datagrams. In 2016 IFIP Networking Conference (IFIP Networking) and Workshops. IEEE, 171--179.
    [8]
    José Joaquin Garcia-Luna-Aceves. 2017. ADN: An information-centric networking architecture for the Internet of Things. In Proceedings of the second international conference on internet-of-things design and implementation. 27--36.
    [9]
    Van Jacobson, Diana K Smetters, James D Thornton, Michael F Plass, Nicholas H Briggs, and Rebecca L Braynard. 2009. Networking named content. In Proceedings of the 5th international conference on Emerging networking experiments and technologies. 1--12.
    [10]
    Davide Kirchner, Raihana Ferdous, Renato Lo Cigno, Leonardo Maccari, Massimo Gallo, Diego Perino, and Lorenzo Saino. 2016. Augustus: a CCN router for programmable networks. In Proceedings of the 3rd ACM Conference on Information-Centric Networking. 31--39.
    [11]
    Rodrigo B Mansilha, Lorenzo Saino, Marinho P Barcellos, Massimo Gallo, Emilio Leonardi, Diego Perino, and Dario Rossi. 2015. Hierarchical content stores in high-speed ICN routers: Emulation and prototype implementation. In Proceedings of the 2nd ACM Conference on Information-Centric Networking. 59--68.
    [12]
    Steven McCanne and Van Jacobson. 1993. The BSD Packet Filter: A New Architecture for User-level Packet Capture. In USENIX winter, Vol. 46.
    [13]
    Paul E. McKenney, Mathieu Desnoyers, and Lai Jiangshan. 2013. User-space RCU. LWN.net (2013). https://lwn.net/Articles/573424/
    [14]
    M. Mosko, I. Solis, and C. Wood. 2019. Content-Centric Networking (CCNx) Semantics. RFC 8569 (Experimental). https://doi.org/10.17487/RFC8569
    [15]
    K.Nichols, V.Jacobson, A. McGregor (Ed.), and J. Iyengar (Ed.). 2018. Controlled Delay Active Queue Management. RFC 8289 (Experimental). https://doi.org/10.17487/RFC8289
    [16]
    Diego Perino, Matteo Varvello, Leonardo Linguaglossa, Rafael Laufer, and Roger Boislaigue. 2014. Caesar: A content router for high-speed forwarding on content names. In Proceedings of the tenth ACM/IEEE symposium on Architectures for networking and communications systems. 137--148.
    [17]
    DPDK Project. [n.d.]. Data Plane Development Kit. Retrieved August 31, 2020 from https://www.dpdk.org/
    [18]
    IO Visor Project. [n.d.]. eBPF: extended Berkeley Packet Filter. Retrieved August 31, 2020 from https://www.iovisor.org/technology/ebpf
    [19]
    Named Data Networking Project. [n.d.]. NDN Packet Format Specification, version 0.3. Retrieved August 31, 2020 from https://named-data.net/doc/NDN-packet-spec/0.3/
    [20]
    Named Data Networking Project. [n.d.]. NDN Protocol Design Principles. Retrieved August 31, 2020 from https://named-data.net/project/ndn-design-principles/
    [21]
    Named Data Networking Project. [n.d.]. NDNLPv2: NDN Link Protocol, version 2. Retrieved August 31, 2020 from https://redmine.named-data.net/projects/nfd/wiki/NDNLPv2
    [22]
    Named Data Networking Project. 2018. NFD Developer's Guide. Technical Report. NDN-0021, Revision 10. https://named-data.net/publications/techreports/ndn-0021-10-nfd-developer-guide/
    [23]
    Duncan Rand, Simon Fayer, and David J Colling. 2015. Possibilities for named data networking in HEP. In Journal of Physics: Conference Series, Vol. 664. IOP Publishing, 052031.
    [24]
    I. Rhee, L. Xu, S. Ha, A. Zimmermann, L. Eggert, and R. Scheffenegger. 2018. CUBIC for Fast Long-Distance Networks. RFC 8312 (Informational). https://doi.org/10.17487/RFC8312
    [25]
    Klaus Schneider, Cheng Yi, Beichuan Zhang, and Lixia Zhang. 2016. A practical congestion control scheme for named data networking. In Proceedings of the 3rd ACM Conference on Information-Centric Networking. 21--30.
    [26]
    Pranab Kumar Sen. 1968. Estimates of the regression coefficient based on Kendall's tau. Journal of the American statistical association 63, 324 (1968), 1379--1389.
    [27]
    Susmit Shannigrahi, Chengyu Fan, and Christos Papadopoulos. 2018. Named data networking strategies for improving large scientific data transfers. In 2018 IEEE International Conference on Communications Workshops (ICC Workshops). IEEE, 1--6.
    [28]
    Susmit Shannigrahi, Christos Papadopoulos, Edmund Yeh, Harvey Newman, Artur Jerzy Barczyk, Ran Liu, Alex Sim, Azher Mughal, Inder Monga, Jean-Roch Vlimant, et al. 2015. Named data networking in climate research and HEP applications. In Journal of Physics: Conference Series, Vol. 664. IOP Publishing, 052033.
    [29]
    Junxiao Shi. 2017. Named Data Networking in Local Area Networks. Ph.D. Dissertation. The University of Arizona. http://hdl.handle.net/10150/625652
    [30]
    Won So, Ashok Narayanan, and David Oran. 2013. Named data networking on a router: Fast and DoS-resistant forwarding with hash tables. In Architectures for Networking and Communications Systems. IEEE, 215--225.
    [31]
    Junji Takemasa, Yuki Koizumi, and Toru Hasegawa. 2017. Toward an ideal NDN router on a commercial off-the-shelf computer. In Proceedings of the 4th ACM Conference on Information-Centric Networking. 43--53.
    [32]
    H Thiel. 1950. A rank-invariant method of linear and polynomial regression analysis, Part 3. In Proceedings of Koninalijke Nederlandse Akademie van Weinenschatpen A, Vol. 53. 1397--1412.
    [33]
    Matteo Varvello, Diego Perino, and Leonardo Linguaglossa. 2013. On the design and implementation of a wire-speed pending interest table. In 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 369--374.
    [34]
    Yi Wang, Keqiang He, Huichen Dai, Wei Meng, Junchen Jiang, Bin Liu, and Yan Chen. 2012. Scalable name lookup in NDN using effective name component encoding. In 2012 IEEE 32nd International Conference on Distributed Computing Systems. IEEE, 688--697.
    [35]
    Edmund Yeh, Ran Liu, Yuanhao Wu, Volkan Mutlu, Yuezhou Liu, Harvey Newman, Catalin Iordache, Raimondas Sirvinskas, Justas Balcas, Susmit Shannigrahi, Chengyu Fan, and Craig Partridge. 2019. SANDIE: SDN-Assisted NDN for Data Intensive Experiments. In SC19 Network Research Exhibition.
    [36]
    Wei You, Bertrand Mathieu, Patrick Truong, Jean-François Peltier, and Gwendal Simon. 2012. Dipit: A distributed bloom-filter based pit table for ccn nodes. In 2012 21st International Conference on Computer Communications and Networks (ICCCN). IEEE, 1--7.
    [37]
    Haowei Yuan and Patrick Crowley. 2014. Scalable pending interest table design: From principles to practice. In IEEE INFOCOM 2014-IEEE Conference on Computer Communications. IEEE, 2049--2057.
    [38]
    Haowei Yuan, Tian Song, and Patrick Crowley. 2012. Scalable NDN forwarding: Concepts, issues and principles. In 2012 21st International Conference on computer communications and networks (ICCCN). IEEE, 1--9.
    [39]
    Lixia Zhang, Alexander Afanasyev, Jeffrey Burke, Van Jacobson, KC Claffy, Patrick Crowley, Christos Papadopoulos, Lan Wang, and Beichuan Zhang. 2014. Named Data Networking. ACM SIGCOMM Computer Communication Review 44, 3 (2014), 66--73.

    Cited By

    View all
    • (2024)Resilient Sensor Data Dissemination to Mitigate Link Faults in IoT Networks With Long-Haul Optical Wires for Power Transmission GridsIEEE Internet of Things Journal10.1109/JIOT.2024.335329111:9(15919-15939)Online publication date: 1-May-2024
    • (2024)Implementation of Centralized Routing based on Cost Metric Calculation in Named Data Networking2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)10.1109/ICETSIS61505.2024.10459435(654-658)Online publication date: 28-Jan-2024
    • (2024)A Named Data Networking Based Fast Open Storage System Plugin for XRootDEPJ Web of Conferences10.1051/epjconf/202429501004295(01004)Online publication date: 6-May-2024
    • Show More Cited By

    Recommendations

    Comments

    Information & Contributors

    Information

    Published In

    cover image ACM Conferences
    ICN '20: Proceedings of the 7th ACM Conference on Information-Centric Networking
    September 2020
    181 pages
    ISBN:9781450380409
    DOI:10.1145/3405656
    This paper is authored by an employee(s) of the United States Government and is in the public domain. Non-exclusive copying or redistribution is allowed, provided that the article citation is given and the authors and agency are clearly identified as its source.

    Sponsors

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    Published: 22 September 2020

    Permissions

    Request permissions for this article.

    Check for updates

    Author Tags

    1. Commodity hardware
    2. High-speed forwarding
    3. Information centric networking
    4. Kernel bypass
    5. NDN forwarder
    6. Named data networking
    7. Network performance
    8. Packet forwarding engine
    9. Performance benchmarking
    10. Software router

    Qualifiers

    • Research-article
    • Research
    • Refereed limited

    Conference

    ICN '20
    Sponsor:
    ICN '20: 7th ACM Conference on Information-Centric Networking
    September 29 - October 1, 2020
    Virtual Event, Canada

    Acceptance Rates

    ICN '20 Paper Acceptance Rate 15 of 39 submissions, 38%;
    Overall Acceptance Rate 133 of 482 submissions, 28%

    Contributors

    Other Metrics

    Bibliometrics & Citations

    Bibliometrics

    Article Metrics

    • Downloads (Last 12 months)293
    • Downloads (Last 6 weeks)39

    Other Metrics

    Citations

    Cited By

    View all
    • (2024)Resilient Sensor Data Dissemination to Mitigate Link Faults in IoT Networks With Long-Haul Optical Wires for Power Transmission GridsIEEE Internet of Things Journal10.1109/JIOT.2024.335329111:9(15919-15939)Online publication date: 1-May-2024
    • (2024)Implementation of Centralized Routing based on Cost Metric Calculation in Named Data Networking2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)10.1109/ICETSIS61505.2024.10459435(654-658)Online publication date: 28-Jan-2024
    • (2024)A Named Data Networking Based Fast Open Storage System Plugin for XRootDEPJ Web of Conferences10.1051/epjconf/202429501004295(01004)Online publication date: 6-May-2024
    • (2023)Pegasus: A High-Speed NDN Router with Programmable Switches and Server ClustersProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623713(12-18)Online publication date: 9-Oct-2023
    • (2023)CCNx Router on FPGA Accelerator Achieving Predictable PerformanceProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623710(1-11)Online publication date: 9-Oct-2023
    • (2023)Capture and Analysis of Traffic Traces on a Wide-Area NDN TestbedProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623707(101-108)Online publication date: 9-Oct-2023
    • (2023)High Performance Inter-satellite Routing Design of Terahertz Interface2023 4th International Conference on Electronic Communication and Artificial Intelligence (ICECAI)10.1109/ICECAI58670.2023.10176766(112-118)Online publication date: 12-May-2023
    • (2023)PLR: An In-Network Proactive Loss Recovery Scheme for Named Data Networking2023 32nd International Conference on Computer Communications and Networks (ICCCN)10.1109/ICCCN58024.2023.10230118(1-10)Online publication date: Jul-2023
    • (2023)A Comprehensive Survey on Software as a Service (SaaS) Transformation for the Automotive SystemsIEEE Access10.1109/ACCESS.2023.329425611(73688-73753)Online publication date: 2023
    • (2023)Enabling privacy by anonymization in the collection of similar data in multi-domain IoTComputer Communications10.1016/j.comcom.2023.02.022203:C(60-76)Online publication date: 1-Apr-2023
    • Show More Cited By

    View Options

    View options

    PDF

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    Get Access

    Login options

    Media

    Figures

    Other

    Tables

    Share

    Share

    Share this Publication link

    Share on social media