research-article

Free access

NDN-DPDK: NDN Forwarding at 100 Gbps on Commodity Hardware

Authors:

Davide Pesavento,

Lotfi BenmohamedAuthors Info & Claims

ICN '20: Proceedings of the 7th ACM Conference on Information-Centric Networking

Pages 30 - 40

https://doi.org/10.1145/3405656.3418715

Published: 22 September 2020 Publication History

Abstract

Since the Named Data Networking (NDN) data plane requires name-based lookup of potentially large tables using variable-length hierarchical names as well as per-packet state updates, achieving high-speed NDN forwarding remains a challenge. In order to address this gap, we developed a high-performance NDN router capable of reaching forwarding rates higher than 100 Gbps while running on commodity hardware. In this paper we present our design and discuss its tradeoffs. We achieved this performance through several optimization techniques that include adopting better algorithms and efficient data structures, as well as making use of the parallelism offered by modern multi-core CPUs and multiple hardware queues with user-space drivers for kernel bypass. Our open-source forwarder is the first software implementation of NDN to exceed 100 Gbps throughput while supporting the full protocol semantics. We also present the results of extensive benchmarking carried out to assess a number of performance dimensions and to diagnose the current bottlenecks in the packet processing pipeline for future scalability enhancements. Finally, we identify future work which includes hardware-assisted ingress traffic dispatching, dynamic load balancing across forwarding threads, and novel caching solutions to accommodate on-disk content stores.

Supplementary Material

MP4 File (p30-shi-presentation.mp4)

Download
47.44 MB

References

[1]

Mohammad Alhowaidi, Byrav Ramamurthy, Brian Bockelman, and David Swanson. 2017. The case for using content-centric networking for distributing high-energy physics software. In 2017 IEEE 37th International Conference on Distributed Computing Systems (ICDCS). IEEE, 2571--2572.

[2]

Jean-Philippe Aumasson and Daniel J Bernstein. 2012. SipHash: a fast short-input PRF. In International Conference on Cryptology in India. Springer, 489--508.

[3]

Mathieu Desnoyers and Paul E. McKenney. [n.d.]. Userspace RCU Implementation. Retrieved August 31, 2020 from https://liburcu.org/

[4]

Chengyu Fan, Susmit Shannigrahi, Steve DiBenedetto, Catherine Olschanowsky, Christos Papadopoulos, and Harvey Newman. 2015. Managing scientific data with named data networking. In Proceedings of the Fifth International Workshop on Network-Aware Data Management. 1--7.

Digital Library

[5]

Matt Fleming. 2017. A thorough introduction to eBPF. LWN.net (2017). https://lwn.net/Articles/740157/

[6]

Masaki Fukushima, Atsushi Tagami, and Toru Hasegawa. 2013. Efficiently looking up non-aggregatable name prefixes by reducing prefix seeking. In 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 340--344.

[7]

JJ Garcia-Luna-Aceves and Maziar Mirzazad Barijough. 2016. Content-centric networking using anonymous datagrams. In 2016 IFIP Networking Conference (IFIP Networking) and Workshops. IEEE, 171--179.

[8]

José Joaquin Garcia-Luna-Aceves. 2017. ADN: An information-centric networking architecture for the Internet of Things. In Proceedings of the second international conference on internet-of-things design and implementation. 27--36.

Digital Library

[9]

Van Jacobson, Diana K Smetters, James D Thornton, Michael F Plass, Nicholas H Briggs, and Rebecca L Braynard. 2009. Networking named content. In Proceedings of the 5th international conference on Emerging networking experiments and technologies. 1--12.

Digital Library

[10]

Davide Kirchner, Raihana Ferdous, Renato Lo Cigno, Leonardo Maccari, Massimo Gallo, Diego Perino, and Lorenzo Saino. 2016. Augustus: a CCN router for programmable networks. In Proceedings of the 3rd ACM Conference on Information-Centric Networking. 31--39.

Digital Library

[11]

Rodrigo B Mansilha, Lorenzo Saino, Marinho P Barcellos, Massimo Gallo, Emilio Leonardi, Diego Perino, and Dario Rossi. 2015. Hierarchical content stores in high-speed ICN routers: Emulation and prototype implementation. In Proceedings of the 2nd ACM Conference on Information-Centric Networking. 59--68.

Digital Library

[12]

Steven McCanne and Van Jacobson. 1993. The BSD Packet Filter: A New Architecture for User-level Packet Capture. In USENIX winter, Vol. 46.

[13]

Paul E. McKenney, Mathieu Desnoyers, and Lai Jiangshan. 2013. User-space RCU. LWN.net (2013). https://lwn.net/Articles/573424/

[14]

M. Mosko, I. Solis, and C. Wood. 2019. Content-Centric Networking (CCNx) Semantics. RFC 8569 (Experimental). https://doi.org/10.17487/RFC8569

[15]

K.Nichols, V.Jacobson, A. McGregor (Ed.), and J. Iyengar (Ed.). 2018. Controlled Delay Active Queue Management. RFC 8289 (Experimental). https://doi.org/10.17487/RFC8289

[16]

Diego Perino, Matteo Varvello, Leonardo Linguaglossa, Rafael Laufer, and Roger Boislaigue. 2014. Caesar: A content router for high-speed forwarding on content names. In Proceedings of the tenth ACM/IEEE symposium on Architectures for networking and communications systems. 137--148.

Digital Library

[17]

DPDK Project. [n.d.]. Data Plane Development Kit. Retrieved August 31, 2020 from https://www.dpdk.org/

[18]

IO Visor Project. [n.d.]. eBPF: extended Berkeley Packet Filter. Retrieved August 31, 2020 from https://www.iovisor.org/technology/ebpf

[19]

Named Data Networking Project. [n.d.]. NDN Packet Format Specification, version 0.3. Retrieved August 31, 2020 from https://named-data.net/doc/NDN-packet-spec/0.3/

[20]

Named Data Networking Project. [n.d.]. NDN Protocol Design Principles. Retrieved August 31, 2020 from https://named-data.net/project/ndn-design-principles/

[21]

Named Data Networking Project. [n.d.]. NDNLPv2: NDN Link Protocol, version 2. Retrieved August 31, 2020 from https://redmine.named-data.net/projects/nfd/wiki/NDNLPv2

[22]

Named Data Networking Project. 2018. NFD Developer's Guide. Technical Report. NDN-0021, Revision 10. https://named-data.net/publications/techreports/ndn-0021-10-nfd-developer-guide/

[23]

Duncan Rand, Simon Fayer, and David J Colling. 2015. Possibilities for named data networking in HEP. In Journal of Physics: Conference Series, Vol. 664. IOP Publishing, 052031.

[24]

I. Rhee, L. Xu, S. Ha, A. Zimmermann, L. Eggert, and R. Scheffenegger. 2018. CUBIC for Fast Long-Distance Networks. RFC 8312 (Informational). https://doi.org/10.17487/RFC8312

[25]

Klaus Schneider, Cheng Yi, Beichuan Zhang, and Lixia Zhang. 2016. A practical congestion control scheme for named data networking. In Proceedings of the 3rd ACM Conference on Information-Centric Networking. 21--30.

Digital Library

[26]

Pranab Kumar Sen. 1968. Estimates of the regression coefficient based on Kendall's tau. Journal of the American statistical association 63, 324 (1968), 1379--1389.

[27]

Susmit Shannigrahi, Chengyu Fan, and Christos Papadopoulos. 2018. Named data networking strategies for improving large scientific data transfers. In 2018 IEEE International Conference on Communications Workshops (ICC Workshops). IEEE, 1--6.

[28]

Susmit Shannigrahi, Christos Papadopoulos, Edmund Yeh, Harvey Newman, Artur Jerzy Barczyk, Ran Liu, Alex Sim, Azher Mughal, Inder Monga, Jean-Roch Vlimant, et al. 2015. Named data networking in climate research and HEP applications. In Journal of Physics: Conference Series, Vol. 664. IOP Publishing, 052033.

[29]

Junxiao Shi. 2017. Named Data Networking in Local Area Networks. Ph.D. Dissertation. The University of Arizona. http://hdl.handle.net/10150/625652

[30]

Won So, Ashok Narayanan, and David Oran. 2013. Named data networking on a router: Fast and DoS-resistant forwarding with hash tables. In Architectures for Networking and Communications Systems. IEEE, 215--225.

[31]

Junji Takemasa, Yuki Koizumi, and Toru Hasegawa. 2017. Toward an ideal NDN router on a commercial off-the-shelf computer. In Proceedings of the 4th ACM Conference on Information-Centric Networking. 43--53.

Digital Library

[32]

H Thiel. 1950. A rank-invariant method of linear and polynomial regression analysis, Part 3. In Proceedings of Koninalijke Nederlandse Akademie van Weinenschatpen A, Vol. 53. 1397--1412.

[33]

Matteo Varvello, Diego Perino, and Leonardo Linguaglossa. 2013. On the design and implementation of a wire-speed pending interest table. In 2013 IEEE Conference on Computer Communications Workshops (INFOCOM WKSHPS). IEEE, 369--374.

[34]

Yi Wang, Keqiang He, Huichen Dai, Wei Meng, Junchen Jiang, Bin Liu, and Yan Chen. 2012. Scalable name lookup in NDN using effective name component encoding. In 2012 IEEE 32nd International Conference on Distributed Computing Systems. IEEE, 688--697.

Digital Library

[35]

Edmund Yeh, Ran Liu, Yuanhao Wu, Volkan Mutlu, Yuezhou Liu, Harvey Newman, Catalin Iordache, Raimondas Sirvinskas, Justas Balcas, Susmit Shannigrahi, Chengyu Fan, and Craig Partridge. 2019. SANDIE: SDN-Assisted NDN for Data Intensive Experiments. In SC19 Network Research Exhibition.

[36]

Wei You, Bertrand Mathieu, Patrick Truong, Jean-François Peltier, and Gwendal Simon. 2012. Dipit: A distributed bloom-filter based pit table for ccn nodes. In 2012 21st International Conference on Computer Communications and Networks (ICCCN). IEEE, 1--7.

[37]

Haowei Yuan and Patrick Crowley. 2014. Scalable pending interest table design: From principles to practice. In IEEE INFOCOM 2014-IEEE Conference on Computer Communications. IEEE, 2049--2057.

[38]

Haowei Yuan, Tian Song, and Patrick Crowley. 2012. Scalable NDN forwarding: Concepts, issues and principles. In 2012 21st International Conference on computer communications and networks (ICCCN). IEEE, 1--9.

[39]

Lixia Zhang, Alexander Afanasyev, Jeffrey Burke, Van Jacobson, KC Claffy, Patrick Crowley, Christos Papadopoulos, Lan Wang, and Beichuan Zhang. 2014. Named Data Networking. ACM SIGCOMM Computer Communication Review 44, 3 (2014), 66--73.

Digital Library

Cited By

Monjurul Karim MSharif KBiswas SLatif ZQu QLi F(2024)CIC-SIoT: Clean-Slate Information-Centric Software-Defined Content Discovery and Distribution for Internet of ThingsIEEE Internet of Things Journal10.1109/JIOT.2024.344181411:22(37140-37153)Online publication date: 15-Nov-2024
https://doi.org/10.1109/JIOT.2024.3441814
Zhou BWu CYang QQian YNie Y(2024)Resilient Sensor Data Dissemination to Mitigate Link Faults in IoT Networks With Long-Haul Optical Wires for Power Transmission GridsIEEE Internet of Things Journal10.1109/JIOT.2024.335329111:9(15919-15939)Online publication date: 1-May-2024
https://doi.org/10.1109/JIOT.2024.3353291
Ramadha AYovita LWibowo T(2024)Implementation of Centralized Routing based on Cost Metric Calculation in Named Data Networking2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)10.1109/ICETSIS61505.2024.10459435(654-658)Online publication date: 28-Jan-2024
https://doi.org/10.1109/ICETSIS61505.2024.10459435
Show More Cited By

Index Terms

NDN-DPDK: NDN Forwarding at 100 Gbps on Commodity Hardware
1. Networks

Recommendations

Pegasus: A High-Speed NDN Router with Programmable Switches and Server Clusters
ACM ICN '23: Proceedings of the 10th ACM Conference on Information-Centric Networking

Programmable switches provide a solution for implementing highspeed Named Data Networking (NDN) forwarding. However, the challenge arises from the packets in the NDN network that carry hierarchical names of varying lengths, coupled with the inherent ...
NDN-RTC: Real-Time Videoconferencing over Named Data Networking
ACM-ICN '15: Proceedings of the 2nd ACM Conference on Information-Centric Networking

NDN-RTC is a videoconferencing library that employs Named Data Networking (NDN), a proposed future Internet architecture. It was designed to provide a platform for experimental research in low-latency, real-time multimedia communication over NDN. It ...
Scalable, high-speed on-chip-based NDN name forwarding using FPGA
ICDCN '19: Proceedings of the 20th International Conference on Distributed Computing and Networking

Named Data Networking (NDN) is the most promising candidate among the proposed content-based future Internet architectures. In NDN, Forwarding Information Base (FIB) maintains name prefixes and their corresponding outgoing interface(s) and forwards ...

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

ICN '20: Proceedings of the 7th ACM Conference on Information-Centric Networking

September 2020

181 pages

ISBN:9781450380409

DOI:10.1145/3405656

Copyright © 2020 Public Domain.

This paper is authored by an employee(s) of the United States Government and is in the public domain. Non-exclusive copying or redistribution is allowed, provided that the article citation is given and the authors and agency are clearly identified as its source.

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 22 September 2020

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article
Research
Refereed limited

Conference

ICN '20

Sponsor:

SIGCOMM

ICN '20: 7th ACM Conference on Information-Centric Networking

September 29 - October 1, 2020

Virtual Event, Canada

Acceptance Rates

ICN '20 Paper Acceptance Rate 15 of 39 submissions, 38%;

Overall Acceptance Rate 133 of 482 submissions, 28%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

28
Total Citations
View Citations
1,234
Total Downloads

Downloads (Last 12 months)235
Downloads (Last 6 weeks)18

Reflects downloads up to 28 Nov 2024

Other Metrics

View Author Metrics

Citations

Cited By

Monjurul Karim MSharif KBiswas SLatif ZQu QLi F(2024)CIC-SIoT: Clean-Slate Information-Centric Software-Defined Content Discovery and Distribution for Internet of ThingsIEEE Internet of Things Journal10.1109/JIOT.2024.344181411:22(37140-37153)Online publication date: 15-Nov-2024
https://doi.org/10.1109/JIOT.2024.3441814
Zhou BWu CYang QQian YNie Y(2024)Resilient Sensor Data Dissemination to Mitigate Link Faults in IoT Networks With Long-Haul Optical Wires for Power Transmission GridsIEEE Internet of Things Journal10.1109/JIOT.2024.335329111:9(15919-15939)Online publication date: 1-May-2024
https://doi.org/10.1109/JIOT.2024.3353291
Ramadha AYovita LWibowo T(2024)Implementation of Centralized Routing based on Cost Metric Calculation in Named Data Networking2024 ASU International Conference in Emerging Technologies for Sustainability and Intelligent Systems (ICETSIS)10.1109/ICETSIS61505.2024.10459435(654-658)Online publication date: 28-Jan-2024
https://doi.org/10.1109/ICETSIS61505.2024.10459435
Mutlu FYeh E(2024)Cost-Aware Joint Caching and Forwarding in Networks with Heterogeneous Cache ResourcesICC 2024 - IEEE International Conference on Communications10.1109/ICC51166.2024.10623104(4736-4742)Online publication date: 9-Jun-2024
https://doi.org/10.1109/ICC51166.2024.10623104
Takemasa JKoizumi YHasegawa T(2024)Modeling and Evaluating a Cache System in ICN Routers Using a Programmable Switch and ComputersIEEE Access10.1109/ACCESS.2024.348458812(154426-154442)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3484588
Iordache CShannigrahi SWu YSong SMultu FBalcas JŠirvinskas RTimilsina SPesavento DNewman HZhang LYeh E(2024)A Named Data Networking Based Fast Open Storage System Plugin for XRootDEPJ Web of Conferences10.1051/epjconf/202429501004295(01004)Online publication date: 6-May-2024
https://doi.org/10.1051/epjconf/202429501004
Long XHuang KYang RDai QLi ZCalvert KHjálmtýsson GCrowley PPapadopoulos C(2023)Pegasus: A High-Speed NDN Router with Programmable Switches and Server ClustersProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623713(12-18)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3623565.3623713
Ooka AAsaeda HCalvert KHjálmtýsson GCrowley PPapadopoulos C(2023)CCNx Router on FPGA Accelerator Achieving Predictable PerformanceProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623710(1-11)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3623565.3623710
Timilsina SPesavento DShi JShannigrahi SBenmohamed LCalvert KHjálmtýsson GCrowley PPapadopoulos C(2023)Capture and Analysis of Traffic Traces on a Wide-Area NDN TestbedProceedings of the 10th ACM Conference on Information-Centric Networking10.1145/3623565.3623707(101-108)Online publication date: 9-Oct-2023
https://dl.acm.org/doi/10.1145/3623565.3623707
Wang XLi TQiu JDiao W(2023)High Performance Inter-satellite Routing Design of Terahertz Interface2023 4th International Conference on Electronic Communication and Artificial Intelligence (ICECAI)10.1109/ICECAI58670.2023.10176766(112-118)Online publication date: 12-May-2023
https://doi.org/10.1109/ICECAI58670.2023.10176766
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents