skip to main content
research-article
Open Access

Metron: High-performance NFV Service Chaining Even in the Presence of Blackboxes

Published:08 July 2021Publication History
Skip Abstract Section

Abstract

Deployment of 100Gigabit Ethernet (GbE) links challenges the packet processing limits of commodity hardware used for Network Functions Virtualization (NFV). Moreover, realizing chained network functions (i.e., service chains) necessitates the use of multiple CPU cores, or even multiple servers, to process packets from such high speed links.

Our system Metron jointly exploits the underlying network and commodity servers’ resources: (i) to offload part of the packet processing logic to the network, (ii)  by using smart tagging to setup and exploit the affinity of traffic classes, and (iii)  by using tag-based hardware dispatching to carry out the remaining packet processing at the speed of the servers’ cores, with zero inter-core communication. Moreover, Metron transparently integrates, manages, and load balances proprietary “blackboxes” together with Metron service chains.

Metron realizes stateful network functions at the speed of 100GbE network cards on a single server, while elastically and rapidly adapting to changing workload volumes. Our experiments demonstrate that Metron service chains can coexist with heterogeneous blackboxes, while still leveraging Metron’s accurate dispatching and load balancing. In summary, Metron has (i)  2.75–8× better efficiency, up to (ii)  4.7× lower latency, and (iii)  7.8× higher throughput than OpenBox, a state-of-the-art NFV system.

References

  1. Mohammad Al-Fares, Alexander Loukissas, and Amin Vahdat. 2008. A scalable, commodity data center network architecture. In Proceedings of the ACM SIGCOMM Conference on Data Communication (SIGCOMM’08). ACM, New York, NY, 63–74. DOI:DOI:https://doi.org/10.1145/1402958.1402967Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Mohammad Al-Fares, Sivasankar Radhakrishnan, Barath Raghavan, Nelson Huang, and Amin Vahdat. 2010. Hedera: Dynamic flow scheduling for data center networks. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation (NSDI’10). USENIX Association, Berkeley, CA, 19–19. Retrieved from https://static.usenix.org/events/nsdi10/tech/full_papers/al-fares.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bilal Anwer, Theophilus Benson, Nick Feamster, and Dave Levin. 2015. Programming slick network functions. In Proceedings of the 1st ACM SIGCOMM Symposium on Software Defined Networking Research (SOSR’15). ACM, New York, NY. DOI:DOI:https://doi.org/10.1145/2774993.2774998Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Tom Barbette. 2018. Architecture for Programmable Network Infrastructure. Doctoral thesis. University of Liege, Faculty of Applied Sciences, Department of Electricity, Electronics and Informatics, Liege, Belgium. Retrieved from http://hdl.handle.net/2268/226257.Google ScholarGoogle Scholar
  5. Tom Barbette and Georgios P. Katsikas. 2018. Metron data plane. Retrieved from https://github.com/tbarbette/fastclick/tree/metron.Google ScholarGoogle Scholar
  6. Tom Barbette, Georgios P. Katsikas, Gerald Q. Maguire, Jr., and Dejan Kostić. 2019. RSS++: Load and state-aware receive side scaling. In Proceedings of the 15th International Conference on Emerging Networking Experiments and Technologies (CoNEXT’19). ACM, New York, NY, 318–333. DOI:DOI:https://doi.org/10.1145/3359989.3365412Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Tom Barbette, Cyril Soldani, Romain Gaillard, and Laurent Mathy. 2018. Building a chain of high-speed VNFs in no time. In Proceedings of the IEEE International Conference on High Performance Switching and Routing (HPSR’18). DOI:DOI:https://doi.org/10.1109/HPSR.2018.8850742Google ScholarGoogle Scholar
  8. Tom Barbette, Cyril Soldani, and Laurent Mathy. 2015. Fast userspace packet processing. In Proceedings of the 11th ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS’15). IEEE Computer Society, Washington, DC, 5–16. DOI:https://doi.org/10.1109/ANCS.2015.7110116Google ScholarGoogle ScholarCross RefCross Ref
  9. Pankaj Berde, Matteo Gerola, Jonathan Hart, Yuta Higuchi, Masayoshi Kobayashi, Toshio Koide, Bob Lantz, Brian O’Connor, Pavlin Radoslavov, William Snow, and Guru Parulkar. 2014. ONOS: Towards an open, distributed SDN OS. In Proceedings of the 3rd Workshop on Hot Topics in Software Defined Networking (HotSDN’14). ACM, New York, NY, 1–6. DOI:DOI:https://doi.org/10.1145/2620728.2620744Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Giuseppe Bianchi, Marco Bonola, Antonio Capone, and Carmelo Cascone. 2014. OpenState: Programming platform-independent stateful openflow applications inside the switch. SIGCOMM Comput. Commun. Rev. 44, 2 (Apr. 2014), 44–51. DOI:DOI:https://doi.org/10.1145/2602204.2602211Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Giuseppe Bianchi, Marco Bonola, Salvatore Pontarelli, Davide Sanvito, Antonio Capone, and Carmelo Cascone. 2016. Open packet processor: A programmable architecture for wire speed platform-independent stateful in-network processing. arXiv preprint arXiv:1605.01977 (2016).Google ScholarGoogle Scholar
  12. Martin Bjorklund. 2010. YANG - A Data Modeling Language for the Network Configuration Protocol (NETCONF). Internet Request for Comments (RFC) 6020 (Proposed Standard). DOI:DOI:https://doi.org/10.17487/RFC6020Google ScholarGoogle Scholar
  13. Boon Ang et al.2010. Single Root I/O Virtualization and Sharing Specification Revision 1.1. Retrieved from https://composter.com.ua/documents/sr-iov1_1_20Jan10_cb.pdf.Google ScholarGoogle Scholar
  14. Pat Bosshart, Dan Daly, Glen Gibb, Martin Izzard, Nick McKeown, Jennifer Rexford, Cole Schlesinger, Dan Talayco, Amin Vahdat, George Varghese, and David Walker. 2014. P4: Programming protocol-independent packet processors. SIGCOMM Comput. Commun. Rev. 44, 3 (July 2014), 87–95. DOI:DOI:https://doi.org/10.1145/2656877.2656890Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Pat Bosshart, Glen Gibb, Hun-Seok Kim, George Varghese, Nick McKeown, Martin Izzard, Fernando Mujica, and Mark Horowitz. 2013. Forwarding metamorphosis: Fast programmable match-action processing in hardware for SDN. SIGCOMM Comput. Commun. Rev. 43, 4 (Aug. 2013), 99–110. DOI:DOI:https://doi.org/10.1145/2534169.2486011Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Anat Bremler-Barr, Yotam Harchol, and David Hay. 2016. OpenBox: A software-defined framework for developing, deploying, and managing network functions. In Proceedings of the Conference on ACM SIGCOMM Conference (SIGCOMM’16). ACM, New York, NY, 511–524. DOI:DOI:https://doi.org/10.1145/2934872.2934875Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. Jeffrey Case, Mark Fedor, Martin Lee Schoffstall, and James Davin. 1990. Simple Network Management Protocol (SNMP). Internet Request for Comments (RFC) 1157. Retrieved from http://www.ietf.org/rfc/rfc1157.txt.Google ScholarGoogle Scholar
  18. Mosharaf Chowdhury, Muntasir Raihan Rahman, and Raouf Boutaba. 2012. ViNEYard: Virtual network embedding algorithms with coordinated node and link mapping. IEEE/ACM Trans. Netw. 20, 1 (Feb. 2012), 206–219. DOI:DOI:https://doi.org/10.1109/TNET.2011.2159308Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Cisco. 2013. Migrate to a 40-Gbps Data Center with Cisco QSFP BiDi Technology. Retrieved from http://www.cisco.com/c/en/us/products/collateral/switches/nexus-9000-series-switches/white-paper-c11-729493.html.Google ScholarGoogle Scholar
  20. Cisco. 2020. Cisco CSR 1000v and Cisco ISRv Software Configuration Guide. Retrieved from https://www.cisco.com/c/en/us/td/docs/routers/csr1000/software/configuration/b_CSR1000v_Configuration_Guide/b_CSR1000v_Configuration_Guide_chapter_010001.html.Google ScholarGoogle Scholar
  21. Thomas Dietz, Roberto Bifulco, Filipe Manco, João Martins, Hans-Joerg Kolbe, and Felipe Huici. 2015. Enhancing the BRAS through virtualization. In Proceedings of the 1st IEEE Conference on Network Softwarization. 1–5. DOI:DOI:https://doi.org/10.1109/NETSOFT.2015.7116144Google ScholarGoogle ScholarCross RefCross Ref
  22. Mihai Dobrescu, Norbert Egi, Katerina Argyraki, Byung-Gon Chun, Kevin Fall, Gianluca Iannaccone, Allan Knies, Maziar Manesh, and Sylvia Ratnasamy. 2009. RouteBricks: Exploiting parallelism to scale software routers. In Proceedings of the ACM SIGOPS 22nd Symposium on Operating Systems Principles (SOSP’09). ACM, New York, NY, 15–28. DOI:DOI:https://doi.org/10.1145/1629575.1629578Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Alex Eckert, Luis MartinGarcia, Reza Niazmand, and Xu Wang. 2016. Wedge 100: More open and versatile than ever. Retrieved from https://code.facebook.com/posts/1802489260027439/wedge-100-more-open-and-versatile-than-ever/.Google ScholarGoogle Scholar
  24. Rob Enns, Martin Bjorklund, Juergen Schoenwaelder, and Andy Bierman. 2011. Network Configuration Protocol (NETCONF). Internet Request for Comments (RFC) 6241 (Proposed Standard). DOI:DOI:https://doi.org/10.17487/RFC6241Google ScholarGoogle Scholar
  25. European Telecommunications Standards Institute. 2017. Network Functions Virtualisation. Retrieved from http://www.etsi.org/technologies-clusters/technologies/689-network-functions-virtualisation.Google ScholarGoogle Scholar
  26. European Telecommunications Standards Institute (ETSI). 2020. Open Source NFV Management and Orchestration (MANO). Retrieved from https://osm.etsi.org/.Google ScholarGoogle Scholar
  27. Daniel Firestone, Andrew Putnam, Sambhrama Mundkur, Derek Chiou, Alireza Dabagh, Mike Andrewartha, Hari Angepat, Vivek Bhanu, Adrian Caulfield, Eric Chung, Harish Kumar Chandrappa, Somesh Chaturmohta, Matt Humphrey, Jack Lavier, Norman Lam, Fengfen Liu, Kalin Ovtcharov, Jitu Padhye, Gautham Popuri, Shachar Raindel, Tejas Sapre, Mark Shaw, Gabriel Silva, Madhan Sivakumar, Nisheeth Srivastava, Anshuman Verma, Qasim Zuhair, Deepak Bansal, Doug Burger, K. Vaid, D. A. Maltz, and A. Greenberg. 2018. Azure accelerated networking: SmartNICs in the public cloud. In 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI’18). USENIX Association, Renton, WA, 51–66. Retrieved from https://www.usenix.org/system/files/conference/nsdi18/nsdi18-firestone.pdf.Google ScholarGoogle Scholar
  28. Aaron Gember-Jacobson, Raajay Viswanathan, Chaithan Prakash, Robert Grandl, Junaid Khalid, Sourav Das, and Aditya Akella. 2014. OpenNF: Enabling innovation in network function control. In Proceedings of the ACM Conference on SIGCOMM (SIGCOMM’14). ACM, New York, NY, 163–174. DOI:DOI:https://doi.org/10.1145/2619239.2626313Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Gilad Shainer, Network Computing. 2014. 100 Gbps Headed For The Data Center. Retrieved from https://www.networkcomputing.com/data-centers/100-gbps-headed-data-centers.Google ScholarGoogle Scholar
  30. Younghwan Go, Muhammad Asim Jamshed, YoungGyoun Moon, Changho Hwang, and KyoungSoo Park. 2017. APUNet: Revitalizing GPU as packet processing accelerator. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI’17). USENIX Association, 83–96. Retrieved from https://www.usenix.org/system/files/conference/nsdi17/nsdi17-go.pdf.Google ScholarGoogle Scholar
  31. Sangjin Han, Keon Jang, Aurojit Panda, Shoumik Palkar, Dongsu Han, and Sylvia Ratnasamy. 2015. SoftNIC: A Software NIC to Augment Hardware. Technical Report UCB/EECS-2015-155. EECS Department, University of California, Berkeley. Retrieved from http://www2.eecs.berkeley.edu/Pubs/TechRpts/2015/EECS-2015-155.html.Google ScholarGoogle Scholar
  32. Sangjin Han, Keon Jang, KyoungSoo Park, and Sue Moon. 2010. PacketShader: A GPU-accelerated software router. In Proceedings of the ACM SIGCOMM Conference (SIGCOMM’10). ACM, New York, NY, 195–206. DOI:DOI:https://doi.org/10.1145/1851182.1851207Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Jiayue He, Rui Zhang-Shen, Ying Li, Cheng-Yen Lee, Jennifer Rexford, and Mung Chiang. 2008. DaVinci: Dynamically adaptive virtual networks for a customized Internet. In Proceedings of the ACM CoNEXT Conference (CoNEXT’08). ACM, New York, NY. DOI:DOI:https://doi.org/10.1145/1544012.1544027Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Hewlett Packard. 2017. HPE FlexNetwork 5130 EI Switch Series. Retrieved from https://h20195.www2.hpe.com/v2/getpdf.aspx/c04394228.pdf.Google ScholarGoogle Scholar
  35. Jinho Hwang, K. K. Ramakrishnan, and Timothy Wood. 2014. NetVM: High performance and flexible networking using virtualization on commodity platforms. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation (NSDI’14). USENIX Association, Berkeley, CA, 445–458. Retrieved from https://www.usenix.org/system/files/conference/nsdi14/nsdi14-paper-hwang.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Intel. 2007. Improving Network Performance in Multi-Core Systems. Retrieved from http://www.intel.com/content/dam/support/us/en/documents/network/sb/318483001us2.pdf.Google ScholarGoogle Scholar
  37. Intel. 2014. Introduction to Intel® Ethernet Flow Director and Memcached Performance. Retrieved from https://www.intel.com/content/dam/www/public/us/en/documents/white-papers/intel-ethernet-flow-director.pdf.Google ScholarGoogle Scholar
  38. Intel. 2016. 82599 10 GbE Controller Datasheet. Retrieved from http://www.intel.com/content/www/us/en/embedded/products/networking/82599-10-gbe-controller-datasheet.html.Google ScholarGoogle Scholar
  39. Muhammad Jamshed, YoungGyoun Moon, Donghwi Kim, Dongsu Han, and KyoungSoo Park. 2017. mOS: A reusable networking stack for flow monitoring middleboxes. In Proceedings of the 14th USENIX Conference on Networked Systems Design and Implementation (NSDI’17). Berkeley, CA, 113–129. Retrieved from https://www.usenix.org/system/files/conference/nsdi17/nsdi17-jamshed.pdf.Google ScholarGoogle Scholar
  40. Muhammad Asim Jamshed, Jihyung Lee, Sangwoo Moon, Insu Yun, Deokjin Kim, Sungryoul Lee, Yung Yi, and KyoungSoo Park. 2012. Kargus: A highly-scalable software-based intrusion detection system. In Proceedings of the ACM Conference on Computer and Communications Security (CCS’12). DOI:DOI:https://doi.org/10.1145/2382196.2382232Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Murad Kablan, Azzam Alsudais, Eric Keller, and Franck Le. 2017. Stateless network functions: Breaking the tight coupling of state and processing. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI’17). 97–112. Retrieved from https://www.usenix.org/system/files/conference/nsdi17/nsdi17-kablan.pdf.Google ScholarGoogle Scholar
  42. Georgios P. Katsikas. 2016. Realizing High Performance NFV Service Chains. Licentiate thesis. KTH Royal Institute of Technology, School of Information and Communication Technology, Kista, Sweden. Retrieved from http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-195352.Google ScholarGoogle Scholar
  43. Georgios P. Katsikas. 2018. Metron controller’s southbound driver for managing commodity servers. Retrieved from https://github.com/gkatsikas/onos/tree/metron-driver/drivers/server.Google ScholarGoogle Scholar
  44. Georgios P. Katsikas. 2018. NFV Service Chains at the Speed of the Underlying Commodity Hardware. Doctoral thesis. KTH Royal Institute of Technology, School of Electrical Engineering and Computer Science, Kista, Sweden. Retrieved from http://urn.kb.se/resolve?urn=urn:nbn:se:kth:diva-233629.Google ScholarGoogle Scholar
  45. Georgios P. Katsikas and Tom Barbette. 2018. ONOS Server Device Driver Tutorial. Retrieved from https://wiki.onosproject.org/display/ONOS/Server+Device+Driver+Tutorial.Google ScholarGoogle Scholar
  46. Georgios P. Katsikas and Tom Barbette. 2020. Metron control plane as an ONOS application. Retrieved from https://github.com/gkatsikas/onos/tree/metron-ctrl/apps/metron.Google ScholarGoogle Scholar
  47. Georgios P. Katsikas, Tom Barbette, Marco Chiesa, Dejan Kostić, and Gerald Q. Maguire Jr.2021. What you need to know about (smart) network interface cards. In Passive and Active Measurement, Oliver Hohlfeld, Andra Lutu, and Dave Levin (Eds.). Springer International Publishing, 319–336. DOI:DOI:https://doi.org/10.1007/978-3-030-72582-2_19Google ScholarGoogle Scholar
  48. Georgios P. Katsikas, Tom Barbette, Dejan Kostić, Rebecca Steinert, and Gerald Q. Maguire Jr.2018. Metron: NFV service chains at the true speed of the underlying hardware. In 15th USENIX Conference on Networked Systems Design and Implementation (NSDI’18). USENIX Association, Renton, WA, 171–186. Retrieved from https://www.usenix.org/system/files/conference/nsdi18/nsdi18-katsikas.pdf.Google ScholarGoogle Scholar
  49. Georgios P. Katsikas, Marcel Enguehard, Maciej Kuźniar, Gerald Q. Maguire Jr., and Dejan Kostić. 2016. SNF: Synthesizing high performance NFV service chains. PeerJ Comput. Sci. 2 (Nov. 2016), e98. DOI:DOI:https://doi.org/10.7717/peerj-cs.98Google ScholarGoogle Scholar
  50. Georgios P. Katsikas, Gerald Q. Maguire Jr., and Dejan Kostić. 2017. Profiling and accelerating commodity NFV service chains with SCC. J. Syst. Softw. 127C (Feb. 2017), 12–27. DOI:DOI:https://doi.org/10.1016/j.jss.2017.01.005Google ScholarGoogle ScholarDigital LibraryDigital Library
  51. Naga Katta, Mukesh Hira, Changhoon Kim, Anirudh Sivaraman, and Jennifer Rexford. 2016. HULA: Scalable load balancing using programmable data planes. In Proceedings of the Symposium on SDN Research (SOSR’16). ACM, New York, NY. DOI:DOI:https://doi.org/10.1145/2890955.2890968Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Antoine Kaufmann, Simon Peter, Naveen Kr. Sharma, Thomas Anderson, and Arvind Krishnamurthy. 2016. High performance packet processing with FlexNIC. In Proceedings of the 21st International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’16). ACM, New York, NY, 67–81. DOI:DOI:https://doi.org/10.1145/2872362.2872367Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Junaid Khalid, Aaron Gember-Jacobson, Roney Michael, Anubhavnidhi Abhashkumar, and Aditya Akella. 2016. Paving the way for NFV: Simplifying middlebox modifications using StateAlyzr. In Proceedings of the 13th USENIX Conference on Networked Systems Design and Implementation (NSDI’16). USENIX Association, 239–253. Retrieved from https://www.usenix.org/system/files/conference/nsdi16/nsdi16-paper-khalid.pdf..Google ScholarGoogle Scholar
  54. Daehyeok Kim, Amirsaman Memaripour, Anirudh Badam, Yibo Zhu, Hongqiang Harry Liu, Jitu Padhye, Shachar Raindel, Steven Swanson, Vyas Sekar, and Srinivasan Seshan. 2018. Hyperloop: Group-based NIC-offloading to accelerate replicated transactions in multi-tenant storage systems. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’18). ACM, New York, NY, 297–312. DOI:DOI:https://doi.org/10.1145/3230543.3230572Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Joongi Kim, Seonggu Huh, Keon Jang, KyoungSoo Park, and Sue Moon. 2012. The power of batching in the click modular router. In Proceedings of the Asia-Pacific Workshop on Systems (APSYS’12). ACM, New York, NY. DOI:DOI:https://doi.org/10.1145/2349896.2349910Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Joongi Kim, Keon Jang, Keunhong Lee, Sangwook Ma, Junhyun Shim, and Sue Moon. 2015. NBA (network balancing act): A high-performance packet processing framework for heterogeneous processors. In Proceedings of the 10th European Conference on Computer Systems (EuroSys’15). ACM, New York, NY. DOI:DOI:https://doi.org/10.1145/2741948.2741969Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. John F. Kim. 2016. Mellanox Blog: 25 Is the New 10, 50 Is the new 40, 100 Is the New Amazing. Retrieved from http://www.mellanox.com/blog/2016/03/25-is-the-new-10-50-is-the-new-40-100-is-the-new-amazing/.Google ScholarGoogle Scholar
  58. Eddie Kohler, Robert Morris, Benjie Chen, John Jannotti, and M. Frans Kaashoek. 2000. The click modular router. ACM Trans. Comput. Syst. 18, 3 (Aug. 2000), 263–297. DOI:DOI:https://doi.org/10.1145/354871.354874Google ScholarGoogle ScholarDigital LibraryDigital Library
  59. Ram Krishnan, Muhammad Durrani, and Peter Phaal. 2014. Real-time SDN and NFV Analytics for DDoS Mitigation. Retrieved from https://blog.sflow.com/2014/02/nfd7-real-time-sdn-and-nfv-analytics_1986.html.Google ScholarGoogle Scholar
  60. Sameer G. Kulkarni, Wei Zhang, Jinho Hwang, Shriram Rajagopalan, K. K. Ramakrishnan, Timothy Wood, Mayutan Arumaithurai, and Xiaoming Fu. 2017. NFVnice: Dynamic backpressure and scheduling for NFV service chains. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’17). ACM, New York, NY, 71–84. DOI:DOI:https://doi.org/10.1145/3098822.3098828Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Maciej Kuźniar, Peter Perešíni, and Dejan Kostić. 2015. What you need to know about SDN flow tables. In Passive and Active Measurement (PAM) (Lecture Notes in Computer Science), Vol. 8995. 347–359. DOI:DOI:https://doi.org/10.1007/978-3-319-15509-8_26Google ScholarGoogle ScholarCross RefCross Ref
  62. Maciej Kuźniar, Peter Perešíni, Dejan Kostić, and Marco Canini. 2018. Methodology, measurement and analysis of flow table update characteristics in hardware OpenFlow switches. Comput. Netw. 26 (2018). DOI:DOI:https://doi.org/10.1016/j.comnet.2018.02.014Google ScholarGoogle Scholar
  63. Bojie Li, Kun Tan, Layong (Larry) Luo, Yanqing Peng, Renqian Luo, Ningyi Xu, Yongqiang Xiong, Peng Cheng, and Enhong Chen. 2016. ClickNP: Highly flexible and high performance network processing with reconfigurable hardware. In Proceedings of the ACM SIGCOMM Conference (SIGCOMM’16). ACM, 1–14. DOI:DOI:https://doi.org/10.1145/2934872.2934897Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Xiaozhou Li, Raghav Sethi, Michael Kaminsky, David G. Andersen, and Michael J. Freedman. 2016. Be fast, cheap and in control with SwitchKV. In Proceedings of the 13th USENIX Conference on Networked Systems Design and Implementation (NSDI’16). USENIX Association, Berkeley, CA, 31–44. Retrieved from https://www.usenix.org/system/files/conference/nsdi16/nsdi16-paper-li_xiaozhou-update.pdf.Google ScholarGoogle Scholar
  65. Guyue Liu, Yuxin Ren, Mykola Yurchenko, K. K. Ramakrishnan, and Timothy Wood. 2018. Microboxes: High performance NFV with customizable, asynchronous TCP stacks and dynamic subscriptions. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’18). ACM, New York, NY, 504–517. DOI:DOI:https://doi.org/10.1145/3230543.3230563Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Joao Martins, Mohamed Ahmed, Costin Raiciu, Vladimir Olteanu, Michio Honda, Roberto Bifulco, and Felipe Huici. 2014. ClickOS and the art of network function virtualization. In Proceedings of the 11th USENIX Conference on Networked Systems Design and Implementation (NSDI’14). USENIX Association, Berkeley, CA, 459–473. Retrieved from https://www.usenix.org/system/files/conference/nsdi14/nsdi14-paper-martins.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library
  67. Nick McKeown, Tom Anderson, Hari Balakrishnan, Guru Parulkar, Larry Peterson, Jennifer Rexford, Scott Shenker, and Jonathan Turner. 2008. OpenFlow: Enabling innovation in campus networks. SIGCOMM Comput. Commun. Rev. 38, 2 (Mar. 2008), 69–74. DOI:DOI:https://doi.org/10.1145/1355734.1355746Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Mellanox. 2017. Mellanox ASAP2: Accelerated Switching and Packet Processing. Retrieved from https://www.mellanox.com/related-docs/products/SB_asap2.pdf.Google ScholarGoogle Scholar
  69. Mellanox. 2017. Mellanox NIC’s Performance Report with DPDK 17.05. Retrieved from https://fast.dpdk.org/doc/perf/DPDK_17_05_Mellanox_NIC_performance_report.pdf.Google ScholarGoogle Scholar
  70. Mellanox. 2018. ConnectX®-4 EN Card 100Gb/s Ethernet Adapter Card. Retrieved from http://www.mellanox.com/related-docs/prod_adapter_cards/PB_ConnectX-4_EN_Card.pdf.Google ScholarGoogle Scholar
  71. Mellanox. 2019. BlueField-2® SmartNIC for InfiniBand 8 Ethernet. Retrieved from https://www.mellanox.com/related-docs/prod_adapter_cards/PB_BlueField-2_SmartNIC_VPI.pdf.Google ScholarGoogle Scholar
  72. Mellanox. 2019. BlueField® SmartNIC for Ethernet. Retrieved from https://www.mellanox.com/related-docs/prod_adapter_cards/PB_BlueField_Smart_NIC.pdf.Google ScholarGoogle Scholar
  73. Mellanox. 2019. ConnectX®-5 EN Card 100Gb/s Ethernet Adapter Card. Retrieved from http://www.mellanox.com/related-docs/prod_adapter_cards/PB_ConnectX-5_EN_Card.pdf.Google ScholarGoogle Scholar
  74. Mellanox. 2019. ConnectX®-6 EN IC 200GbE Ethernet Adapter IC. Retrieved from https://www.mellanox.com/related-docs/prod_silicon/PB_ConnectX-6_EN_IC.pdf.Google ScholarGoogle Scholar
  75. Rui Miao, Hongyi Zeng, Changhoon Kim, Jeongkeun Lee, and Minlan Yu. 2017. SilkRoad: Making stateful layer-4 load balancing fast and cheap using switching ASICs. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’17). ACM, New York, NY, 15–28. DOI:DOI:https://doi.org/10.1145/3098822.3098824Google ScholarGoogle ScholarDigital LibraryDigital Library
  76. Michael Mitzenmacher. 2001. The power of two choices in randomized load balancing. IEEE Trans. Parallel Distrib. Syst. 12, 10 (Oct. 2001), 1094–1104. DOI:DOI:https://doi.org/10.1109/71.963420Google ScholarGoogle ScholarDigital LibraryDigital Library
  77. Netcope Technologies. 2020. Netcope P4 Cloud: Online P4 to FPGA synthesis and in-hardware evaluation. Retrieved from https://www.netcope.com/en/products/netcopep4.Google ScholarGoogle Scholar
  78. Netronome. 2018. Agilio LX 1x100GbE SmartNIC. Retrieved from https://www.netronome.com/m/documents/PB_Agilio_Lx_1x100GbE-7-20.pdf.Google ScholarGoogle Scholar
  79. Netronome. 2020. Agilio CX SmartNICs. Retrieved from https://www.netronome.com/products/agilio-cx/. Retrieved from https://www.netronome.com/products/agilio-cx/.Google ScholarGoogle Scholar
  80. Netronome. 2020. Agilio FX SmartNICs. Retrieved from https://www.netronome.com/products/agilio-fx/.Google ScholarGoogle Scholar
  81. NoviFlow. 2013. NoviSwitch 1132 High Performance OpenFlow Switch. Retrieved from https://noviflow.com/wp-content/uploads/NoviSwitch-1132-Datasheet-V2_1.pdf.Google ScholarGoogle Scholar
  82. Vladimir Andrei Olteanu and Costin Raiciu. 2012. Efficiently migrating stateful middleboxes. In Proceedings of the ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM’12). ACM, 93–94. DOI:DOI:https://doi.org/10.1145/2342356.2342376Google ScholarGoogle ScholarDigital LibraryDigital Library
  83. Diego Ongaro and John Ousterhout. 2014. In search of an understandable consensus algorithm. In Proceedings of the USENIX Conference on USENIX Technical Conference (USENIX ATC’14). USENIX Association, Berkeley, CA, 305–320. Retrieved from https://www.usenix.org/system/files/conference/atc14/atc14-paper-ongaro.pdf.Google ScholarGoogle Scholar
  84. Open Networking Foundation (ONF). 2020. Central Office Re-architected as a Datacenter (CORD). Retrieved from https://www.opennetworking.org/cord/.Google ScholarGoogle Scholar
  85. Open Networking Foundation (ONF). 2020. Open Network Operating System (ONOS). Retrieved from http://onosproject.org/.Google ScholarGoogle Scholar
  86. Open Networking Foundation (ONF). 2020. P4 brigade. Retrieved from https://wiki.onosproject.org/display/ONOS/P4+brigade.Google ScholarGoogle Scholar
  87. Open Networking Foundation (ONF). 2020. Stratum. Retrieved from https://www.opennetworking.org/stratum/.Google ScholarGoogle Scholar
  88. Open vSwitch. [n.d.]. An Open Virtual Switch. Retrieved from http://openvswitch.org.Google ScholarGoogle Scholar
  89. OpenStack. 2020. Open Source Cloud Computing Software. Retrieved from https://www.openstack.org/.Google ScholarGoogle Scholar
  90. Shoumik Palkar, Chang Lan, Sangjin Han, Keon Jang, Aurojit Panda, Sylvia Ratnasamy, Luigi Rizzo, and Scott Shenker. 2015. E2: A framework for NFV applications. In Proceedings of the 25th Symposium on Operating Systems Principles (SOSP’15). ACM, New York, NY, 121–136. DOI:DOI:https://doi.org/10.1145/2815400.2815423Google ScholarGoogle ScholarDigital LibraryDigital Library
  91. Aleksey Pesterev, Nickolai Zeldovich, and Robert T. Morris. 2010. Locating cache performance bottlenecks using data profiling. In Proceedings of the 5th European Conference on Computer Systems (EuroSys’10). ACM, New York, NY, 335–348. DOI:DOI:https://doi.org/10.1145/1755913.1755947Google ScholarGoogle Scholar
  92. Ben Pfaff, Justin Pettit, Teemu Koponen, Ethan J. Jackson, Andy Zhou, Jarno Rajahalme, Jesse Gross, Alex Wang, Jonathan Stringer, Pravin Shelar, Keith Amidon, and Martín Casado. 2015. The design and implementation of open vSwitch. In Proceedings of the 12th USENIX Conference on Networked Systems Design and Implementation (NSDI’15). USENIX Association, Berkeley, CA, 117–130. Retrieved from https://www.usenix.org/system/files/conference/nsdi15/nsdi15-paper-pfaff.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library
  93. Daniel Raumer, Sebastian Gallenmüller, Paul Emmerich, Lukas Märdian, Florian Wohlfart, and Georg Carle. 2016. Efficient serving of VPN endpoints on COTS server hardware. In Proceedings of the IEEE 5th International Conference on Cloud Networking (CloudNet’16). Retrieved from https://ieeexplore.ieee.org/document/7776595.Google ScholarGoogle ScholarCross RefCross Ref
  94. Ron Renwick. 2017. Increase Application Performance with SmartNICs. Retrieved from https://www.openstack.org/assets/presentation-media/Netronome-OpenStack-Summit-Marketplace-presentation.pdf.Google ScholarGoogle Scholar
  95. Clayne B. Robison. 2017. How to Set Up Intel Ethernet Flow Director. Retrieved from https://software.intel.com/en-us/articles/setting-up-intel-ethernet-flow-director.Google ScholarGoogle Scholar
  96. Eric C. Rosen, Arun Viswanathan, and Ross Callon. 2001. Multiprotocol Label Switching Architecture. Internet Request for Comments (RFC) 3031. DOI:DOI:https://doi.org/10.17487/RFC3031Google ScholarGoogle Scholar
  97. Katharine Schmidtke. 2017. Facebook: Designing 100G optical connections. Retrieved from https://code.facebook.com/posts/1633153936991442/designing-100g-optical-connections/.Google ScholarGoogle Scholar
  98. Vyas Sekar, Norbert Egi, Sylvia Ratnasamy, Michael K. Reiter, and Guangyu Shi. 2012. Design and implementation of a consolidated middlebox architecture. In Proceedings of the 9th USENIX Conference on Networked Systems Design and Implementation (NSDI’12). USENIX Association, Berkeley, CA, 24–24. Retrieved from https://www.usenix.org/system/files/conference/nsdi12/nsdi12-final96.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library
  99. Snort. 2020. Network Intrusion Detection 8 Prevention System. Retrieved from https://www.snort.org/.Google ScholarGoogle Scholar
  100. Chen Sun, Jun Bi, Zhilong Zheng, Heng Yu, and Hongxin Hu. 2017. NFP: Enabling network function parallelism in NFV. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’17). ACM, New York, NY, 43–56. DOI:DOI:https://doi.org/10.1145/3098822.3098826Google ScholarGoogle ScholarDigital LibraryDigital Library
  101. Weibin Sun and Robert Ricci. 2013. Fast and flexible: Parallel packet processing with GPUs and click. In Proceedings of the 9th ACM/IEEE Symposium on Architectures for Networking and Communications Systems (ANCS’13). IEEE Press, Piscataway, NJ, 25–36. Retrieved from http://dl.acm.org/citation.cfm?id=2537857.2537861.Google ScholarGoogle ScholarCross RefCross Ref
  102. David E. Taylor and Jonathan S. Turner. 2007. ClassBench: A packet classification benchmark. IEEE/ACM Trans. Netw. 15, 3 (June 2007), 499–511. DOI:DOI:https://doi.org/10.1109/TNET.2007.893156Google ScholarGoogle ScholarDigital LibraryDigital Library
  103. The Linux Foundation. 2021. Data Plane Development Kit (DPDK). Retrieved from http://dpdk.org.Google ScholarGoogle Scholar
  104. The Linux Foundation. 2020. DPDK Generic flow API. Retrieved from https://doc.dpdk.org/guides/prog_guide/rte_flow.html.Google ScholarGoogle Scholar
  105. The Linux Foundation. 2020. DPDK MLX5 poll mode driver. Retrieved from https://doc.dpdk.org/guides/nics/mlx5.html.Google ScholarGoogle Scholar
  106. The Linux Foundation. 2020. DPDK’s Flow Performance Tool. Retrieved from https://doc.dpdk.org/guides/tools/flow-perf.html.Google ScholarGoogle Scholar
  107. The Linux Foundation. 2020. Kubernetes. Retrieved from https://kubernetes.io/.Google ScholarGoogle Scholar
  108. The Linux Foundation. 2020. Open Platform for NFV (OPNFV). Retrieved from https://www.opnfv.org/.Google ScholarGoogle Scholar
  109. Aliso Viejo. 2015. QLogic and Broadcom First to Demonstrate End-to-End Interoperability for 25Gb and 100Gb Ethernet. Retrieved from https://globenewswire.com/news-release/2015/01/27/700249/10116850/en/QLogic-and-Broadcom-First-to-Demonstrate-End-to-End-Interoperability-for-25Gb-and-100Gb-Ethernet.html.Google ScholarGoogle Scholar
  110. Shinae Woo, Justine Sherry, Sangjin Han, Sue Moon, Sylvia Ratnasamy, and Scott Shenker. 2018. Elastic scaling of stateful network functions. In Proceedings of the 15th USENIX Symposium on Networked Systems Design and Implementation (NSDI’18). USENIX Association, Renton, WA, 299–312. Retrieved from https://www.usenix.org/system/files/conference/nsdi18/nsdi18-woo.pdf.Google ScholarGoogle Scholar
  111. Dingming Wu, Ang Chen, T. S. Eugene Ng, Guohui Wang, and Haiyong Wang. 2019. Accelerated service chaining on a single switch ASIC. In Proceedings of the 18th ACM Workshop on Hot Topics in Networks (HotNets’19). ACM, New York, NY, 141–149. DOI:DOI:https://doi.org/10.1145/3365609.3365849Google ScholarGoogle ScholarDigital LibraryDigital Library
  112. Minlan Yu, Yung Yi, Jennifer Rexford, and Mung Chiang. 2008. Rethinking virtual network embedding: Substrate support for path splitting and migration. SIGCOMM Comput. Commun. Rev. 38, 2 (Mar. 2008), 17–29. DOI:DOI:https://doi.org/10.1145/1355734.1355737Google ScholarGoogle ScholarDigital LibraryDigital Library
  113. Pamela Zave, Ronaldo A. Ferreira, Xuan Kelvin Zou, Masaharu Morimoto, and Jennifer Rexford. 2017. Dynamic service chaining with Dysco. In Proceedings of the Conference of the ACM Special Interest Group on Data Communication (SIGCOMM’17). ACM, New York, NY, 57–70. DOI:DOI:https://doi.org/10.1145/3098822.3098827Google ScholarGoogle ScholarDigital LibraryDigital Library
  114. Wei Zhang, Jinho Hwang, Shriram Rajagopalan, K. K. Ramakrishnan, and Timothy Wood. 2016. Flurries: Countless fine-grained NFs for flexible per-flow customization. In Proceedings of the 12th ACM International Conference on Emerging Networking Experiments and Technologies (CoNEXT’16). ACM, New York, NY, 3–17. DOI:DOI:https://doi.org/10.1145/2999572.2999602Google ScholarGoogle ScholarDigital LibraryDigital Library
  115. Wei Zhang, Guyue Liu, Wenhui Zhang, Neel Shah, Phillip Lopreiato, Gregoire Todeschi, K. K. Ramakrishnan, and Timothy Wood. 2016. OpenNetVM: A platform for high performance network service chains. In Proceedings of the ACM SIGCOMM Workshop on Hot Topics in Middleboxes and Network Function Virtualization. ACM. Retrieved from http://faculty.cs.gwu.edu/ timwood/papers/16-HotMiddlebox-onvm.pdf.Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Metron: High-performance NFV Service Chaining Even in the Presence of Blackboxes

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader

        HTML Format

        View this article in HTML Format .

        View HTML Format
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!