research-article

Cost-effective capacity provisioning in wide area networks with Shoofly

Authors:

Nikolaj Bjorner,

Jamie GaudetteAuthors Info & Claims

SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference

Pages 534 - 546

https://doi.org/10.1145/3452296.3472895

Published: 09 August 2021 Publication History

Abstract

In this work we propose Shoofly, a network design tool that minimizes hardware costs of provisioning long-haul capacity by optically bypassing network hops where conversion of signals from optical to electrical domain is unnecessary and uneconomical. Shoofly leverages optical signal quality and traffic demand telemetry from a large commercial cloud provider to identify optical bypasses in the cloud WAN that reduce the hardware cost of long-haul capacity by 40%. A key challenge is that optical bypasses cause signals to travel longer distances on fiber before re-generation, potentially reducing link capacities and resilience to optical link failures. Despite these challenges, Shoofly provisions bypass-enabled topologies that meet 8X the present-day demands using existing network hardware. Even under aggressive stochastic and deterministic link failure scenarios, these topologies save 32% of the cost of long-haul capacity.

Supplementary Material

jin-public-review (67-public-review.pdf)

Cost-Effective Capacity Provisioning in Wide Area Networks with Shoofly: Public Review

Download
68.47 KB

MP4 File (video-presentation.mp4)

Conference Presentation Video

Download
40.19 MB

MOV File (video-long.mov)

Long Version Video

Download
77.37 MB

References

[1]

Ravindra K Ahuja, Thomas L Magnanti, and James B Orlin. 1993. Network Flows: Theory, Algorithms, and Applications. Prentice hall.

[2]

Srivatsan Balasubramanian, Satyajeet Ahuja, Gaya Nagarajan, Andrea Celletti, and Frantisek Foston. 2017. Multilayer planning for facebook scale worldwide network. In 2017 International Conference on Optical Network Design and Modeling (ONDM). IEEE, 1--6.

[3]

Ajay Kumar Bangla, Alireza Ghaffarkhah, Ben Preskill, Bikash Koley, Christoph Albrecht, Emilie Danna, Joe Jiang, and Xiaoxue Zhao. 2015. Capacity planning for the Google backbone network. (2015).

[4]

M. Birk, G. Choudhury, B. Cortez, A. Goddard, N. Padi, A. Raghuram, K. Tse, S. Tse, A. Wallace, and K. Xi. 2016. Evolving to an SDN-enabled isp backbone: key technologies and applications. IEEE Communications Magazine (2016).

Digital Library

[5]

Jeremy Bogle, Nikhil Bhatia, Manya Ghobadi, Ishai Menache, Nikolaj Bjørner, Asaf Valadarsky, and Michael Schapira. 2019. TEAVAR: striking the right utilization-availability balance in WAN traffic engineering. In Proceedings of the ACM Special Interest Group on Data Communication, SIGCOMM 2019, Beijing, China, August 19-23, 2019. ACM.

Digital Library

[6]

A. Brzezinski and E. Modiano. 2005. Dynamic reconfiguration and routing algorithms for IP-over-WDM networks with stochastic traffic. Journal of Lightwave Technology 23, 10 (2005), 3188--3205.

[7]

Yiyang Chang, Chuan Jiang, Ashish Chandra, Sanjay G. Rao, and Mohit Tawarmalani. 2020. Lancet: Better network resilience by designing for pruned failure sets. In Abstracts of the 2020 SIGMETRICS/Performance Joint International Conference on Measurement and Modeling of Computer Systems, Boston, MA, USA, June, 8-12, 2020, Edmund Yeh, Athina Markopoulou, and Y. C. Tay (Eds.). ACM, 53--54.

Digital Library

[8]

Yiyang Chang, Sanjay G. Rao, and Mohit Tawarmalani. 2017. Robust Validation of Network Designs under Uncertain Demands and Failures. In 14th USENIX Symposium on Networked Systems Design and Implementation, NSDI 2017, Boston, MA, USA, March 27-29, 2017, Aditya Akella and Jon Howell (Eds.). USENIX Association. https://www.usenix.org/conference/nsdi17/technical-sessions/presentation/chang

[9]

Angela L Chiu, Gagan Choudhury, George Clapp, Robert Doverspike, Mark Feuer, Joel W Gannett, Janet Jackel, Gi Tae Kim, John G Klincewicz, Taek Jin Kwon, et al. 2011. Architectures and protocols for capacity efficient, highly dynamic and highly resilient core networks. IEEE/OSA Journal of Optical Communications and Networking (2011).

[10]

Cisco. (Accessed on 2021-01-20). What is MPLS - Multiprotocol Label Switching. https://www.cisco.com/c/en/us/products/ios-nx-os-software/multiprotocol-label-switching-mpls/index.html. ((Accessed on 2021-01-20)).

[11]

Vojislav Dukic, Ginni Khanna, Christos Gkantsidis, Thomas Karagiannis, Francesca Parmigiani, Ankit Singla, Mark Filer, Jeffrey L. Cox, Anna Ptasznik, Nick Harland, Winston Saunders, and Christian Belady. 2020. Beyond the Mega-Data Center: Networking Multi-Data Center Regions. In Proceedings of the Annual Conference of the ACM Special Interest Group on Data Communication on the Applications, Technologies, Architectures, and Protocols for Computer Communication (SIGCOMM '20). Association for Computing Machinery, New York, NY, USA, 765--781.

Digital Library

[12]

Mark Filer, Jamie Gaudette, Yawei Yin, Denizcan Billor, Zahra Bakhtiari, and Jeffrey L. Cox. 2019. Low-margin optical networking at cloud scale [Invited]. J. Opt. Commun. Netw. 11, 10 (Oct 2019), C94--C108.

[13]

Klaus-Tycho Förster, Ratul Mahajan, and Roger Wattenhofer. 2016. Consistent updates in software defined networks: On dependencies, loop freedom, and blackholes. In 2016 IFIP Networking Conference, Networking 2016 and Workshops Vienna, Austria. IEEE Computer Society.

[14]

Monia Ghobadi, Jamie Gaudette, Ratul Mahajan, Amar Phanishayee, Buddy Klinkers, and Daniel Kilper. 2016. Evaluation of Elastic Modulation Gains in Microsoft's Optical Backbone in North America. Optical Fiber Communication Conference (2016), M2J.2.

[15]

Monia Ghobadi and Ratul Mahajan. 2016. Optical layer failures in a large backbone. In Proceedings of the 2016 Internet Measurement Conference. 461--467.

Digital Library

[16]

Jennifer Gossels, Gagan Choudhury, and Jennifer Rexford. 2019. Robust network design for IP/optical backbones. IEEE/OSA Journal of Optical Communications and Networking 11, 8 (2019), 478--490.

[17]

Gurobi. (Accessed on 2019-10-02). GUROBI Optimization. https://www.gurobi.com/. ((Accessed on 2019-10-02)).

[18]

Chi-Yao Hong, Srikanth Kandula, Ratul Mahajan, Ming Zhang, Vijay Gill, Mohan Nanduri, and Roger Wattenhofer. 2013. Achieving High Utilization with Software-driven WAN. SIGCOMM (2013), 12.

[19]

Infinera. (Accessed on 2021-01-10). Optical Line Systems. https://www.infinera.com/optical-line-systems. ((Accessed on 2021-01-10)).

[20]

Sushant Jain, Alok Kumar, Subhasree Mandal, Joon Ong, Leon Poutievski, Arjun Singh, Subbaiah Venkata, Jim Wanderer, Junlan Zhou, Min Zhu, Jon Zolla, Urs Hölzle, Stephen Stuart, and Amin Vahdat. 2013. B4: Experience with a Globally-deployed Software Defined Wan. SIGCOMM (2013), 12.

Digital Library

[21]

Xin Jin, Yiran Li, Da Wei, Siming Li, Jie Gao, Lei Xu, Guangzhi Li, Wei Xu, and Jennifer Rexford. 2016. Optimizing bulk transfers with software-defined optical WAN. In Proceedings of the 2016 ACM SIGCOMM Conference. 87--100.

Digital Library

[22]

Juniper Network. (Accessed on 2021-01-10). Shared Risk Link Groups for MPLS. https://www.juniper.net/documentation/en_US/junos/topics/topic-map/srlg-for-mpls.html. ((Accessed on 2021-01-10)).

[23]

Praveen Kumar, Yang Yuan, Chris Yu, Nate Foster, Robert Kleinberg, Petr Lapukhov, Chiun Lin Lim, and Robert Soulé. 2018. Semi-oblivious traffic engineering: The road not taken. In 15th {USENIX} Symposium on Networked Systems Design and Implementation ({NSDI} 18).

Digital Library

[24]

Wenxin Li, Xiaobo Zhou, Keqiu Li, Heng Qi, and Deke Guo. 2018. Trafficshaper: shaping inter-datacenter traffic to reduce the transmission cost. IEEE/ACM Transactions on Networking 26, 3 (2018), 1193--1206.

Digital Library

[25]

Hongqiang Harry Liu, Srikanth Kandula, Ratul Mahajan, Ming Zhang, and David Gelernter. 2014. Traffic engineering with forward fault correction. In ACM SIGCOMM 2014 Conference, SIGCOMM'14, Chicago, IL, USA, August 17-22, 2014, Fabián E. Bustamante, Y. Charlie Hu, Arvind Krishnamurthy, and Sylvia Ratnasamy (Eds.). ACM, 527--538.

Digital Library

[26]

Hongqiang Harry Liu and Jian Li. (Accessed on 2020-12-19). O(n) improve. ((Accessed on 2020-12-19)).

[27]

P. Papanikolaou, K. Christodoulopoulos, and E. Varvarigos. 2017. Joint multi-layer survivability techniques for IP-over-elastic-optical- networks. IEEE/OSA Journal of Optical Communications and Networking 9, 1 (2017), A85--A98.

[28]

P. Papanikolaou, K. Christodoulopoulos, and E. Varvarigos. 2018. Optimization techniques for incremental planning of multilayer elastic optical networks. IEEE/OSA Journal of Optical Communications and Networking 10, 3 (2018), 183--194.

[29]

Rachee Singh, Sharad Agarwal, Matt Calder, and Paramvir Bahl. 2021. Cost-effective Cloud Edge Traffic Engineering with Cascara. In 18th USENIX Symposium on Networked Systems Design and Implementation (NSDI 21). USENIX Association, 201--216. https://www.usenix.org/conference/nsdi21/presentation/singh

[30]

Rachee Singh, Monia Ghobadi, Klaus-Tycho Foerster, Mark Filer, and Phillipa Gill. 2017. Run, Walk, Crawl: Towards Dynamic Link Capacities. In Proceedings of the 16th ACM Workshop on Hot Topics in Networks (HotNets-XVI). Association for Computing Machinery, New York, NY, USA, 143--149.

Digital Library

[31]

Rachee Singh, Manya Ghobadi, Klaus-Tycho Foerster, Mark Filer, and Phillipa Gill. 2018. RADWAN: Rate Adaptive Wide Area Network. ACM SIGCOMM. https://www.microsoft.com/en-us/research/publication/radwan-rate-adaptive-wide-area-network/

[32]

TeleGeography. (Accessed on 2020-01-20). Wavelengths Pricing Data. https://www2.telegeography.com/wavelengths-pricing-data. ((Accessed on 2020-01-20)).

[33]

Asaf Valadarsky, Michael Schapira, Dafna Shahaf, and Aviv Tamar. 2017. Learning to route. In Proceedings of the 16th ACM workshop on hot topics in networks. 185--191.

Digital Library

[34]

Danyang Zhuo, Monia Ghobadi, Ratul Mahajan, Amar Phanishayee, Xuan Kelvin Zou, Hang Guan, Arvind Krishnamurthy, and Thomas Anderson. 2017. RAIL: A Case for Redundant Arrays of Inexpensive Links in Data Center Networks. In 14th USENIX Symposium on Networked Systems Design and Implementation (NSDI 17). USENIX Association.

Cited By

Nance-Hall MLiu ZSekar VDurairajan R(2025)Analyzing the Benefits of Optical Topology Programming for Mitigating Link-Flood DDoS AttacksIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2024.339118822:1(146-163)Online publication date: Jan-2025
https://doi.org/10.1109/TDSC.2024.3391188
Wang JZhao GXu HQiao CHuang H(2025)A cost-efficient traffic engineering framework with various pricing schemes in cloudsComputer Networks10.1016/j.comnet.2025.111090259(111090)Online publication date: Mar-2025
https://doi.org/10.1016/j.comnet.2025.111090
Namyar PArzani BBeckett RSegarra SRaj HKrishnaswamy UGovindan RKandula SVanbever LZhang I(2024)Finding adversarial inputs for heuristics using multi-level optimizationProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691877(927-949)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691877
Show More Cited By

Index Terms

Cost-effective capacity provisioning in wide area networks with Shoofly
1. Networks

Recommendations

Benefits of optical bypass in WDM networks with hybrid optical-and-electronic switching node architecture
AINTEC '09: Proceedings of the 4th Asian Internet Engineering Conference

In a traditional WDM network, all traffic needs to be terminated at switching nodes and is switched electronically, e.g., by DXC, IP router, ATM switch, and SONET/SDH switch. With the emergence of the all-optical switching technology, traffic switching ...
Cost-effective single-hub WDM ring networks: A proposal and analysis

In this paper, we study a new concept of traffic grooming in wavelength-division multiplexing (WDM) ring networks that aims at eliminating both the bandwidth underutilization and the scalability concerns that are typical of all-optical wavelength routed ...
Design and analysis of optical wdm metropolitan and wide-area networks

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGCOMM '21: Proceedings of the 2021 ACM SIGCOMM 2021 Conference

August 2021

868 pages

ISBN:9781450383837

DOI:10.1145/3452296

General Chairs:
Fernando Kuipers
Delft University of Technology
,
Matthew Caesar
University of Illinois at Urbana-Champaign

Copyright © 2021 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than the author(s) must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected].

Sponsors

SIGCOMM: ACM Special Interest Group on Data Communication

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 09 August 2021

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Research-article

Conference

SIGCOMM '21

Sponsor:

SIGCOMM

SIGCOMM '21: ACM SIGCOMM 2021 Conference

August 23 - 27, 2021

Virtual Event, USA

Acceptance Rates

Overall Acceptance Rate 462 of 3,389 submissions, 14%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

12
Total Citations
View Citations
857
Total Downloads

Downloads (Last 12 months)62
Downloads (Last 6 weeks)6

Reflects downloads up to 12 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

Nance-Hall MLiu ZSekar VDurairajan R(2025)Analyzing the Benefits of Optical Topology Programming for Mitigating Link-Flood DDoS AttacksIEEE Transactions on Dependable and Secure Computing10.1109/TDSC.2024.339118822:1(146-163)Online publication date: Jan-2025
https://doi.org/10.1109/TDSC.2024.3391188
Wang JZhao GXu HQiao CHuang H(2025)A cost-efficient traffic engineering framework with various pricing schemes in cloudsComputer Networks10.1016/j.comnet.2025.111090259(111090)Online publication date: Mar-2025
https://doi.org/10.1016/j.comnet.2025.111090
Namyar PArzani BBeckett RSegarra SRaj HKrishnaswamy UGovindan RKandula SVanbever LZhang I(2024)Finding adversarial inputs for heuristics using multi-level optimizationProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691877(927-949)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691877
Kumar AOwens BBjørner NGuan BYin YBahl PSingh RVanbever LZhang I(2024)CHISELProceedings of the 21st USENIX Symposium on Networked Systems Design and Implementation10.5555/3691825.3691873(859-875)Online publication date: 16-Apr-2024
https://dl.acm.org/doi/10.5555/3691825.3691873
Kumar ADevraj ABunandar DSingh R(2024)A case for server-scale photonic connectivityProceedings of the 23rd ACM Workshop on Hot Topics in Networks10.1145/3696348.3696856(290-299)Online publication date: 18-Nov-2024
https://dl.acm.org/doi/10.1145/3696348.3696856
Nance-Hall MBarford PFoerster KDurairajan R(2024)Improving Scalability in Traffic Engineering via Optical Topology ProgrammingIEEE Transactions on Network and Service Management10.1109/TNSM.2023.333589821:2(1581-1600)Online publication date: Apr-2024
https://doi.org/10.1109/TNSM.2023.3335898
Zhao PYou JYuan X(2024)Circling Reduction Algorithm for Cloud Edge Traffic Allocation Under the 95th Percentile BillingIEEE/ACM Transactions on Networking10.1109/TNET.2024.341564932:5(4254-4269)Online publication date: Oct-2024
https://doi.org/10.1109/TNET.2024.3415649
Yu XLv QLi RWu MZhang YZhu Z(2024)Network Expansion of Regional DCIs: Optical Circuit Switching Versus Electrical Packet SwitchingJournal of Lightwave Technology10.1109/JLT.2024.341992642:20(7044-7055)Online publication date: 15-Oct-2024
https://doi.org/10.1109/JLT.2024.3419926
Wu BQian KLi BMa YZhang QJiang ZZhao JCai DZhai ELiu XJin XSchulzrinne HKohler EMaltz DMisra V(2023)XRON: A Hybrid Elastic Cloud Overlay Network for Video Conferencing at Planetary ScaleProceedings of the ACM SIGCOMM 2023 Conference10.1145/3603269.3604845(696-709)Online publication date: Sep-2023
https://doi.org/10.1145/3603269.3604845
Poutievski LMashayekhi OOng JSingh ATariq MWang RZhang JBeauregard VConner PGribble SKapoor RKratzer SLi NLiu HNagaraj KOrnstein JSawhney SUrata RVicisano LYasumura KZhang SZhou JVahdat AKuipers FOrda A(2022)Jupiter evolvingProceedings of the ACM SIGCOMM 2022 Conference10.1145/3544216.3544265(66-85)Online publication date: 22-Aug-2022
https://dl.acm.org/doi/10.1145/3544216.3544265
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Figures

Tables

Media

View Table of Conten