skip to main content
10.1145/3484266.3487394acmconferencesArticle/Chapter ViewAbstractPublication PagescommConference Proceedingsconference-collections
research-article
Open access

Redesigning Data Centers for Renewable Energy

Published: 04 November 2021 Publication History

Abstract

Renewable energy is becoming an important power source for data centers, especially with the zero-carbon waste pledges made by big cloud providers. However, one of the main challenges of renewable energy sources is the high variability of power produced. Traditional approaches such as batteries or transmitting to the grid fall short on scale, overhead, or "green-ness". We propose Virtual Battery: instead of adapting the availability of power to match the computation demand we shift computational demand to meet the availability of power. Virtual batteries shift demand by requiring applications to either be flexible and delay-tolerant or proactively migrating to where power is (going to be) available. We show that using multiple virtual battery sites in combination can meet the needs of modern applications. Moreover, we show how an intelligent network and power aware co-scheduler can not only provide availability despite variability but also help mitigate migration related network overhead by over 30% in total and 4.2x at peak.

References

[1]
2021. Pricing - Windows Virtual Machines | Microsoft Azure. https://azure.microsoft.com/en-us/pricing/details/virtual-machines/windows. (2021). [Online; accessed 23. Jun. 2021].
[2]
Sherif Akoush, Ripduman Sohan, Andrew Rice, Andrew W Moore, and Andy Hopper. 2010. Predicting the performance of virtual machine migration. In 2010 IEEE international symposium on modeling, analysis and simulation of computer and telecommunication systems. IEEE, 37--46.
[3]
Sherif Akoush, Ripduman Sohan, Andrew Rice, Andrew W. Moore, and Andy Hopper. 2011. Free Lunch: Exploiting Renewable Energy for Computing. In 13th Workshop on Hot Topics in Operating Systems (HotOS XIII). USENIX Association, Napa, CA. https://www.usenix.org/conference/hotosxiii/free-lunch- exploiting- renewable- energy- computing
[4]
Aleasoft. 2020. Negative prices in some European markets during the first weekend of July due to the wind energy. https://rb.gy/krt5jr. (2020).
[5]
Amazon. 2020. Spot Instances. https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/using-spot-instances.html. (2020).
[6]
Pradeep Ambati, Íñigo Goiri, Felipe Frujeri, Alper Gun, Ke Wang, Brian Dolan, Brian Corell, Sekhar Pasupuleti, Thomas Moscibroda, Sameh Elnikety, et al. 2020. Providing SLOs for Resource-Harvesting VMs in Cloud Platforms. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI '20). 735--751.
[7]
Amazon AWS. 2020. Burstable performance instances. https://docs.aws.amazon.com/AWSEC2/latest/UserGuide/burstable-performance-instances.html. (2020).
[8]
Microsoft Azure. 2017. Introducing B-Series, our new burstable VM size. https://azure.microsoft.com/en-us/blog/introducing-b-series-our-new-burstable-vm-size/. (2017).
[9]
Shahab Bahrami, Vincent WS Wong, and Jianwei Huang. 2018. Data center demand response in deregulated electricity markets. IEEE Transactions on Smart Grid 10, 3 (2018), 2820--2832.
[10]
Josep Ll Berral, Íñigo Goiri, Ramón Nou, Ferran Julià, Jordi Guitart, Ricard Gavaldà, and Jordi Torres. 2010. Towards energy-aware scheduling in data centers using machine learning. In Proceedings of the 1st International Conference on energy-Efficient Computing and Networking. 215--224.
[11]
Aditya Bhaskara, Moses Charikar, Eden Chlamtac, Uriel Feige, and Aravindan Vijayaraghavan. 2010. Detecting high log-densities: an O (n 1/4) approximation for densest k-subgraph. In Proceedings of the forty-second ACM symposium on Theory of computing. 201--210.
[12]
University of Michigan Center for Sustainable Systems. 2020. US Grid Energy Storage Factsheet. http://css.umich.edu/factsheets/us-grid-energy-storage-factsheet. (2020).
[13]
Angelos Chatzipapas, Dimosthenis Pediaditakis, Charalampos Rotsos, Vincenzo Mancuso, Jon Crowcroft, and Andrew Moore. 2015. Challenge: Resolving data center power bill disputes: The energyperformance trade-offs of consolidation. In Proceedings of the 2015 ACM Sixth International Conference on Future Energy Systems. 89--94.
[14]
Hao Chen, Michael C Caramanis, and Ayse K Coskun. 2014. The data center as a grid load stabilizer. In 2014 19th Asia and South Pacific Design Automation Conference (ASP-DAC). IEEE, 105--112.
[15]
Andrew A. Chien, Richard Wolski, and Fan Yang. 2015. The Zero-Carbon Cloud: High-Value, Dispatchable Demand for Renewable Power Generators. The Electricity Journal 28, 8 (2015), 110--118. https://doi.org/10.1016/j.tej.2015.09.010
[16]
Asaf Cidon, Robert Escriva, Sachin Katti, Mendel Rosenblum, and Emin Gun Sirer. 2015. Tiered replication: A cost-effective alternative to full cluster geo-replication. In 2015 USENIX Annual Technical Conference (ATC'15). 31--43.
[17]
CleanEnergyWire. 2021. More renewables curbed to stabilise German power grid - report. https://www.cleanenergywire.org/news/more-renewables-curbed-stabilise-german-power-grid-report. (2021).
[18]
Contributors to Wikimedia projects. 2021. List of onshore wind farms - Wikipedia. https://en.wikipedia.org/wiki/List_of_onshore_wind_farms. (2021). [Online; accessed 23. Jun. 2021].
[19]
Brendan Cully, Geoffrey Lefebvre, Dutch Meyer, Mike Feeley, Norm Hutchinson, and Andrew Warfield. 2008. Remus: High availability via asynchronous virtual machine replication. In Proceedings of the 5th USENIX symposium on networked systems design and implementation. San Francisco, 161--174.
[20]
Howard David, Chris Fallin, Eugene Gorbatov, Ulf R Hanebutte, and Onur Mutlu. 2011. Memory power management via dynamic voltage/frequency scaling. In Proceedings of the 8th ACM international conference on Autonomic computing. 31--40.
[21]
Howard David, Eugene Gorbatov, Ulf R Hanebutte, Rahul Khanna, and Christian Le. 2010. RAPL: Memory power estimation and capping. In 2010 ACM/IEEE International Symposium on Low-Power Electronics and Design (ISLPED).IEEE, 189--194.
[22]
Diego Didona, Kristina Spirovska, and Willy Zwaenepoel. 2017. Okapi: Causally consistent geo-replication made faster, cheaper and more available. arXiv preprint arXiv:1702.04263 (2017).
[23]
DownToEarth. 2020. Renewable energy: Curtailment is a bane. https://www.downtoearth.org.in/blog/energy/renewable-energy-curtailment-is-a-bane-68857. (2020).
[24]
Truong Vinh Truong Duy, Yukinori Sato, and Yasushi Inoguchi. 2010. Performance evaluation of a Green Scheduling Algorithm for energy savings in Cloud computing. In 2010 IEEE International Symposium on Parallel Distributed Processing, Workshops and Phd Forum (IPDPSW). 1--8. https://doi.org/10.1109/IPDPSW.2010.5470908
[25]
ELIA. 2021. Solar and Wind Generation. https://www.elia.be/en/grid-data/power-generation. (2021).
[26]
US Energy Information Administration. 2020. Electricity explained: Electricity generation, capacity, and sales in the United States. https://www.eia.gov/energyexplained/electricity/electricity-in-the-us-generation-capacity-and-sales.php. (2020).
[27]
Robert L Fares and Carey W King. 2017. Trends in transmission, distribution, and administration costs for US investor-owned electric utilities. Energy Policy 105 (2017), 354--362.
[28]
Iratxe Gonzalez Aparicio, Thomas Huld, Francesco Careri, Fabio Monforti, and Andreas Zucker. 2017. EMHIRES dataset Part II: Solar power generation. European Meteorological derived High resolution RES generation time series for present and future scenarios. Part II: PV generation using the PVGIS model (2017).
[29]
Google. 2020. Our data centers now work harder when the sun shines and wind blows. https://blog.google/inside-google/infrastructure/data-centers-work-harder-sun-shines-wind-blows. (2020).
[30]
Google. 2021. Cloud sustainability. https://cloud.google.com/sustainability. (2021).
[31]
Green Mountain Data Center. 2020. Data Center Power Costs. https://greenmountain.no/2020/07/01/data-center-power-costs/. (2020).
[32]
Ori Hadary, Luke Marshall, Ishai Menache, Abhisek Pan, Esaias E Greeff, David Dion, Star Dorminey, Shailesh Joshi, Yang Chen, Mark Russinovich, et al. 2020. Protean: {VM} Allocation Service at Scale. In 14th USENIX Symposium on Operating Systems Design and Implementation (OSDI '20). 845--861.
[33]
Aaron Harlap, Andrew Chung, Alexey Tumanov, Gregory R. Ganger, and Phillip B. Gibbons. 2018. Tributary: spot-dancing for elastic services with latency SLOs. In 2018 USENIX Annual Technical Conference (USENIX ATC 18). USENIX Association, Boston, MA, 1--14. https://www.usenix.org/conference/atc18/presentation/harlap
[34]
Brandon Heller, Srini Seetharaman, Priya Mahadevan, Yiannis Yiakoumis, Puneet Sharma, Sujata Banerjee, and Nick McKeown. 2010. ElasticTree: Saving Energy in Data Center Networks. In Proceedings of the 7th USENIX Conference on Networked Systems Design and Implementation (NSDI'10). USENIX Association, USA, 17.
[35]
Gonzalez Aparicio Iratxe, Andreas Zucker, Francesco Careri, Fabio Monforti, Thomas Huld, and Jake Badger. 2016. EMHIRES dataset Part I: Wind power generation. (2016).
[36]
JustEnergy. 2021. Renewable Energy vs. Traditional Energy: The Real Cost. https://justenergy.com/blog/renewable-energy-vs-traditional-energy-the-real-cost/. (2021).
[37]
Vasileios Kontorinis, Liuyi Eric Zhang, Baris Aksanli, Jack Sampson, Houman Homayoun, Eddie Pettis, Dean M Tullsen, and Tajana Simunic Rosing. 2012. Managing distributed ups energy for effective power capping in data centers. In 2012 39th Annual International Symposium on Computer Architecture (ISCA). IEEE, 488--499.
[38]
Alok Kumbhare, Reza Azimi, Ioannis Manousakis, Anand Bonde, Felipe Frujeri, Nithish Mahalingam, Pulkit Misra, Seyyed Ahmad Javadi, Bianca Schroeder, Marcus Fontoura, et al. 2020. Prediction-Based Power Oversubscription in Cloud Platforms. arXiv preprint arXiv:2010.15388 (2020).
[39]
Evangelos Kyritsis, Jonas Andersson, and Apostolos Serletis. 2017. Electricity prices, large-scale renewable integration, and policy implications. Energy Policy 101 (2017), 550--560.
[40]
Horacio Andrés Lagar-Cavilla, Joseph Andrew Whitney, Adin Matthew Scannell, Philip Patchin, Stephen M Rumble, Eyal De Lara, Michael Brudno, and Mahadev Satyanarayanan. 2009. Snowflock: rapid virtual machine cloning for cloud computing. In Proceedings of the 4th ACM European conference on Computer systems. 1--12.
[41]
Zhenhua Liu, Iris Liu, Steven Low, and Adam Wierman. 2014. Pricing data center demand response. ACM SIGMETRICS Performance Evaluation Review 42, 1 (2014), 111--123.
[42]
Zhenhua Liu, Adam Wierman, Yuan Chen, Benjamin Razon, and Niangjun Chen. 2013. Data center demand response: Avoiding the coincident peak via workload shifting and local generation. Performance Evaluation 70, 10 (2013), 770--791.
[43]
Microsoft. 2020. More renewables curbed to stabilise German power grid - report. https://azure.microsoft.com/en-us/blog/introducing-the-microsoft-azure-modular-datacenter/. (2020).
[44]
Microsoft. 2020. Use Azure Spot Virtual Machines. https://docs.microsoft.com/en-us/azure/virtual-machines/spot-vms. (2020).
[45]
Microsoft. 2021. Azure sustainability. https://azure.microsoft.com/en-in/global-infrastructure/sustainability/. (2021).
[46]
Jayashree Mohan, Amar Phanishayee, and Vijay Chidambaram. 2021. CheckFreq: Frequent, Fine-Grained DNN Checkpointing. In 19th USENIX Conference on File and Storage Technologies (FAST '21). 203--216.
[47]
Adam Moody, Greg Bronevetsky, Kathryn Mohror, and Bronis R De Supinski. 2010. Design, modeling, and evaluation of a scalable multi-level checkpointing system. In SC'10: Proceedings of the 2010 ACM/IEEE International Conference for High Performance Computing, Networking, Storage and Analysis. IEEE, 1--11.
[48]
Eric O'Shaughnessy, Jesse R Cruce, and Kaifeng Xu. 2020. Too much of a good thing? Global trends in the curtailment of solar PV. Solar Energy 208 (2020), 1068--1077.
[49]
The Shift project. 2019. Lean ICT - TOWARDS DIGITAL SOBRIETY. Technical Report.
[50]
Asfandyar Qureshi, Rick Weber, Hari Balakrishnan, John Guttag, and Bruce Maggs. 2009. Cutting the electric bill for internet-scale systems. In Proceedings of the ACM SIGCOMM 2009 conference on Data communication. 123--134.
[51]
Adam Ruprecht, Danny Jones, Dmitry Shiraev, Greg Harmon, Maya Spivak, Michael Krebs, Miche Baker-Harvey, and Tyler Sanderson. 2018. Vm live migration at scale. ACM SIGPLAN Notices 53, 3 (2018), 45--56.
[52]
Roy Schwartz, Jesse Dodge, Noah A. Smith, and Oren Etzioni. 2020. Green AI. Commun. ACM 63, 12 (Nov. 2020), 54--63. https://doi.org/10.1145/3381831
[53]
Prateek Sharma, Ahmed Ali-Eldin, and Prashant Shenoy. 2019. Resource deflation: A new approach for transient resource reclamation. In Proceedings of the Fourteenth EuroSys Conference 2019. 1--17.
[54]
Prateek Sharma, Stephen Lee, Tian Guo, David Irwin, and Prashant Shenoy. 2015. Spotcheck: Designing a derivative iaas cloud on the spot market. In Proceedings of the Tenth European Conference on Computer Systems. 1--15.
[55]
Supreeth Shastri and David Irwin. 2017. HotSpot: automated server hopping in cloud spot markets. In Proceedings of the 2017 Symposium on Cloud Computing. 493--505.
[56]
Rahul Singh, David Irwin, Prashant Shenoy, and Kadangode K Ramakrishnan. 2013. Yank: Enabling green data centers to pull the plug. In 10th USENIX Symposium on Networked Systems Design and Implementation (NSDI 13). 143--155.
[57]
Chandrasekar Subramanian, Arunchandar Vasan, and Anand Sivasubramaniam. 2010. Reducing data center power with server consolidation: Approximation and evaluation. In 2010 International Conference on High Performance Computing. IEEE, 1--10.
[58]
Supreeth Subramanya, Tian Guo, Prateek Sharma, David Irwin, and Prashant Shenoy. 2015. Spoton: a batch computing service for the spot market. In Proceedings of the sixth ACM symposium on cloud computing. 329--341.
[59]
Kavita Surana and Sarah Marie Jordaan. 2021. We calculated emissions due to electricity loss on the power grid - globally, it's a lot. (Oct 2021). https://rb.gy/fhqhma [Online; accessed 11. Oct. 2021].
[60]
The Climate Pledge. 2021. See which companies and organizations have committed to net zero carbon by 2040. https://www.theclimatepledge.com/us/en/Signatories. (2021).
[61]
The Wind Power. 2021. Wind farms databases. https://www.thewindpower.net/store_windfarms_view_all_en.php. (2021).
[62]
Abhishek Verma, Luis Pedrosa, Madhukar R. Korupolu, David Oppenheimer, Eric Tune, and John Wilkes. 2015. Large-scale cluster management at Google with Borg. In Proceedings of the European Conference on Computer Systems (EuroSys). Bordeaux, France.
[63]
Gregor Von Laszewski, Lizhe Wang, Andrew J Younge, and Xi He. 2009. Power-aware scheduling of virtual machines in dvfs-enabled clusters. In 2009 IEEE International Conference on Cluster Computing and Workshops. IEEE, 1--10.
[64]
Cheng Wang, Bhuvan Urgaonkar, Qian Wang, George Kesidis, and Anand Sivasubramaniam. 2013. Data center power cost optimization via workload modulation. In 2013 IEEE/ACM 6th International Conference on Utility and Cloud Computing. IEEE, 260--263.
[65]
Wiki Solar. 2021. Deployment of utility-scale solar power by continent. https://wiki-solar.org/region/continents/. (2021).
[66]
Chia-Ming Wu, Ruay-Shiung Chang, and Hsin-Yu Chan. 2014. A green energy-efficient scheduling algorithm using the DVFS technique for cloud datacenters. Future Generation Computer Systems 37 (2014), 141--147.
[67]
Chi yao Hong, Subhasree Mandal, Mohammad A. Alfares, Min Zhu, Rich Alimi, Kondapa Naidu Bollineni, Chandan Bhagat, Sourabh Jain, Jay Kaimal, Jeffrey Liang, Kirill Mendelev, Steve Padgett, Faro Thomas Rabe, Saikat Ray, Malveeka Tewari, Matt Tierney, Monika Zahn, Jon Zolla, Joon Ong, and Amin Vahdat. 2018. B4 and After: Managing Hierarchy, Partitioning, and Asymmetry for Availability and Scale in Google's Software-Defined WAN. In SIGCOMM'18. https://conferences.sigcomm.org/sigcomm/2018/program_tuesday.html
[68]
Chaojie Zhang, Alok Kumbhare, Ioannis Manousakis, Deli Zhang, Pulkit Misra, Rod Assis, Kyle Woolcock, Nithish Mahalingam, Brijesh Warrier, David Gauthier, Lalu Kunnath, Steve Solomon, Osvaldo Morales, Marcus Fontoura, and Ricardo Bianchini. 2021. Flex: High-Availability Datacenters With Zero Reserved Power. In Proceedings of the International Symposium on Computer Architecture (ISCA'21).

Cited By

View all
  • (2024)Realizing the Carbon-Aware Service Provision in ICT SystemIEEE Transactions on Network and Service Management10.1109/TNSM.2024.338548421:4(4090-4103)Online publication date: Aug-2024
  • (2024)Data Center-Enabled High Altitude Platforms: A Green Computing AlternativeIEEE Transactions on Mobile Computing10.1109/TMC.2023.331620423:5(6149-6162)Online publication date: May-2024
  • (2024)When Green Computing Meets Performance and Resilience SLOs2024 54th Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S)10.1109/DSN-S60304.2024.00015(17-22)Online publication date: 24-Jun-2024
  • Show More Cited By

Recommendations

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences
HotNets '21: Proceedings of the 20th ACM Workshop on Hot Topics in Networks
November 2021
246 pages
ISBN:9781450390873
DOI:10.1145/3484266
Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 04 November 2021

Permissions

Request permissions for this article.

Check for updates

Qualifiers

  • Research-article
  • Research
  • Refereed limited

Conference

HotNets '21
Sponsor:
HotNets '21: The 20th ACM Workshop on Hot Topics in Networks
November 10 - 12, 2021
Virtual Event, United Kingdom

Acceptance Rates

Overall Acceptance Rate 110 of 460 submissions, 24%

Contributors

Other Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

  • Downloads (Last 12 months)540
  • Downloads (Last 6 weeks)73
Reflects downloads up to 10 Nov 2024

Other Metrics

Citations

Cited By

View all
  • (2024)Realizing the Carbon-Aware Service Provision in ICT SystemIEEE Transactions on Network and Service Management10.1109/TNSM.2024.338548421:4(4090-4103)Online publication date: Aug-2024
  • (2024)Data Center-Enabled High Altitude Platforms: A Green Computing AlternativeIEEE Transactions on Mobile Computing10.1109/TMC.2023.331620423:5(6149-6162)Online publication date: May-2024
  • (2024)When Green Computing Meets Performance and Resilience SLOs2024 54th Annual IEEE/IFIP International Conference on Dependable Systems and Networks - Supplemental Volume (DSN-S)10.1109/DSN-S60304.2024.00015(17-22)Online publication date: 24-Jun-2024
  • (2024)Energy efficient task scheduling based on deep reinforcement learning in cloud environmentFuture Generation Computer Systems10.1016/j.future.2023.10.002151:C(214-231)Online publication date: 27-Feb-2024
  • (2023)Sustainable Computing - Without the Hot AirACM SIGEnergy Energy Informatics Review10.1145/3630614.36306233:3(47-52)Online publication date: 25-Oct-2023
  • (2023)Toward Carbon-Aware NetworkingACM SIGEnergy Energy Informatics Review10.1145/3630614.36306183:3(15-20)Online publication date: 25-Oct-2023
  • (2023)Educating the Future Engineer Towards Realizing the Powering of the Future Internet2023 31st Southern African Universities Power Engineering Conference (SAUPEC)10.1109/SAUPEC57889.2023.10057695(1-6)Online publication date: 24-Jan-2023
  • (2023)Workload Shifting Based on Low Carbon Intensity Periods: A Framework for Reducing Carbon Emissions in Cloud Computing2023 IEEE International Conference on Big Data (BigData)10.1109/BigData59044.2023.10386447(3387-3395)Online publication date: 15-Dec-2023
  • (2022)Dynamic Remote Networking for Modular Data Centres2022 International Conference on Artificial Intelligence, Big Data, Computing and Data Communication Systems (icABCD)10.1109/icABCD54961.2022.9856131(1-6)Online publication date: 4-Aug-2022

View Options

View options

PDF

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader

Get Access

Login options

Media

Figures

Other

Tables

Share

Share

Share this Publication link

Share on social media