Abstract
Datacenters spend $10--25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively underprovision infrastructure assuming that simultaneous peak draw across all equipment will happen rarely. The resulting nonzero probability of emergency events where power needs exceed provisioned capacity, however small, mandates graceful reaction mechanisms to cap the power draw instead of leaving it to disruptive circuit breakers/fuses. Existing strategies for power capping use temporal knobs local to a server that throttle the rate of execution (using power modes), and/or spatial knobs that redirect/migrate excess load to regions of the datacenter with more power headroom. We show these mechanisms to have performance degrading ramifications, and propose an entirely orthogonal solution that leverages existing UPS batteries to temporarily augment the utility supply during emergencies. We build an experimental prototype to demonstrate such power capping on a cluster of 8 servers, each with an individual battery, and implement several online heuristics in the context of different datacenter workloads to evaluate their effectiveness in handling power emergencies. We show that our battery-based solution can: (i) handle emergencies of short durations on its own, (ii) supplement existing reaction mechanisms to enhance their efficacy for longer emergencies, and (iii) create more slack for shifting applications temporarily to nonpeak durations.
- Ahmad, F. and Vijaykumar, T. N. 2010. Joint optimization of idle and cooling power in data centers while maintaining response time. In Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS’10). ACM, New York, 243--256. Google Scholar
Digital Library
- Amur, H., Cipar, J., Gupta, V., Ganger, G. R., Kozuch, M., and Schwan, K. 2010. Robust and flexible power-proportional storage. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). ACM, New York, 217--228. Google Scholar
Digital Library
- Ardakanian, O., Rosenberg, C., and Keshav, S. 2012. On the impact of storage in residential power distribution systems. In Proceedings of the Greenmetrics Workshop.Google Scholar
- Bar-Noy, A., Feng, Y., Johnson, M. P., and Liu, O. 2008. When to reap and when to sow: Lowering peak usage With realistic batteries. In Proceedings of the Workshop on Experimental Algorithms (WEA). Google Scholar
Digital Library
- Barker, S., Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Albrecht, J. 2012. SmartCap: Flattening peak electricity demand in smart homes. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom).Google Scholar
- Barroso, L. A. and Holzle, U. 2007. The case for energy-proportional computing. J. Comput. 40, 12, 33--37. Google Scholar
Digital Library
- Barroso, L. A. and Holzle, U. 2009. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan and Claypool Publishers. Google Scholar
Digital Library
- Bhandarkar, D. Server design summit, 2010. Watt matters in energy efficiency. Keynote speech.Google Scholar
- Bhattacharya, A. A., Culler, D., Kansal, A., Govindan, S., and Sankar, S. 2012. The need for speed and stability in data center power capping. In Proceedings of the Green Computing Conference (IGCC). Google Scholar
Digital Library
- Chase, J., Anderson, D., Thakur, P., and Vahdat, A. 2001. Managing energy and server resources in hosting centers. In Proceedings of the Symposium on Operating Systems Principles (SOSP). Google Scholar
Digital Library
- Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., and Zhao, F. 2008. Energy-Aware server provisioning and load dispatching for connection-intensive internet services. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI). Google Scholar
Digital Library
- Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., and Gautam, N. 2005. Managing server energy and operational costs in hosting centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google Scholar
Digital Library
- Clark, C., Fraser, K., Hand, S., Hansen, J., Jul, E., Limpach, C., Pratt, I., and Warfield, A. 2005. Live migration of virtual machines. In Proceedings of the Symposium on Networked Systems Design and Implementation (NSDI). Google Scholar
Digital Library
- Commercial Circuit Breakers. 2008. Commercial Circuit Breakers. (2008). http://circuit-breakers.carlingtech.com/allcircuits.aspGoogle Scholar
- Deng, Q., Meisner, D., Ramos, L., Wenisch, T. F. and Bianchini, R. 2011. MemScale: Active lowpower modes for main memory. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google Scholar
Digital Library
- Facebook Server-level UPS batteries. 2009. Facebook Server-level UPS batteries. http://www.datacenterknowledge.com/archives/2009/11/27/facebook-follows-google-to-data-center-savings/Google Scholar
- Fan, X., Weber, W. -D., and Barroso, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- Felter, W., Rajamani, K., Rusu, C., and Keller, T. 2005. A Performance-Conserving approach for reducing peak power consumption in server systems. In Proceedings of the International Conference on Supercomputing (ICS). Google Scholar
Digital Library
- Femal, M. E. and Freeh, V. W. 2004. Safe overprovisioning: Using power limits to increase aggregate throughput. In Proceedings of the Workshop on Power-Aware Computer Systems (PACS). Google Scholar
Digital Library
- Flinn, J. and Satyanarayanan, M. 2004. Managing battery lifetime with energy-aware adaptation. Trans. Comput. Syst. 22, 2, 137--179. Google Scholar
Digital Library
- Gandhi, A., Harchol-Balter, M., Das, R., and Lefurgy, C. 2009. Optimal power allocation in server farms. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google Scholar
Digital Library
- Ganesh, L., Liu, J., Nath, S., Reeves, G., and Zhao, F. 2009. Unleash stranded power in data centers with rackpacker. In Proceedings of the Workshop on Energy-Effcient Design (WEED).Google Scholar
- Gast, N. G., Tomozei, D. -C., and Le Boudec, J. -Y. 2012. Optimal storage policies with wind forecast uncertainties. In Proceedings of the Greenmetrics Workshop.Google Scholar
Digital Library
- Goiri, I., Le, K., Nguyen, T. D., Guitart, J., Torres, J., Bianchini, R. D. 2012. GreenHadoop: Leveraging green energy in data-processing frameworks. In Proceedings of the ACM European Conference on Computer Systems (EUROSYS). Google Scholar
Digital Library
- Google Server-level UPS batteries. 2009. Google Server-level UPS batteries. http://news.cnet.com/8301-10013-10209580-92.htmlGoogle Scholar
- Govindan, S., Choi, J., Urgaonkar, B., Sivasubramaniam, B., and Baldini, A. 2009. Statistical profiling-based techniques for effective power provisioning in data centers. In Proceedings of the International European Conference on Computer Systems (EUROSYS). Google Scholar
Digital Library
- Govindan, S., Sivasubramaniam, A., and Urgaonkar, B. 2011a. Benefits and limitations of tapping into stored energy for datacenters. In Proceedings of the International Symposium of Computer Architecture (ISCA). Google Scholar
Digital Library
- Govindan, S., Wang, D., Chen, L., Sivasubramaniam, A., and Urgaonkar, B. 2011b. Towards realizing a low cost and highly available datacenter power infrastructure. In Proceedings of the Workshop on Power Aware Computing and Systems (HotPower). Google Scholar
Digital Library
- Hadoop Map Reduce. 2007. Hadoop map reduce. http://hadoop.apache.org/mapreduce/Google Scholar
- Hamilton, J. 2009. ISCA keynote 2009. Internet-Scale service infrastructure effciency. In Proceedings of the Annual International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- Kontorinis, V., Zhang, L. E., Aksanli, B., Sampson, J., Homayoun, H., Petis, E., Tullsen, D. M. and Rosing, T. S. 2012. Managing distributed UPS energy for effective power capping in data centers. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- Le, K., Bianchini, R., Martonosi, M., and Nguyen, T. 2009. Cost- and energy-aware load distribution across data centers. In Proceedings of the Workshop on Power-Aware Computing and Systems (HOTPOWER).Google Scholar
- Le, K., Bianchini, R., Nguyen, T. D., Bilgir, O., and Martonosi, M. 2010. Capping the brown energy consumption of Internet services at low cost. In Proceedings of the Green Computing Conference (IGCC). Google Scholar
Digital Library
- Lead-acid battery cost. 2010. Lead-acid battery cost. http://energy.sandia.gov/wp/wp-content/gallery/uploads/093669c.pdfGoogle Scholar
- Lefurgy, C., Wang, X., and Ware, M. 2007. Server-Level power control. In Proceedings of International Conference on Autonomic Computing (ICAC). Google Scholar
Digital Library
- Lim, H., Kansal, A., and Liu, J. 2011. Power budgeting for virtualized data centers. In Proceedings of the USENIX Conference on USENIX Annual Technical Conference. Google Scholar
Digital Library
- Lin, M., Wierman, A., Andrew, L. L. H., and Thereska, E. 2011. Dynamic right-sizing for power-proportional data centers. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM).Google Scholar
- Linden, D. and Reddy, T. B. 2002. Handbook of Batteries. McGraw Hill.Google Scholar
- Linux AVG Anti Virus. 2012. Linux AVG anti virus. http://free.avg.com/Google Scholar
- Ma, K., Li, X., Chen, M., and Wang, X. 2011. Scalable power control for many-core architectures running multithreaded applications. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- McCluer, S. 2005. APC white paper 30 (Revision 11): Battery technology for data centers and network rooms: Lead-Acid battery options. Whitepaper.Google Scholar
- Meisner, D., Sadler, C. M., Barroso, L. A., Weber, W., and Wenisch, T. F. 2011. Power management of online data-intensive services. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- Microsoft Rack-level UPS batteries. 2011. Microsoft Rack-level UPS batteries. http://www.datacenterknowledge.com/archives/2011/04/25/microsoft-reveals-its-speciality-servers-racks/Google Scholar
- Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Zhu, T. 2012. SmartCharge: Cutting the electricity bill in smart homes with energy storage. In Proceedings of the International Conference on Future Energy Systems: Where Energy, Computing and Communication Meet (e-Energy). Google Scholar
Digital Library
- Moore, J., Chase, J., Ranganathan P., and Sharma, R. 2005. Making scheduling cool: Temperature-Aware workload placement in data centers. In Proceedings of the Usenix Annual Technical Conference. Google Scholar
Digital Library
- Pelley, S., Meisner, D., Zandevakili, P., Wenisch, T. F. and Underwood, J. 2010. Power routing: Dynamic power provisioning in the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google Scholar
Digital Library
- Pinheiro, E., Bianchini, R., Carrera, E., and Heath, T. 2001. Load balancing and unbalancing for power and performance in cluster-based systems. In Proceedings of the Workshop on Compilers and Operating Systems for Low Power (COLP).Google Scholar
- Qureshi, A., Weber, R., Balakrishnan, H., Guttag, J., and Maggs, B. 2009. Cutting the electric bill for internet-scale systems. In Proceedings of the ACM SIGCOMM Conference on Data Communication (SIGCOMM). Google Scholar
Digital Library
- Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., and Zhu, X. 2008. No power struggles: Coordinated multi-level power management for the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google Scholar
Digital Library
- Ramos, L. and Bianchini, R. 2008. C-Oracle: Predictive thermal management for data centers. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).Google Scholar
- Ranganathan, P., Leech, P., Irwin, D., and Chase, J. 2006. Ensemble-Level power management for dense blade servers. In Proceedings of International Symposium on Computer Architecture (ISCA). Google Scholar
Digital Library
- Rao, L., Liu, X., and Liu, W. 2010a. Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricity-market environment. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOMM). Google Scholar
Digital Library
- Rao, L., Liu, X., Ilic, M., and Liu, J. 2010b. MEC-IDC: Joint load balancing and power control for distributed Internet data centers. In Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS). Google Scholar
Digital Library
- Ren, J., Wang, D., Urgaonkar, B., and Sivasubramaniam, A. 2012. Carbon-Aware energy capacity planning for datacenters. In Proceedings of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS). Google Scholar
Digital Library
- Sharma, N., Barker, S., Irwin, D., and Shenoy, P. 2011. Blink: Managing server clusters on intermittent power. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google Scholar
Digital Library
- Smith, B. C., Leimkuhler, J. F., and Darrow, R. M. 1992. Yield management at american airlines. Interfaces 22, 1, 8--31.Google Scholar
Digital Library
- Smith, W. 2000. TPC-W: Benchmarking an ecommerce solution. http://www.tpc.org/information/other/techarticles.asp.Google Scholar
- SPECjbb. 2005. SPEC JBB2005: Java business benchmark. http://www.spec.org/jbb2005/Google Scholar
- Urgaonkar, B., Shenoy, P., and Roscoe, T. 2002. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI). Google Scholar
Digital Library
- Urgaonkar, R., Urgaonkar, B., Neely, M. J., and Sivasubramaniam, A., 2011. Optimal power cost management using stored energy in data centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google Scholar
Digital Library
- Vasan, A., Sivasubramaniam, A., Shimpi, V., Sivabalan, T., and Subbiah, R. 2010. Worth their watts? - an empirical study of data center servers. In Proceedings of the International Symposium on High Performance Computer Architecture (HPCA).Google Scholar
- Ven, P., Hegde, N., Massoulie, L., and Salonidis, T. 2011. Optimal control of residential energy storage under price fluctuations. In Proceedings of the International Conference on Smart Grids, Green Communications and IT Energy-Aware Technologies.Google Scholar
- Verma, A., De, P., Mann, V., Nayak, T., Purohit, A., Dasgupta, G., and Kothari, R. 2010. BrownMap: Enforcing power budget in shared data centers. In Proceedings of the Conference on Middleware (MIDDLEWARE). Google Scholar
Digital Library
- Waldspurger, C. 2002. Memory resource management in VMWare ESX server. In Proceedings of the Symposium on Operating System Design and Implementation (OSDI). Google Scholar
Digital Library
- Wang, D., Ren, C., Sivasubramaniam, A., Urgaonkar, B., and Fathy, H. 2012. Energy storage in datacenters: What, where, and how much? In Proceedings of the ACM SIGMETRICS/PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google Scholar
Digital Library
- Wang, X. and Chen, M. 2008. Cluster-Level feedback power control for performance optimization. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).Google Scholar
- Wang, X., Chen, M., and Lefurgy, C. 2011. How much power oversubscription is safe and allowed in data centers? In Proceedings of the International Conference on Autonomic Computing (ICAC). Google Scholar
Digital Library
- Weisel, A. and Bellosa, F. 2002. Process cruise control-event-driven clock scaling for dynamic power management. In Proceedings of the International Conference on Compilers, Architecture and Synthesis for Embedded Systems (CASES). Google Scholar
Digital Library
- Zeng, H., Fan, X., Ellis, C., Lebeck, A., and Vahdat, A. 2002. ECOSystem: Managing energy as a first class operating system resource. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google Scholar
Digital Library
- Zhang, F., Shi, Z., and Wolf, W. 2009. A dynamic battery model for co-design in cyber-physical systems. In Proceedings of the International Conference on Distributed Computing Systems Workshops (ICDCSW). Google Scholar
Digital Library
- Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping diskarrays sleep through the winter. In Proceedings of the Symposium on Operating Systems Principles (SOSP). Google Scholar
Digital Library
Index Terms
Aggressive Datacenter Power Provisioning with Batteries
Recommendations
Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters
ASPLOS '12Datacenters spend $10-25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively under-...
Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters
ASPLOS '12Datacenters spend $10-25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively under-...
Leveraging stored energy for handling power emergencies in aggressively provisioned datacenters
ASPLOS XVII: Proceedings of the seventeenth international conference on Architectural Support for Programming Languages and Operating SystemsDatacenters spend $10-25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively under-...






Comments