skip to main content
research-article

Aggressive Datacenter Power Provisioning with Batteries

Published:01 February 2013Publication History
Skip Abstract Section

Abstract

Datacenters spend $10--25 per watt in provisioning their power infrastructure, regardless of the watts actually consumed. Since peak power needs arise rarely, provisioning power infrastructure for them can be expensive. One can, thus, aggressively underprovision infrastructure assuming that simultaneous peak draw across all equipment will happen rarely. The resulting nonzero probability of emergency events where power needs exceed provisioned capacity, however small, mandates graceful reaction mechanisms to cap the power draw instead of leaving it to disruptive circuit breakers/fuses. Existing strategies for power capping use temporal knobs local to a server that throttle the rate of execution (using power modes), and/or spatial knobs that redirect/migrate excess load to regions of the datacenter with more power headroom. We show these mechanisms to have performance degrading ramifications, and propose an entirely orthogonal solution that leverages existing UPS batteries to temporarily augment the utility supply during emergencies. We build an experimental prototype to demonstrate such power capping on a cluster of 8 servers, each with an individual battery, and implement several online heuristics in the context of different datacenter workloads to evaluate their effectiveness in handling power emergencies. We show that our battery-based solution can: (i) handle emergencies of short durations on its own, (ii) supplement existing reaction mechanisms to enhance their efficacy for longer emergencies, and (iii) create more slack for shifting applications temporarily to nonpeak durations.

References

  1. Ahmad, F. and Vijaykumar, T. N. 2010. Joint optimization of idle and cooling power in data centers while maintaining response time. In Proceedings of the 15th Edition of ASPLOS on Architectural Support for Programming Languages and Operating Systems (ASPLOS’10). ACM, New York, 243--256. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Amur, H., Cipar, J., Gupta, V., Ganger, G. R., Kozuch, M., and Schwan, K. 2010. Robust and flexible power-proportional storage. In Proceedings of the 1st ACM Symposium on Cloud Computing (SoCC’10). ACM, New York, 217--228. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Ardakanian, O., Rosenberg, C., and Keshav, S. 2012. On the impact of storage in residential power distribution systems. In Proceedings of the Greenmetrics Workshop.Google ScholarGoogle Scholar
  4. Bar-Noy, A., Feng, Y., Johnson, M. P., and Liu, O. 2008. When to reap and when to sow: Lowering peak usage With realistic batteries. In Proceedings of the Workshop on Experimental Algorithms (WEA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Barker, S., Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Albrecht, J. 2012. SmartCap: Flattening peak electricity demand in smart homes. In Proceedings of the IEEE International Conference on Pervasive Computing and Communications (PerCom).Google ScholarGoogle Scholar
  6. Barroso, L. A. and Holzle, U. 2007. The case for energy-proportional computing. J. Comput. 40, 12, 33--37. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Barroso, L. A. and Holzle, U. 2009. The Datacenter as a Computer: An Introduction to the Design of Warehouse-Scale Machines. Morgan and Claypool Publishers. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Bhandarkar, D. Server design summit, 2010. Watt matters in energy efficiency. Keynote speech.Google ScholarGoogle Scholar
  9. Bhattacharya, A. A., Culler, D., Kansal, A., Govindan, S., and Sankar, S. 2012. The need for speed and stability in data center power capping. In Proceedings of the Green Computing Conference (IGCC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Chase, J., Anderson, D., Thakur, P., and Vahdat, A. 2001. Managing energy and server resources in hosting centers. In Proceedings of the Symposium on Operating Systems Principles (SOSP). Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Chen, G., He, W., Liu, J., Nath, S., Rigas, L., Xiao, L., and Zhao, F. 2008. Energy-Aware server provisioning and load dispatching for connection-intensive internet services. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation (NSDI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Chen, Y., Das, A., Qin, W., Sivasubramaniam, A., Wang, Q., and Gautam, N. 2005. Managing server energy and operational costs in hosting centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Clark, C., Fraser, K., Hand, S., Hansen, J., Jul, E., Limpach, C., Pratt, I., and Warfield, A. 2005. Live migration of virtual machines. In Proceedings of the Symposium on Networked Systems Design and Implementation (NSDI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Commercial Circuit Breakers. 2008. Commercial Circuit Breakers. (2008). http://circuit-breakers.carlingtech.com/allcircuits.aspGoogle ScholarGoogle Scholar
  15. Deng, Q., Meisner, D., Ramos, L., Wenisch, T. F. and Bianchini, R. 2011. MemScale: Active lowpower modes for main memory. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Facebook Server-level UPS batteries. 2009. Facebook Server-level UPS batteries. http://www.datacenterknowledge.com/archives/2009/11/27/facebook-follows-google-to-data-center-savings/Google ScholarGoogle Scholar
  17. Fan, X., Weber, W. -D., and Barroso, L. A. 2007. Power provisioning for a warehouse-sized computer. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Felter, W., Rajamani, K., Rusu, C., and Keller, T. 2005. A Performance-Conserving approach for reducing peak power consumption in server systems. In Proceedings of the International Conference on Supercomputing (ICS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Femal, M. E. and Freeh, V. W. 2004. Safe overprovisioning: Using power limits to increase aggregate throughput. In Proceedings of the Workshop on Power-Aware Computer Systems (PACS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Flinn, J. and Satyanarayanan, M. 2004. Managing battery lifetime with energy-aware adaptation. Trans. Comput. Syst. 22, 2, 137--179. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Gandhi, A., Harchol-Balter, M., Das, R., and Lefurgy, C. 2009. Optimal power allocation in server farms. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Ganesh, L., Liu, J., Nath, S., Reeves, G., and Zhao, F. 2009. Unleash stranded power in data centers with rackpacker. In Proceedings of the Workshop on Energy-Effcient Design (WEED).Google ScholarGoogle Scholar
  23. Gast, N. G., Tomozei, D. -C., and Le Boudec, J. -Y. 2012. Optimal storage policies with wind forecast uncertainties. In Proceedings of the Greenmetrics Workshop.Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Goiri, I., Le, K., Nguyen, T. D., Guitart, J., Torres, J., Bianchini, R. D. 2012. GreenHadoop: Leveraging green energy in data-processing frameworks. In Proceedings of the ACM European Conference on Computer Systems (EUROSYS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Google Server-level UPS batteries. 2009. Google Server-level UPS batteries. http://news.cnet.com/8301-10013-10209580-92.htmlGoogle ScholarGoogle Scholar
  26. Govindan, S., Choi, J., Urgaonkar, B., Sivasubramaniam, B., and Baldini, A. 2009. Statistical profiling-based techniques for effective power provisioning in data centers. In Proceedings of the International European Conference on Computer Systems (EUROSYS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Govindan, S., Sivasubramaniam, A., and Urgaonkar, B. 2011a. Benefits and limitations of tapping into stored energy for datacenters. In Proceedings of the International Symposium of Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Govindan, S., Wang, D., Chen, L., Sivasubramaniam, A., and Urgaonkar, B. 2011b. Towards realizing a low cost and highly available datacenter power infrastructure. In Proceedings of the Workshop on Power Aware Computing and Systems (HotPower). Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Hadoop Map Reduce. 2007. Hadoop map reduce. http://hadoop.apache.org/mapreduce/Google ScholarGoogle Scholar
  30. Hamilton, J. 2009. ISCA keynote 2009. Internet-Scale service infrastructure effciency. In Proceedings of the Annual International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Kontorinis, V., Zhang, L. E., Aksanli, B., Sampson, J., Homayoun, H., Petis, E., Tullsen, D. M. and Rosing, T. S. 2012. Managing distributed UPS energy for effective power capping in data centers. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Le, K., Bianchini, R., Martonosi, M., and Nguyen, T. 2009. Cost- and energy-aware load distribution across data centers. In Proceedings of the Workshop on Power-Aware Computing and Systems (HOTPOWER).Google ScholarGoogle Scholar
  33. Le, K., Bianchini, R., Nguyen, T. D., Bilgir, O., and Martonosi, M. 2010. Capping the brown energy consumption of Internet services at low cost. In Proceedings of the Green Computing Conference (IGCC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Lead-acid battery cost. 2010. Lead-acid battery cost. http://energy.sandia.gov/wp/wp-content/gallery/uploads/093669c.pdfGoogle ScholarGoogle Scholar
  35. Lefurgy, C., Wang, X., and Ware, M. 2007. Server-Level power control. In Proceedings of International Conference on Autonomic Computing (ICAC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Lim, H., Kansal, A., and Liu, J. 2011. Power budgeting for virtualized data centers. In Proceedings of the USENIX Conference on USENIX Annual Technical Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Lin, M., Wierman, A., Andrew, L. L. H., and Thereska, E. 2011. Dynamic right-sizing for power-proportional data centers. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOM).Google ScholarGoogle Scholar
  38. Linden, D. and Reddy, T. B. 2002. Handbook of Batteries. McGraw Hill.Google ScholarGoogle Scholar
  39. Linux AVG Anti Virus. 2012. Linux AVG anti virus. http://free.avg.com/Google ScholarGoogle Scholar
  40. Ma, K., Li, X., Chen, M., and Wang, X. 2011. Scalable power control for many-core architectures running multithreaded applications. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. McCluer, S. 2005. APC white paper 30 (Revision 11): Battery technology for data centers and network rooms: Lead-Acid battery options. Whitepaper.Google ScholarGoogle Scholar
  42. Meisner, D., Sadler, C. M., Barroso, L. A., Weber, W., and Wenisch, T. F. 2011. Power management of online data-intensive services. In Proceedings of the International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Microsoft Rack-level UPS batteries. 2011. Microsoft Rack-level UPS batteries. http://www.datacenterknowledge.com/archives/2011/04/25/microsoft-reveals-its-speciality-servers-racks/Google ScholarGoogle Scholar
  44. Mishra, A., Irwin, D., Shenoy, P., Kurose, J., and Zhu, T. 2012. SmartCharge: Cutting the electricity bill in smart homes with energy storage. In Proceedings of the International Conference on Future Energy Systems: Where Energy, Computing and Communication Meet (e-Energy). Google ScholarGoogle ScholarDigital LibraryDigital Library
  45. Moore, J., Chase, J., Ranganathan P., and Sharma, R. 2005. Making scheduling cool: Temperature-Aware workload placement in data centers. In Proceedings of the Usenix Annual Technical Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  46. Pelley, S., Meisner, D., Zandevakili, P., Wenisch, T. F. and Underwood, J. 2010. Power routing: Dynamic power provisioning in the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  47. Pinheiro, E., Bianchini, R., Carrera, E., and Heath, T. 2001. Load balancing and unbalancing for power and performance in cluster-based systems. In Proceedings of the Workshop on Compilers and Operating Systems for Low Power (COLP).Google ScholarGoogle Scholar
  48. Qureshi, A., Weber, R., Balakrishnan, H., Guttag, J., and Maggs, B. 2009. Cutting the electric bill for internet-scale systems. In Proceedings of the ACM SIGCOMM Conference on Data Communication (SIGCOMM). Google ScholarGoogle ScholarDigital LibraryDigital Library
  49. Raghavendra, R., Ranganathan, P., Talwar, V., Wang, Z., and Zhu, X. 2008. No power struggles: Coordinated multi-level power management for the data center. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  50. Ramos, L. and Bianchini, R. 2008. C-Oracle: Predictive thermal management for data centers. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).Google ScholarGoogle Scholar
  51. Ranganathan, P., Leech, P., Irwin, D., and Chase, J. 2006. Ensemble-Level power management for dense blade servers. In Proceedings of International Symposium on Computer Architecture (ISCA). Google ScholarGoogle ScholarDigital LibraryDigital Library
  52. Rao, L., Liu, X., and Liu, W. 2010a. Minimizing electricity cost: Optimization of distributed internet data centers in a multi-electricity-market environment. In Proceedings of the IEEE International Conference on Computer Communications (INFOCOMM). Google ScholarGoogle ScholarDigital LibraryDigital Library
  53. Rao, L., Liu, X., Ilic, M., and Liu, J. 2010b. MEC-IDC: Joint load balancing and power control for distributed Internet data centers. In Proceedings of the 1st ACM/IEEE International Conference on Cyber-Physical Systems (ICCPS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  54. Ren, J., Wang, D., Urgaonkar, B., and Sivasubramaniam, A. 2012. Carbon-Aware energy capacity planning for datacenters. In Proceedings of the IEEE International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  55. Sharma, N., Barker, S., Irwin, D., and Shenoy, P. 2011. Blink: Managing server clusters on intermittent power. In Proceedings of the International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  56. Smith, B. C., Leimkuhler, J. F., and Darrow, R. M. 1992. Yield management at american airlines. Interfaces 22, 1, 8--31.Google ScholarGoogle ScholarDigital LibraryDigital Library
  57. Smith, W. 2000. TPC-W: Benchmarking an ecommerce solution. http://www.tpc.org/information/other/techarticles.asp.Google ScholarGoogle Scholar
  58. SPECjbb. 2005. SPEC JBB2005: Java business benchmark. http://www.spec.org/jbb2005/Google ScholarGoogle Scholar
  59. Urgaonkar, B., Shenoy, P., and Roscoe, T. 2002. Resource overbooking and application profiling in shared hosting platforms. In Proceedings of the Symposium on Operating Systems Design and Implementation (OSDI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  60. Urgaonkar, R., Urgaonkar, B., Neely, M. J., and Sivasubramaniam, A., 2011. Optimal power cost management using stored energy in data centers. In Proceedings of the Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  61. Vasan, A., Sivasubramaniam, A., Shimpi, V., Sivabalan, T., and Subbiah, R. 2010. Worth their watts? - an empirical study of data center servers. In Proceedings of the International Symposium on High Performance Computer Architecture (HPCA).Google ScholarGoogle Scholar
  62. Ven, P., Hegde, N., Massoulie, L., and Salonidis, T. 2011. Optimal control of residential energy storage under price fluctuations. In Proceedings of the International Conference on Smart Grids, Green Communications and IT Energy-Aware Technologies.Google ScholarGoogle Scholar
  63. Verma, A., De, P., Mann, V., Nayak, T., Purohit, A., Dasgupta, G., and Kothari, R. 2010. BrownMap: Enforcing power budget in shared data centers. In Proceedings of the Conference on Middleware (MIDDLEWARE). Google ScholarGoogle ScholarDigital LibraryDigital Library
  64. Waldspurger, C. 2002. Memory resource management in VMWare ESX server. In Proceedings of the Symposium on Operating System Design and Implementation (OSDI). Google ScholarGoogle ScholarDigital LibraryDigital Library
  65. Wang, D., Ren, C., Sivasubramaniam, A., Urgaonkar, B., and Fathy, H. 2012. Energy storage in datacenters: What, where, and how much? In Proceedings of the ACM SIGMETRICS/PERFORMANCE Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  66. Wang, X. and Chen, M. 2008. Cluster-Level feedback power control for performance optimization. In Proceedings of the International Symposium on High-Performance Computer Architecture (HPCA).Google ScholarGoogle Scholar
  67. Wang, X., Chen, M., and Lefurgy, C. 2011. How much power oversubscription is safe and allowed in data centers? In Proceedings of the International Conference on Autonomic Computing (ICAC). Google ScholarGoogle ScholarDigital LibraryDigital Library
  68. Weisel, A. and Bellosa, F. 2002. Process cruise control-event-driven clock scaling for dynamic power management. In Proceedings of the International Conference on Compilers, Architecture and Synthesis for Embedded Systems (CASES). Google ScholarGoogle ScholarDigital LibraryDigital Library
  69. Zeng, H., Fan, X., Ellis, C., Lebeck, A., and Vahdat, A. 2002. ECOSystem: Managing energy as a first class operating system resource. In Proceedings of the Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS). Google ScholarGoogle ScholarDigital LibraryDigital Library
  70. Zhang, F., Shi, Z., and Wolf, W. 2009. A dynamic battery model for co-design in cyber-physical systems. In Proceedings of the International Conference on Distributed Computing Systems Workshops (ICDCSW). Google ScholarGoogle ScholarDigital LibraryDigital Library
  71. Zhu, Q., Chen, Z., Tan, L., Zhou, Y., Keeton, K., and Wilkes, J. 2005. Hibernator: Helping diskarrays sleep through the winter. In Proceedings of the Symposium on Operating Systems Principles (SOSP). Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Aggressive Datacenter Power Provisioning with Batteries

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!