Abstract
Data center power infrastructure incurs massive capital costs, which typically exceed energy costs over the life of the facility. To squeeze maximum value from the infrastructure, researchers have proposed over-subscribing power circuits, relying on the observation that peak loads are rare. To ensure availability, these proposals employ power capping, which throttles server performance during utilization spikes to enforce safe power budgets. However, because budgets must be enforced locally -- at each power distribution unit (PDU) -- local utilization spikes may force throttling even when power delivery capacity is available elsewhere. Moreover, the need to maintain reserve capacity for fault tolerance on power delivery paths magnifies the impact of utilization spikes.
In this paper, we develop mechanisms to better utilize installed power infrastructure, reducing reserve capacity margins and avoiding performance throttling. Unlike conventional high-availability data centers, where collocated servers share identical primary and secondary power feeds, we reorganize power feeds to create shuffled power distribution topologies. Shuffled topologies spread secondary power feeds over numerous PDUs, reducing reserve capacity requirements to tolerate a single PDU failure. Second, we propose Power Routing, which schedules IT load dynamically across redundant power feeds to: (1) shift slack to servers with growing power demands, and (2) balance power draw across AC phases to reduce heating and improve electrical stability. We describe efficient heuristics for scheduling servers to PDUs (an NP-complete problem). Using data collected from nearly 1000 servers in three production facilities, we demonstrate that these mechanisms can reduce the required power infrastructure capacity relative to conventional high-availability data centers by 32% without performance degradation.
- SPECpower Benchmark Results. {Online}. Available: http://www.spec.org/power\_ssj2008/resultsGoogle Scholar
- G. Alvarez, W. Burkhard, L. Stockmeyer, and F. Cristian, "Declustered disk array architectures with optimal and near-optimal parallelism," in Proceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA), 1998. Google Scholar
Digital Library
- L. A. Barroso and U. Hölzle, "The case for energy-proportional computing," Computer, vol. 40, no. 12, 2007. Google Scholar
Digital Library
- J. S. Chase, D. C. Anderson, P. N. Thakar, A. M. Vahdat, and R. P. Doyle, "Managing energy and server resources in hosting centers," SIGOPS Oper. Syst. Rev., vol. 35, no. 5, 2001. Google Scholar
Digital Library
- J. Choi, S. Govindan, B. Urgaonkar, and A. Sivasubramanium, "Profiling, prediction, and capping of power consumption in consolidated environments," in MASCOTS, September 2008.Google Scholar
- C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield, "Live migration of virtual machines," in Proceedings of the 2nd conference on Symposium on Networked Systems Design & Implementation (NSDI), 2005. Google Scholar
Digital Library
- T. Cormen, C. Leiserson, R. Rivest, and C. Stein, Introduction to Algorithms. MIT Press, 2001. Google Scholar
Digital Library
- X. Fan, W.-D. Weber, and L. A. Barroso, "Power provisioning for a warehouse-sized computer," in Proceedings of the 34th Annual International Symposium on Computer Architecture (ISCA), 2007. Google Scholar
Digital Library
- M. E. Femal and V. W. Freeh, "Boosting data center performance through non-uniform power allocation," in Proceedings of Second International Conference on Autonomic Computing (ICAC), 2005. Google Scholar
Digital Library
- A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy, "Optimal power allocation in server farms," in Proceedings of ACM SIGMETRICS 2009 Conference on Measurement and Modeling of Computer Systems, 2009. Google Scholar
Digital Library
- A. Gandhi, M. Harchol-Balter, R. Das, C. Lefurgy, and J. Kephart, "Power capping via forced idleness," in Workshop on Energy-Efficient Design, 2009.Google Scholar
- M. Garey, D. Johnson, R. Backhouse, G. von Bochmann, D. Harel, C. van Rijsbergen, J. Hopcroft, J. Ullman, A. Marshall, I. Olkin phet al., phA Guide to the Theory of Computers and Intractability. Springer.Google Scholar
- S. Govindan, J. Choi, B. Urgaonkar, A. Sivasubramaniam, and A. Baldini, "Statistical profiling-based techniques for effective power provisioning in data centers," in phProceedings of the 4th ACM European Conference on Computer systems (EuroSys), 2009. Google Scholar
Digital Library
- T. Gruzs, "A survey of neutral currents in three-phase computer power systems," IEEE Transactions on Industry Applications, vol. 26, no. 4, Jul/Aug 1990.Google Scholar
Cross Ref
- J. Hamilton, "Internet-scale service infrastructure efficiency," Keynote at the International Symposium on Computer Architecture (ISCA), 2009. Google Scholar
Digital Library
- HP Staff, "HP power capping and dynamic power capping for ProLiant servers," HP, Tech. Rep. TC090303TB, 2009.Google Scholar
- C. Lefurgy, X. Wang, and M. Ware, "Power capping: A prelude to power shifting," Cluster Computing, vol. 11, no. 2, 2008. Google Scholar
Digital Library
- Luiz André Barroso and Urs Hölzle, The Datacenter as a Computer. Morgan Claypool, 2009.Google Scholar
- D. Meisner, B. T. Gold, and T. F. Wenisch, "Powernap: eliminating server idle power," in Proceeding of the 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS), March 2009. Google Scholar
Digital Library
- R. Nathuji and K. Schwan, "Virtualpower: coordinated power management in virtualized enterprise systems," in Proceedings of twenty-first ACM SIGOPS Symposium on Operating Systems Principles (SOSP), 2007. Google Scholar
Digital Library
- P. Popa, "Managing server energy consumption using IBM PowerExecutive," IBM, Tech. Rep., 2006.Google Scholar
- R. Raghavendra, P. Ranganathan, V. Talwar, Z. Wang, and X. Zhu, "No 'power' struggles: coordinated multi-level power management for the data center," in phProceeding of the 13th International Conference on Architectural Support for Programming Languages and Operating Systems, 2008. Google Scholar
Digital Library
- P. Ranganathan, P. Leech, D. Irwin, and J. Chase, "Ensemble-level power management for dense blade servers," in phProceedings of the 33rd Annual International Symposium on Computer Architecture (ISCA), 2006. Google Scholar
Digital Library
- N. Rasmussen, "A scalable, reconfigurable, and efficient data center power distribution architecture," APC by Schneider Electric, Tech. Rep. #129, 2009.Google Scholar
- A. Seznec, "A case for two-way skewed-associative caches," in phProceedings of the 20th Annual International Symposium on Computer Architecture (ISCA), 1993. Google Scholar
Digital Library
- W. Turner and J. Seader, "Dollars per kW plus dollars per square foot are a better datacenter cost model than dollars per square foot alone," Uptime Institute, Tech. Rep., 2006.Google Scholar
- W. Turner, J. Seader, and K. Brill, "Industry standard tier classifications define site infrastructure performance," Uptime Institute, Tech. Rep., 2005.Google Scholar
- X. Wang and M. Chen, "Cluster-level feedback power control for performance optimization," in phProceedings of the 14th IEEE International Symposium on High-Performance Computer Architecture (HPCA), 2008.Google Scholar
- X. Wang, M. Chen, C. Lefurgy, and T. W. Keller, "SHIP: Scalable hierarchical power control for large--scale data centers," in phProceedings of the 18th International Conference on Parallel Architectures and Compilation Techniques (PACT), 2009. Google Scholar
Digital Library
Index Terms
Power routing: dynamic power provisioning in the data center
Recommendations
Power routing: dynamic power provisioning in the data center
ASPLOS '10Data center power infrastructure incurs massive capital costs, which typically exceed energy costs over the life of the facility. To squeeze maximum value from the infrastructure, researchers have proposed over-subscribing power circuits, relying on the ...
Power routing: dynamic power provisioning in the data center
ASPLOS XV: Proceedings of the fifteenth International Conference on Architectural support for programming languages and operating systemsData center power infrastructure incurs massive capital costs, which typically exceed energy costs over the life of the facility. To squeeze maximum value from the infrastructure, researchers have proposed over-subscribing power circuits, relying on the ...
Power availability provisioning in large data centers
CF '14: Proceedings of the 11th ACM Conference on Computing FrontiersEnterprise data centers are provisioned with conservative redundancies built into their power infrastructures to handle failures. Conservative over-provisioning of power capacity for availability reasons results in significant capital investment for ...







Comments