skip to main content
research-article

Self-Tuning Batching with DVFS for Performance Improvement and Energy Efficiency in Internet Servers

Authors Info & Claims
Published:25 March 2015Publication History
Skip Abstract Section

Abstract

Performance improvement and energy efficiency are two important goals in provisioning Internet services in datacenter servers. In this article, we propose and develop a self-tuning request batching mechanism to simultaneously achieve the two correlated goals. The batching mechanism increases the cache hit rate at the front-tier Web server, which provides the opportunity to improve an application’s performance and the energy efficiency of the server system. The core of the batching mechanism is a novel and practical two-layer control system that adaptively adjusts the batching interval and frequency states of CPUs according to the service level agreement and the workload characteristics. The batching control adopts a self-tuning fuzzy model predictive control approach for application performance improvement. The power control dynamically adjusts the frequency of Central Processing Units (CPUs) with Dynamic Voltage and Frequency Scaling (DVFS) in response to workload fluctuations for energy efficiency. A coordinator between the two control loops achieves the desired performance and energy efficiency. We further extend the self-tuning batching with DVFS approach from a single-server system to a multiserver system. It relies on a MIMO expert fuzzy control to adjust the CPU frequencies of multiple servers and coordinate the frequency states of CPUs at different tiers. We implement the mechanism in a test bed. Experimental results demonstrate that the new approach significantly improves the application performance in terms of the system throughput and average response time. At the same time, the results also illustrate the mechanism can reduce the energy consumption of a single-server system by 13% and a multiserver system by 11%, respectively.

References

  1. B. Addis, Dr. Ardagna, B. Panicucci, M. Squillante, and L. Zhang. 2013. A hierarchical approach for the resource management of very large cloud platforms. IEEE Trans. Dependable Secure Comput. 10, 5 (2013), 253--272. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Y. Chen, B. Yang, A. Abraham, and L. Peng. 2007. Automatic design of hierarchical Takagi-Sugeno type fuzzy systems using evolutionary algorithms. IEEE Trans. Fuzzy Syst. 15, 3 (2007), 385--397. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. D. Cheng, Y. Guo, and X. Zhou. 2013. Self-tuning batching with DVFS for improving performance and energy efficiency in servers. In Procceedings of the IEEE/ACM International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’13). Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Y. Diao, J. L. Hellerstein, S. Parekh, H. Shaihk, and M. Surendra. 2006. Controlling quality of service in multi-tier Web applications. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS’06). Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. M. Elnozahy, M. Kistler, and R. Rajamony. 2003. Energy conservation policies for web servers. In Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS’03). Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. A. Gandhi, Y. Chen, D. Gmach, M. Arlitt, and M. Marwah. 2011a. Minimizing data center SLA violations and power consumption via hybrid resource provisioning. In Proceedings of the International Green Computing Conference and Workshops (IGCC’11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy. 2009. Optimal power allocation in server farms. In Procceedings of the ACM SIGMETRICS. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. A. Gandhi, M. Harchol-Balter, and M. Kozuch. 2011b. The case for sleep states in servers. In the USENIX Workshop on Power Aware Computing and Systems (HotPower’11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. J. Gong and C.-Z. Xu. 2010. vPnP: Automated coordination of power and performance in virtualized datacenters. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’10).Google ScholarGoogle ScholarCross RefCross Ref
  10. Z. Gong and X. Gu. 2010. PAC: Pattern-driven application consolidation for efficient cloud computing. In Proceedings of the IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Y. Guo, P. Lama, Jia Rao, and X. Zhou. 2013. V-Cache: Towards flexible resource provisioning for multi-tier applications in IaaS clouds. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS’13). Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Y. Guo, P. Lama, and X. Zhou. 2012. Automated and agile server parameter tuning with learning and control. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS’12). Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. D. Hagimont, C. M. Kamga, L. Broto, A. Tchana, and N. D. Palma. 2013. DVFS aware CPU credit enforcement in a virtualized system. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware’13).Google ScholarGoogle Scholar
  14. T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu. 2007. Dynamic voltage scaling in multitier web servers with end-to-end delay control. IEEE Trans. Comput. 56, 4 (2007), 444--458. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. G. Jung, M. A. Hiltunen, K. R. Joshi, R. D. Schlichting, and C. Pu. 2010. Mistral: Dynamically managing power, performance, and adaptation cost in cloud infrastructures. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS’10). Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. S. Kumar, V. Talwar, V. Kumar, P. Ranganathan, and K. Schwan. 2009. vManage: Loosely coupled platform and virtualization management in data centers. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’09). Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. P. Lama, Y. Guo, and X. Zhou. 2013. Autonomic performance and power control for co-located web applications on virtualized servers. In Proceedings of the ACM/IEEE International Workshop on Quality of Service (IWQoS’13). 1--10.Google ScholarGoogle Scholar
  18. P. Lama and X. Zhou. 2011. PERFUME: Power and performance guarantee with fuzzy MIMO control in virtualized servers. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’11). Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. P. Lama and X. Zhou. 2012. NINEPIN: Non-invasive and energy efficient performance isolation in virtualized servers. In Procedings of the IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’12). 1--12. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. P. Lama and X. Zhou. 2013. Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee. ACM Trans. Auton. Adaptive Syst. 8, 2 (2013), 1--31. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. C. Lefurgy, X. Wang, and M. Ware. 2007. Server-level power control. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’07). Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. R. Nathuji, C. Isci, and E. Gorbatov. 2007. Exploiting platform heterogeneity for power efficient data centers. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’07). Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. P. Padala, K.-Y. Hou, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, and A. Merchant. 2009. Automated control of multiple virtualized resources. In Proceedings of the EuroSys Conference (EuroSys’09). 13--26. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. V. Sharma, A. Thomas, T. Abdelzaher, K. Skadron, and Z. Lu. 2003. Power-aware QoS management in web servers. In Proceedings of the IEEE Real-Time Systems Symposium (RTSS’03). Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. C. Stewart, T. Kelly, and A. Zhang. 2007. Exploiting nonstationarity for performance prediction. In Proceedings of the EuroSys Conference (EuroSys’07). 31--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. O. S. Unsal and I. Koren. 2003. System-level power-aware design techniques in real-time systems. Proc. IEEE 91, 7 (2003), 1--15.Google ScholarGoogle ScholarCross RefCross Ref
  27. B. Urgaonkar, P. Shenoy, A. Chandra, P. Goyal, and T. Wood. 2008. Agile dynamic provisioning of multi-tier Internet applications. ACM Trans. Auton. Adaptive Syst. 3, 1 (2008), 1--39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. A. Verma, P. Ahuja, and A. Neogi. 2008. pMapper: Power and migration cost aware application placement in virtualized systems. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. H. Wang, Q. Teng, X. Zhong, and P. F. Sweeney. 2010. Using the middle tier to understand cross-tier delay in a multi-tier application. In Proceedings of the IEEE Int’ernational Parallel Distributed Processing Symposium (IPDPS’10).Google ScholarGoogle Scholar
  30. H. O. Wang, K. Tanaka, and M. F. Griffin. 1996. An approach to fuzzy control of nonlinear systems: Stability and design issues. IEEE Trans. Fuzzy Syst. 4, 1 (1996), 14--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Q. Wang, Y. Kanemasa, J. Li, C. A. Lai, M. Matsubara, and C. Pu. 2013. Impact of DVFS on n-Tier application performance. In Proceedings of the ACM Conference on Timely Results in Operating Systems (TRIOS’13). Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. X. Wang, M. Chen, and X. Fu. 2010. Mimo power control for high-density servers in an enclosure. IEEE Trans. Parallel Distributed Syst. 21, 10 (2010), 1412--1426. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. X. Wang, M. Chen, C. Lefurgy, and T. W. Keller. 2012. SHIP: A scalable hierarchical power control architecture for large-scale data centers. IEEE Trans. Parallel Distributed Syst. 23, 1 (2012), 168--176. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. X. Wang and Y. Wang. 2009. Co-Con: Coordinated control of power and application performance for virtualized server clusters. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’09).Google ScholarGoogle Scholar
  35. Y. Wang and X. Wang. 2013. Virtual batching: Request batching for server energy conservation in virtualized data centers. IEEE Trans. Parallel Distributed Syst. 24, 8 (2013), 1695--1705. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Self-Tuning Batching with DVFS for Performance Improvement and Energy Efficiency in Internet Servers

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!