Abstract
Performance improvement and energy efficiency are two important goals in provisioning Internet services in datacenter servers. In this article, we propose and develop a self-tuning request batching mechanism to simultaneously achieve the two correlated goals. The batching mechanism increases the cache hit rate at the front-tier Web server, which provides the opportunity to improve an application’s performance and the energy efficiency of the server system. The core of the batching mechanism is a novel and practical two-layer control system that adaptively adjusts the batching interval and frequency states of CPUs according to the service level agreement and the workload characteristics. The batching control adopts a self-tuning fuzzy model predictive control approach for application performance improvement. The power control dynamically adjusts the frequency of Central Processing Units (CPUs) with Dynamic Voltage and Frequency Scaling (DVFS) in response to workload fluctuations for energy efficiency. A coordinator between the two control loops achieves the desired performance and energy efficiency. We further extend the self-tuning batching with DVFS approach from a single-server system to a multiserver system. It relies on a MIMO expert fuzzy control to adjust the CPU frequencies of multiple servers and coordinate the frequency states of CPUs at different tiers. We implement the mechanism in a test bed. Experimental results demonstrate that the new approach significantly improves the application performance in terms of the system throughput and average response time. At the same time, the results also illustrate the mechanism can reduce the energy consumption of a single-server system by 13% and a multiserver system by 11%, respectively.
- B. Addis, Dr. Ardagna, B. Panicucci, M. Squillante, and L. Zhang. 2013. A hierarchical approach for the resource management of very large cloud platforms. IEEE Trans. Dependable Secure Comput. 10, 5 (2013), 253--272. Google Scholar
Digital Library
- Y. Chen, B. Yang, A. Abraham, and L. Peng. 2007. Automatic design of hierarchical Takagi-Sugeno type fuzzy systems using evolutionary algorithms. IEEE Trans. Fuzzy Syst. 15, 3 (2007), 385--397. Google Scholar
Digital Library
- D. Cheng, Y. Guo, and X. Zhou. 2013. Self-tuning batching with DVFS for improving performance and energy efficiency in servers. In Procceedings of the IEEE/ACM International Symposium on Modeling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’13). Google Scholar
Digital Library
- Y. Diao, J. L. Hellerstein, S. Parekh, H. Shaihk, and M. Surendra. 2006. Controlling quality of service in multi-tier Web applications. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS’06). Google Scholar
Digital Library
- M. Elnozahy, M. Kistler, and R. Rajamony. 2003. Energy conservation policies for web servers. In Proceedings of the USENIX Symposium on Internet Technologies and Systems (USITS’03). Google Scholar
Digital Library
- A. Gandhi, Y. Chen, D. Gmach, M. Arlitt, and M. Marwah. 2011a. Minimizing data center SLA violations and power consumption via hybrid resource provisioning. In Proceedings of the International Green Computing Conference and Workshops (IGCC’11). Google Scholar
Digital Library
- A. Gandhi, M. Harchol-Balter, R. Das, and C. Lefurgy. 2009. Optimal power allocation in server farms. In Procceedings of the ACM SIGMETRICS. Google Scholar
Digital Library
- A. Gandhi, M. Harchol-Balter, and M. Kozuch. 2011b. The case for sleep states in servers. In the USENIX Workshop on Power Aware Computing and Systems (HotPower’11). Google Scholar
Digital Library
- J. Gong and C.-Z. Xu. 2010. vPnP: Automated coordination of power and performance in virtualized datacenters. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’10).Google Scholar
Cross Ref
- Z. Gong and X. Gu. 2010. PAC: Pattern-driven application consolidation for efficient cloud computing. In Proceedings of the IEEE/ACM International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’10). Google Scholar
Digital Library
- Y. Guo, P. Lama, Jia Rao, and X. Zhou. 2013. V-Cache: Towards flexible resource provisioning for multi-tier applications in IaaS clouds. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS’13). Google Scholar
Digital Library
- Y. Guo, P. Lama, and X. Zhou. 2012. Automated and agile server parameter tuning with learning and control. In Proceedings of the IEEE International Parallel and Distributed Processing Symposium (IPDPS’12). Google Scholar
Digital Library
- D. Hagimont, C. M. Kamga, L. Broto, A. Tchana, and N. D. Palma. 2013. DVFS aware CPU credit enforcement in a virtualized system. In Proceedings of the ACM/IFIP/USENIX International Conference on Middleware (Middleware’13).Google Scholar
- T. Horvath, T. Abdelzaher, K. Skadron, and X. Liu. 2007. Dynamic voltage scaling in multitier web servers with end-to-end delay control. IEEE Trans. Comput. 56, 4 (2007), 444--458. Google Scholar
Digital Library
- G. Jung, M. A. Hiltunen, K. R. Joshi, R. D. Schlichting, and C. Pu. 2010. Mistral: Dynamically managing power, performance, and adaptation cost in cloud infrastructures. In Proceedings of the IEEE International Conference on Distributed Computing Systems (ICDCS’10). Google Scholar
Digital Library
- S. Kumar, V. Talwar, V. Kumar, P. Ranganathan, and K. Schwan. 2009. vManage: Loosely coupled platform and virtualization management in data centers. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’09). Google Scholar
Digital Library
- P. Lama, Y. Guo, and X. Zhou. 2013. Autonomic performance and power control for co-located web applications on virtualized servers. In Proceedings of the ACM/IEEE International Workshop on Quality of Service (IWQoS’13). 1--10.Google Scholar
- P. Lama and X. Zhou. 2011. PERFUME: Power and performance guarantee with fuzzy MIMO control in virtualized servers. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’11). Google Scholar
Digital Library
- P. Lama and X. Zhou. 2012. NINEPIN: Non-invasive and energy efficient performance isolation in virtualized servers. In Procedings of the IEEE/IFIP International Conference on Dependable Systems and Networks (DSN’12). 1--12. Google Scholar
Digital Library
- P. Lama and X. Zhou. 2013. Autonomic provisioning with self-adaptive neural fuzzy control for percentile-based delay guarantee. ACM Trans. Auton. Adaptive Syst. 8, 2 (2013), 1--31. Google Scholar
Digital Library
- C. Lefurgy, X. Wang, and M. Ware. 2007. Server-level power control. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’07). Google Scholar
Digital Library
- R. Nathuji, C. Isci, and E. Gorbatov. 2007. Exploiting platform heterogeneity for power efficient data centers. In Proceedings of the IEEE International Conference on Autonomic Computing (ICAC’07). Google Scholar
Digital Library
- P. Padala, K.-Y. Hou, K. G. Shin, X. Zhu, M. Uysal, Z. Wang, S. Singhal, and A. Merchant. 2009. Automated control of multiple virtualized resources. In Proceedings of the EuroSys Conference (EuroSys’09). 13--26. Google Scholar
Digital Library
- V. Sharma, A. Thomas, T. Abdelzaher, K. Skadron, and Z. Lu. 2003. Power-aware QoS management in web servers. In Proceedings of the IEEE Real-Time Systems Symposium (RTSS’03). Google Scholar
Digital Library
- C. Stewart, T. Kelly, and A. Zhang. 2007. Exploiting nonstationarity for performance prediction. In Proceedings of the EuroSys Conference (EuroSys’07). 31--44. Google Scholar
Digital Library
- O. S. Unsal and I. Koren. 2003. System-level power-aware design techniques in real-time systems. Proc. IEEE 91, 7 (2003), 1--15.Google Scholar
Cross Ref
- B. Urgaonkar, P. Shenoy, A. Chandra, P. Goyal, and T. Wood. 2008. Agile dynamic provisioning of multi-tier Internet applications. ACM Trans. Auton. Adaptive Syst. 3, 1 (2008), 1--39. Google Scholar
Digital Library
- A. Verma, P. Ahuja, and A. Neogi. 2008. pMapper: Power and migration cost aware application placement in virtualized systems. In Proceedings of the ACM/IFIP/USENIX International Middleware Conference. Google Scholar
Digital Library
- H. Wang, Q. Teng, X. Zhong, and P. F. Sweeney. 2010. Using the middle tier to understand cross-tier delay in a multi-tier application. In Proceedings of the IEEE Int’ernational Parallel Distributed Processing Symposium (IPDPS’10).Google Scholar
- H. O. Wang, K. Tanaka, and M. F. Griffin. 1996. An approach to fuzzy control of nonlinear systems: Stability and design issues. IEEE Trans. Fuzzy Syst. 4, 1 (1996), 14--23. Google Scholar
Digital Library
- Q. Wang, Y. Kanemasa, J. Li, C. A. Lai, M. Matsubara, and C. Pu. 2013. Impact of DVFS on n-Tier application performance. In Proceedings of the ACM Conference on Timely Results in Operating Systems (TRIOS’13). Google Scholar
Digital Library
- X. Wang, M. Chen, and X. Fu. 2010. Mimo power control for high-density servers in an enclosure. IEEE Trans. Parallel Distributed Syst. 21, 10 (2010), 1412--1426. Google Scholar
Digital Library
- X. Wang, M. Chen, C. Lefurgy, and T. W. Keller. 2012. SHIP: A scalable hierarchical power control architecture for large-scale data centers. IEEE Trans. Parallel Distributed Syst. 23, 1 (2012), 168--176. Google Scholar
Digital Library
- X. Wang and Y. Wang. 2009. Co-Con: Coordinated control of power and application performance for virtualized server clusters. In Proceedings of the IEEE International Workshop on Quality of Service (IWQoS’09).Google Scholar
- Y. Wang and X. Wang. 2013. Virtual batching: Request batching for server energy conservation in virtualized data centers. IEEE Trans. Parallel Distributed Syst. 24, 8 (2013), 1695--1705. Google Scholar
Digital Library
Index Terms
Self-Tuning Batching with DVFS for Performance Improvement and Energy Efficiency in Internet Servers
Recommendations
Self-Tuning Batching with DVFS for Improving Performance and Energy Efficiency in Servers
MASCOTS '13: Proceedings of the 2013 IEEE 21st International Symposium on Modelling, Analysis & Simulation of Computer and Telecommunication SystemsPerformance improvement and energy efficiency are two important goals in provisioning Internet services in data center servers. In this paper, we propose and develop a self-tuning request batching mechanism to simultaneously achieve the two correlated ...
DVFS-aware application classification to improve GPGPUs energy efficiency
Highlights- Exploring the effects of core and memory DVFS on the execution of GPU applications.
AbstractThe increasing importance of GPUs as high-performance accelerators and the power and energy constraints of computing systems, make it fundamental to develop techniques for energy efficiency maximization of GPGPU applications. Among ...
Energy-efficient scheduling of a real-time task on DVFS-enabled multi-cores
ICHIT '09: Proceedings of the 2009 International Conference on Hybrid Information TechnologyWe propose an energy-efficient scheduling of a long-lived real-time video task running on DVFS-enabled multi-core platforms. The proposed scheme reduces the energy consumption by executing the task in parallel on an appropriate number of cores with the ...






Comments