Abstract
Resource management of virtualized servers in data centers has become a critical task, since it enables cost-effective consolidation of server applications. Resource management is an important and challenging task, especially for multitier applications with unpredictable time-varying workloads. Work in resource management using control theory has shown clear benefits of dynamically adjusting resource allocations to match fluctuating workloads. However, little work has been done toward adaptive controllers for unknown workload types. This work presents a new resource management scheme that incorporates the Kalman filter into feedback controllers to dynamically allocate CPU resources to virtual machines hosting server applications. We present a set of controllers that continuously detect and self-adapt to unforeseen workload changes. Furthermore, our most advanced controller also self-configures itself without any a priori information and with a small 4.8% performance penalty in the case of high-intensity workload changes. In addition, our controllers are enhanced to deal with multitier server applications: by using the pair-wise resource coupling between tiers, they improve server response to large workload increases as compared to controllers with no such resource-coupling mechanism. Our approaches are evaluated and their performance is illustrated on a 3-tier Rubis benchmark website deployed on a prototype Xen-virtualized cluster.
- Virgilio Almeida, Martin Arlitt, and Jerry Rolia. 2002. Analyzing a web-based system’s performance measures at multiple time scales. SIGMETRICS Performance Evaluation Review 30, 2 (2002), 3--9. Google Scholar
Digital Library
- Cristiana Amza, Anupam Chandra, Alan L. Cox, Sameh Elnikety, Romer Gil, Karthick Rajamani, Willy Zwaenepoel, Emmanuel Cecchet, and Julie Marguerite. 2002. Specification and implementation of dynamic web site benchmarks. In Proceedings of the 5th Annual IEEE Workshop on Workload Characterization (WWW-5). 3--13.Google Scholar
Cross Ref
- Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. 2003. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03). ACM, New York, NY, 164--177. Google Scholar
Digital Library
- Emmanuel Cecchet, Anupam Chanda, Sameh Elnikety, Julie Marguerite, and Willy Zwaenepoel. 2003. Performance comparison of middleware architectures for generating dynamic web content. In Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware (Middleware’03). Springer-Verlag, New York, NY, 242--261. Google Scholar
Digital Library
- Emmanuel Cecchet, Julie Marguerite, and Willy Zwaenepoel. 2002. Performance and scalability of EJB applications. In Proceedings of the 17th ACM SIGPLAN Conference on Object-oriented Programming, Systems, Languages, and Applications (OOPSLA’02). ACM, New York, NY, 246--261. DOI: http://doi.acm.org/10.1145/582419.582443 Google Scholar
Digital Library
- Themistoklis Charalambous and Evangelia Kalyvianaki. 2010. A min-max framework for CPU resource provisioning in virtualized servers using H∞ filters. In Proceedings of the 49th IEEE Conference on Decision and Control (CDC’10). 3778--3783.Google Scholar
Cross Ref
- Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP’01). ACM, New York, NY, 103--116. DOI: http://dx.doi.org/10.1145/502034.502045 Google Scholar
Digital Library
- Mike Y. Chen, Anthony Accardi, Emre Kiciman, Jim Lloyd, Dave Patterson, Armando Fox, and Eric Brewer. 2004. Path-based faliure and evolution management. In Proceedings of the 1st Conference on Symposium on Networked Systems Design and Implementation (NSDI’04). USENIX Association, Berkeley, CA, 309--322. Google Scholar
Digital Library
- Ludmila Cherkasova and Rob Gardner. 2005. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In Proceedings of the Annual USENIX Technical Conference (USENIX’05). USENIX Association, Berkeley, CA, 387--390. Google Scholar
Digital Library
- Eduardo F. Costa and Alessandro Astolfi. 2008. On the stability of the recursive Kalman filter for linear time-invariant systems. In Proceedings of the American Control Conference (CDC’08). 1286--1291.Google Scholar
- Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation (OSDI’’04). ACM, New York, NY, 137--150. Google Scholar
Digital Library
- Zhenhuan Gong, Xiaohui Gu, and John Wilkes. 2010. PRESS: Predictive elastic resource scaling for cloud systems. In International Conference on Network and Service Management (CNSM’10). IEEE Computer Society, Washington, DC, 9--16. DOI: http://dx.doi.org/10.1109/CNSM.2010.5691343Google Scholar
- Gueyoung Jung, Kaustubh R. Joshi, Matti A. Hiltunen, Richard D. Schlichting, and Calton Pu. 2008. Generating adaptation policies for multi-tier applications in consolidated server environments. In Proceedings of the 2008 International Conference on Autonomic Computing (ICAC’08). IEEE Computer Society, Washington, DC, 23--32. DOI: http://dx.doi.org/10.1109/ICAC.2008.21 Google Scholar
Digital Library
- Rudolph E. Kalman. 1960. A new approach to linear filtering and prediction problems. Transactions of the ASME--Journal of Basic Engineering 82, Series D (1960), 35--45.Google Scholar
- Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2009. Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters. In Proceedings of the 6th International Conference on Autonomic Computing (ICAC’09). ACM, New York, NY, 117--126. Google Scholar
Digital Library
- Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2010. Resource provisioning for multi-tier virtualized server applications. Computer Measurement Group Journal (CMG), Spring Issue 126 (2010), 6--17.Google Scholar
- Minkyong Kim and Brian Noble. 2001. Mobile network estimation. In Proceedings of the 7th Annual International Conference on Mobile Computing and Networking (MobiCom’01). ACM, New York, NY, 298--309. DOI: http://dx.doi.org/10.1145/381677.381705 Google Scholar
Digital Library
- Sajib Kundu, Raju Rangaswami, Ajay Gulati, Ming Zhao, and Kaushik Dutta. 2012. Modeling virtualized applications using machine learning techniques. In Proceedings of the 8th ACM SIGPLAN/SIGOPS Conference on Virtual Execution Environments (VEE’12). ACM Press, New York, 3--12. DOI: http://dx.doi.org/10.1145/2151024.2151028 Google Scholar
Digital Library
- Xue Liu, Xiaoyun Zhu, P. Padala, Zhikui Wang, and S. Singhal. 2007. Optimal multivariate control for differentiated services on a shared hosting platform. In Proceedings of the 46th IEEE Conference on Decision and Control. IEEE Computer Society, Washington, DC, 3792--3799.Google Scholar
- Peter S. Maybeck. 1979. Stochastic Models, Estimation, and Control. Mathematics in Science and Engineering, Vol. 141. Academic Press, New York.Google Scholar
- Daniel A. Menasce and Mohamed N. Bennani. 2006. Autonomic virtualized environments. In Proceedings of the International Conference on Autonomic and Autonomous Systems (ICAS’06). IEEE Computer Society, Washington, DC, 28. DOI: http://dx.doi.org/10.1109/ICAS.2006.13 Google Scholar
Digital Library
- Aravind Menon, Jose Renato Santos, Yoshio Turner, G. (John) Janakiraman, and Willy Zwaenepoel. 2005. Diagnosing performance overheads in the xen virtual machine environment. In Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments (VEE’05). ACM Press, New York, NY, 13--23. DOI: http://dx.doi.org/10.1145/1064979.1064984 Google Scholar
Digital Library
- Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic distributed resource scaling for infrastructure-as-a-service. In Proceedings of the 10th International Conference on Autonomic Computing (ICAC’13). 69--82.Google Scholar
- Pradeep Padala, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant. 2009. Automated control of multiple virtualized resources. In Proceedings of the 4th ACM European Conference on Computer systems (EuroSys’09). ACM, New York, NY, 13--26. DOI: http://dx.doi.org/10.1145/1519065.1519068 Google Scholar
Digital Library
- Pradeep Padala, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, Arif Merchant, and Kenneth Salem. 2007. Adaptive control of virtualized resources in utility computing environments. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 (EuroSys’07). ACM, New York, NY, 289--302. DOI: http://dx.doi.org/10.1145/1272996.1273026 Google Scholar
Digital Library
- Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, and John Wilkes. 2011. CloudScale: Elastic resource scaling for multi-tenant cloud systems. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC’11). ACM, New York, NY. DOI: http://dx.doi.org/10.1145/2038916.2038921 Google Scholar
Digital Library
- Dan Simon. 2006. Optimal State Estimation. John Wiley & Sons, Inc.Google Scholar
- Gerald Tesauro, Nicholas K. Jong, Rajarshi Das, and Mohamed N. Bennani. 2007. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing 10, 3 (2007), 287--299. Google Scholar
Digital Library
- Bhuvan Urgaonkar and Prashant Shenoy. 2004. Sharc: Managing CPU and network bandwidth in shared clusters. IEEE Transactions Parallel Distributed Systems (TPDS’04) 15, 1 (Jan. 2004), 2--17. DOI: http://dx.doi.org/10.1109/TPDS.2004.1264781 Google Scholar
Digital Library
- Bhuvan Urgaonkar, Prashant Shenoy, Abhishek Chandra, Pawan Goyal, and Timothy Wood. 2008. Agile dynamic provisioning of multi-tier internet applications. Transactions on Autonomic and Adaptive Systems (TAAS’08) 3, 1 (2008), 1:1--1:39. Google Scholar
Digital Library
- Bhuvan Urgaonkar, Prashant Shenoy, and Timothy Roscoe. 2002. Resource overbooking and application profiling in shared hosting platforms. SIGOPS Operating Systems Review 36, SI (Dec. 2002), 239--254. DOI: http://dx.doi.org/10.1145/844128.844151 Google Scholar
Digital Library
- Zhikui Wang, Xue Liu, Alex Zhang, Christopher Stewart, Xiaoyun Zhu, Terence Kelly, and Sharad Singhal. 2007. AutoParam: Automated control of application-level performance in virtualized server environments. In Proceedings of the 2nd International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBID’07).Google Scholar
- Zhikui Wang, Xiaoyun Zhu, and Sharad Singhal. 2005. Utilization and SLO-Based control for dynamic sizing of resource partitions. In Proceedings of the 16th IFIP/IEEE Ambient Networks International Conference on Distributed Systems: Operations and Management (DSOM’05). Springer-Verlag, Berlin, 133--144. DOI: http://dx.doi.org/10.1007/11568285_12 Google Scholar
Digital Library
- Greg Welch and Gary Bishop. 1995. An Introduction to the Kalman Filter. Technical Report 95-041. University of North Carolina at Chapel Hill, Department of Computer Science. Google Scholar
Digital Library
- Timothy Wood, Ludmila Cherkasova, Kivanc Ozonat, and Prashant Shenoy. 2008. Profiling and modeling resource usage of virtualized applications. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (Middleware’08). Springer-Verlag, New York, NY, 366--387. Google Scholar
Digital Library
- Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. 2007. Black-box and gray-box strategies for virtual machine migration. In Proceedings of the 4th USENIX Conference on Networked Systems Design and Implementation (NSDI’07). USENIX Association, Berkeley, CA, 229--242. Google Scholar
Digital Library
- Jing Xu, Ming Zhao, Jose Fortes, Robert Carpenter, and Mazin Yousif. 2007. On the use of fuzzy modeling in virtualized data center management. In Proceedings of the International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 25. Google Scholar
Digital Library
- Wei Xu, Xiaoyun Zhu, Sharad Singhal, and Zhikui Wang. 2006. Predictive control for dynamic resource allocation in enterprise data centers. In Proceedings of the IEEE/IFIP Network Operations and Management Symposium (NOMS’06). 115--126.Google Scholar
- Qi Zhang, Ludmila Cherkasova, and Evgenia Smirni. 2007. A regression-based analytic model for dynamic resource provisioning of multi-tier applications. In Proceedings of the 4th International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 27. DOI: http://dx.doi.org/10.1109/ICAC.2007.1 Google Scholar
Digital Library
- Tao Zheng, Jinmei Yang, Murray Woodside, Marin Litoiu, and Gabriel Iszlai. 2005. Tracking time-varying parameters in software systems with extended Kalman filters. In Proceedings of the 2005 conference of the Centre for Advanced Studies on Collaborative research (CASCON’05). IBM Press, 334--345. Google Scholar
Digital Library
- Xiaoyun Zhu, Zhikui Wang, and Sharad Singhal. 2006. Utility-driven workload management using nested control design. In Proceedings of the American Control Conference (ACC’06). 6.Google Scholar
Index Terms
Adaptive Resource Provisioning for Virtualized Servers Using Kalman Filters
Recommendations
Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters
ICAC '09: Proceedings of the 6th international conference on Autonomic computingData center virtualization allows cost-effective server consolidation which can increase system throughput and reduce power consumption. Resource management of virtualized servers is an important and challenging task, especially when dealing with ...
Resource management architecture for future information appliances
Real-Time and Embedded Computing SystemsThis paper presents our CPU resource management architecture and mechanisms for future information appliances. Information appliances are special purpose computational devices. Their examples include mobile phones, digital TVs, and vehicle navigation ...
Performance Analysis of Network I/O Workloads in Virtualized Data Centers
Server consolidation and application consolidation through virtualization are key performance optimizations in cloud-based service delivery industry. In this paper, we argue that it is important for both cloud consumers and cloud providers to understand ...






Comments