skip to main content
research-article

Adaptive Resource Provisioning for Virtualized Servers Using Kalman Filters

Published:01 July 2014Publication History
Skip Abstract Section

Abstract

Resource management of virtualized servers in data centers has become a critical task, since it enables cost-effective consolidation of server applications. Resource management is an important and challenging task, especially for multitier applications with unpredictable time-varying workloads. Work in resource management using control theory has shown clear benefits of dynamically adjusting resource allocations to match fluctuating workloads. However, little work has been done toward adaptive controllers for unknown workload types. This work presents a new resource management scheme that incorporates the Kalman filter into feedback controllers to dynamically allocate CPU resources to virtual machines hosting server applications. We present a set of controllers that continuously detect and self-adapt to unforeseen workload changes. Furthermore, our most advanced controller also self-configures itself without any a priori information and with a small 4.8% performance penalty in the case of high-intensity workload changes. In addition, our controllers are enhanced to deal with multitier server applications: by using the pair-wise resource coupling between tiers, they improve server response to large workload increases as compared to controllers with no such resource-coupling mechanism. Our approaches are evaluated and their performance is illustrated on a 3-tier Rubis benchmark website deployed on a prototype Xen-virtualized cluster.

References

  1. Virgilio Almeida, Martin Arlitt, and Jerry Rolia. 2002. Analyzing a web-based system’s performance measures at multiple time scales. SIGMETRICS Performance Evaluation Review 30, 2 (2002), 3--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Cristiana Amza, Anupam Chandra, Alan L. Cox, Sameh Elnikety, Romer Gil, Karthick Rajamani, Willy Zwaenepoel, Emmanuel Cecchet, and Julie Marguerite. 2002. Specification and implementation of dynamic web site benchmarks. In Proceedings of the 5th Annual IEEE Workshop on Workload Characterization (WWW-5). 3--13.Google ScholarGoogle ScholarCross RefCross Ref
  3. Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. 2003. Xen and the art of virtualization. In Proceedings of the 19th ACM Symposium on Operating Systems Principles (SOSP’03). ACM, New York, NY, 164--177. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Emmanuel Cecchet, Anupam Chanda, Sameh Elnikety, Julie Marguerite, and Willy Zwaenepoel. 2003. Performance comparison of middleware architectures for generating dynamic web content. In Proceedings of the ACM/IFIP/USENIX 2003 International Conference on Middleware (Middleware’03). Springer-Verlag, New York, NY, 242--261. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Emmanuel Cecchet, Julie Marguerite, and Willy Zwaenepoel. 2002. Performance and scalability of EJB applications. In Proceedings of the 17th ACM SIGPLAN Conference on Object-oriented Programming, Systems, Languages, and Applications (OOPSLA’02). ACM, New York, NY, 246--261. DOI: http://doi.acm.org/10.1145/582419.582443 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Themistoklis Charalambous and Evangelia Kalyvianaki. 2010. A min-max framework for CPU resource provisioning in virtualized servers using H filters. In Proceedings of the 49th IEEE Conference on Decision and Control (CDC’10). 3778--3783.Google ScholarGoogle ScholarCross RefCross Ref
  7. Jeffrey S. Chase, Darrell C. Anderson, Prachi N. Thakar, Amin M. Vahdat, and Ronald P. Doyle. 2001. Managing energy and server resources in hosting centers. In Proceedings of the 18th ACM Symposium on Operating Systems Principles (SOSP’01). ACM, New York, NY, 103--116. DOI: http://dx.doi.org/10.1145/502034.502045 Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Mike Y. Chen, Anthony Accardi, Emre Kiciman, Jim Lloyd, Dave Patterson, Armando Fox, and Eric Brewer. 2004. Path-based faliure and evolution management. In Proceedings of the 1st Conference on Symposium on Networked Systems Design and Implementation (NSDI’04). USENIX Association, Berkeley, CA, 309--322. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Ludmila Cherkasova and Rob Gardner. 2005. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In Proceedings of the Annual USENIX Technical Conference (USENIX’05). USENIX Association, Berkeley, CA, 387--390. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Eduardo F. Costa and Alessandro Astolfi. 2008. On the stability of the recursive Kalman filter for linear time-invariant systems. In Proceedings of the American Control Conference (CDC’08). 1286--1291.Google ScholarGoogle Scholar
  11. Jeffrey Dean and Sanjay Ghemawat. 2004. MapReduce: Simplified data processing on large clusters. In Proceedings of the 6th Symposium on Operating Systems Design & Implementation (OSDI’’04). ACM, New York, NY, 137--150. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Zhenhuan Gong, Xiaohui Gu, and John Wilkes. 2010. PRESS: Predictive elastic resource scaling for cloud systems. In International Conference on Network and Service Management (CNSM’10). IEEE Computer Society, Washington, DC, 9--16. DOI: http://dx.doi.org/10.1109/CNSM.2010.5691343Google ScholarGoogle Scholar
  13. Gueyoung Jung, Kaustubh R. Joshi, Matti A. Hiltunen, Richard D. Schlichting, and Calton Pu. 2008. Generating adaptation policies for multi-tier applications in consolidated server environments. In Proceedings of the 2008 International Conference on Autonomic Computing (ICAC’08). IEEE Computer Society, Washington, DC, 23--32. DOI: http://dx.doi.org/10.1109/ICAC.2008.21 Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Rudolph E. Kalman. 1960. A new approach to linear filtering and prediction problems. Transactions of the ASME--Journal of Basic Engineering 82, Series D (1960), 35--45.Google ScholarGoogle Scholar
  15. Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2009. Self-adaptive and self-configured CPU resource provisioning for virtualized servers using Kalman filters. In Proceedings of the 6th International Conference on Autonomic Computing (ICAC’09). ACM, New York, NY, 117--126. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Evangelia Kalyvianaki, Themistoklis Charalambous, and Steven Hand. 2010. Resource provisioning for multi-tier virtualized server applications. Computer Measurement Group Journal (CMG), Spring Issue 126 (2010), 6--17.Google ScholarGoogle Scholar
  17. Minkyong Kim and Brian Noble. 2001. Mobile network estimation. In Proceedings of the 7th Annual International Conference on Mobile Computing and Networking (MobiCom’01). ACM, New York, NY, 298--309. DOI: http://dx.doi.org/10.1145/381677.381705 Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Sajib Kundu, Raju Rangaswami, Ajay Gulati, Ming Zhao, and Kaushik Dutta. 2012. Modeling virtualized applications using machine learning techniques. In Proceedings of the 8th ACM SIGPLAN/SIGOPS Conference on Virtual Execution Environments (VEE’12). ACM Press, New York, 3--12. DOI: http://dx.doi.org/10.1145/2151024.2151028 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Xue Liu, Xiaoyun Zhu, P. Padala, Zhikui Wang, and S. Singhal. 2007. Optimal multivariate control for differentiated services on a shared hosting platform. In Proceedings of the 46th IEEE Conference on Decision and Control. IEEE Computer Society, Washington, DC, 3792--3799.Google ScholarGoogle Scholar
  20. Peter S. Maybeck. 1979. Stochastic Models, Estimation, and Control. Mathematics in Science and Engineering, Vol. 141. Academic Press, New York.Google ScholarGoogle Scholar
  21. Daniel A. Menasce and Mohamed N. Bennani. 2006. Autonomic virtualized environments. In Proceedings of the International Conference on Autonomic and Autonomous Systems (ICAS’06). IEEE Computer Society, Washington, DC, 28. DOI: http://dx.doi.org/10.1109/ICAS.2006.13 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Aravind Menon, Jose Renato Santos, Yoshio Turner, G. (John) Janakiraman, and Willy Zwaenepoel. 2005. Diagnosing performance overheads in the xen virtual machine environment. In Proceedings of the 1st ACM/USENIX International Conference on Virtual Execution Environments (VEE’05). ACM Press, New York, NY, 13--23. DOI: http://dx.doi.org/10.1145/1064979.1064984 Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Hiep Nguyen, Zhiming Shen, Xiaohui Gu, Sethuraman Subbiah, and John Wilkes. 2013. AGILE: Elastic distributed resource scaling for infrastructure-as-a-service. In Proceedings of the 10th International Conference on Autonomic Computing (ICAC’13). 69--82.Google ScholarGoogle Scholar
  24. Pradeep Padala, Kai-Yuan Hou, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, and Arif Merchant. 2009. Automated control of multiple virtualized resources. In Proceedings of the 4th ACM European Conference on Computer systems (EuroSys’09). ACM, New York, NY, 13--26. DOI: http://dx.doi.org/10.1145/1519065.1519068 Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Pradeep Padala, Kang G. Shin, Xiaoyun Zhu, Mustafa Uysal, Zhikui Wang, Sharad Singhal, Arif Merchant, and Kenneth Salem. 2007. Adaptive control of virtualized resources in utility computing environments. In Proceedings of the 2nd ACM SIGOPS/EuroSys European Conference on Computer Systems 2007 (EuroSys’07). ACM, New York, NY, 289--302. DOI: http://dx.doi.org/10.1145/1272996.1273026 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Zhiming Shen, Sethuraman Subbiah, Xiaohui Gu, and John Wilkes. 2011. CloudScale: Elastic resource scaling for multi-tenant cloud systems. In Proceedings of the 2nd ACM Symposium on Cloud Computing (SOCC’11). ACM, New York, NY. DOI: http://dx.doi.org/10.1145/2038916.2038921 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Dan Simon. 2006. Optimal State Estimation. John Wiley & Sons, Inc.Google ScholarGoogle Scholar
  28. Gerald Tesauro, Nicholas K. Jong, Rajarshi Das, and Mohamed N. Bennani. 2007. On the use of hybrid reinforcement learning for autonomic resource allocation. Cluster Computing 10, 3 (2007), 287--299. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Bhuvan Urgaonkar and Prashant Shenoy. 2004. Sharc: Managing CPU and network bandwidth in shared clusters. IEEE Transactions Parallel Distributed Systems (TPDS’04) 15, 1 (Jan. 2004), 2--17. DOI: http://dx.doi.org/10.1109/TPDS.2004.1264781 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Bhuvan Urgaonkar, Prashant Shenoy, Abhishek Chandra, Pawan Goyal, and Timothy Wood. 2008. Agile dynamic provisioning of multi-tier internet applications. Transactions on Autonomic and Adaptive Systems (TAAS’08) 3, 1 (2008), 1:1--1:39. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Bhuvan Urgaonkar, Prashant Shenoy, and Timothy Roscoe. 2002. Resource overbooking and application profiling in shared hosting platforms. SIGOPS Operating Systems Review 36, SI (Dec. 2002), 239--254. DOI: http://dx.doi.org/10.1145/844128.844151 Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Zhikui Wang, Xue Liu, Alex Zhang, Christopher Stewart, Xiaoyun Zhu, Terence Kelly, and Sharad Singhal. 2007. AutoParam: Automated control of application-level performance in virtualized server environments. In Proceedings of the 2nd International Workshop on Feedback Control Implementation and Design in Computing Systems and Networks (FeBID’07).Google ScholarGoogle Scholar
  33. Zhikui Wang, Xiaoyun Zhu, and Sharad Singhal. 2005. Utilization and SLO-Based control for dynamic sizing of resource partitions. In Proceedings of the 16th IFIP/IEEE Ambient Networks International Conference on Distributed Systems: Operations and Management (DSOM’05). Springer-Verlag, Berlin, 133--144. DOI: http://dx.doi.org/10.1007/11568285_12 Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Greg Welch and Gary Bishop. 1995. An Introduction to the Kalman Filter. Technical Report 95-041. University of North Carolina at Chapel Hill, Department of Computer Science. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Timothy Wood, Ludmila Cherkasova, Kivanc Ozonat, and Prashant Shenoy. 2008. Profiling and modeling resource usage of virtualized applications. In Proceedings of the 9th ACM/IFIP/USENIX International Conference on Middleware (Middleware’08). Springer-Verlag, New York, NY, 366--387. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Timothy Wood, Prashant Shenoy, Arun Venkataramani, and Mazin Yousif. 2007. Black-box and gray-box strategies for virtual machine migration. In Proceedings of the 4th USENIX Conference on Networked Systems Design and Implementation (NSDI’07). USENIX Association, Berkeley, CA, 229--242. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Jing Xu, Ming Zhao, Jose Fortes, Robert Carpenter, and Mazin Yousif. 2007. On the use of fuzzy modeling in virtualized data center management. In Proceedings of the International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 25. Google ScholarGoogle ScholarDigital LibraryDigital Library
  38. Wei Xu, Xiaoyun Zhu, Sharad Singhal, and Zhikui Wang. 2006. Predictive control for dynamic resource allocation in enterprise data centers. In Proceedings of the IEEE/IFIP Network Operations and Management Symposium (NOMS’06). 115--126.Google ScholarGoogle Scholar
  39. Qi Zhang, Ludmila Cherkasova, and Evgenia Smirni. 2007. A regression-based analytic model for dynamic resource provisioning of multi-tier applications. In Proceedings of the 4th International Conference on Autonomic Computing (ICAC’07). IEEE Computer Society, Washington, DC, 27. DOI: http://dx.doi.org/10.1109/ICAC.2007.1 Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Tao Zheng, Jinmei Yang, Murray Woodside, Marin Litoiu, and Gabriel Iszlai. 2005. Tracking time-varying parameters in software systems with extended Kalman filters. In Proceedings of the 2005 conference of the Centre for Advanced Studies on Collaborative research (CASCON’05). IBM Press, 334--345. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Xiaoyun Zhu, Zhikui Wang, and Sharad Singhal. 2006. Utility-driven workload management using nested control design. In Proceedings of the American Control Conference (ACC’06). 6.Google ScholarGoogle Scholar

Index Terms

  1. Adaptive Resource Provisioning for Virtualized Servers Using Kalman Filters

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!