Abstract
Server consolidation, by running multiple virtual machines on top of a single platform with virtualization, provides an efficient solu-tion to parallelism and utilization of modern multi-core processors system. However, the performance and scalability of server con-solidation solution on modern massive advanced server is not well addressed. In this paper, we conduct a comprehensive study of Xen per-formance and scalability characterization running SPECvirt_sc2010, and identify that large memory and cache footprint, due to the unnecessary high frequent context switch, introduce additional challenges to the system performance and scalability. We propose two optimizations (dynamically-allocable tasklets and context-switch rate controller) to improve the performance. The results show the improved memory and cache efficiency with a reduction of the overall CPI, resulting in an improvement of server consolidation capability by 15% in SPECvirt_sc2010. In the meantime, our optimization achieves an up to 50% acceleration of service response, which greatly improves the QoS of Xen virtualization solution.
- Intel Corporation. Terascale computing. http://www.intel.com/research/platform/terascale/index.htm.Google Scholar
- Intel Corporation. Intel Develops Tera-Scale Research Chips. http://www.intel.com/pressroom/archive/releases/20060926corpb.htm.Google Scholar
- VMware. http://www.vmware.com/.Google Scholar
- Microsoft Virtual Server, http://www.microsoft.com/hyper-v-server/Google Scholar
- Kernel Based Virtual Machine http://www.linux-kvm.org/Google Scholar
- P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A. Warfield. Xen and the art of virtualization. In Proceedings of the Symposium on Operating Systems Principles (SOSP), Oct. 2003 Google Scholar
Digital Library
- SPECvirt_sc2010 http://www.spec.org/virt_sc2010/Google Scholar
- P. ApparaoNewell, Towards Modeling & Analysis of Consolidated CMP Servers, Workshop on the Design, Analysis, and Simulation of Chip Multi-Processors (dasCMP), 2007Google Scholar
- Jeffrey P. Casazza, Redefining server performance characterization for virtualization benchmarking, Intel Technology journal August 2006Google Scholar
- I. M. Leslie, D. Mcauley, R. Black, T. Roscoe, P. T. Barham, D. Evers, R. Fairbairns, and E. Hyden. The Design and Implementation of an Operating System to Support Distributed Multimedia Applications. IEEE Journal of Selected Areas in Communications, 1996 Google Scholar
Digital Library
- VMmark http://www.vmware.com/products/vmmark/Google Scholar
- M. Rosenblum. VMware's Virtual Platform: A virtual machine monitor for commodity PCs. In Hot Chips 11: Stanford University, Stanford, CA, August 15--17, 1999Google Scholar
- K. Fraser, S. Hand, R. Neugebauer, I. Pratt, A. War_eld, and M. Williamson. Safe hardware access with the Xen virtual machine monitor. In 1st Workshop on Operating System and Architectural Support for the on demand IT InfraStructure (OASIS), Oct 2004Google Scholar
- A. Menon, J. R. Santos, Y. Turner, G. J. Janakiraman, and W. Zwaenepoel. Diagnosing performance overheads in the Xen virtual machine environment. In Proceedings of the First ACM/USENIX International Conference on Virtual Execution Environments (VEE), pages 13--23, June 2005 Google Scholar
Digital Library
- Selvamuthukumar Senthilvelan and Murugappan Senthilvelan. Study of content-based sharing on the xen virtual machine monitor http://www.cs.wisc.edu/~remzi/Classes/736/Spring2005/Projects/Muru-Selva/cs736-report.pdf.Google Scholar
- Wiegert, J., et al.: Challenges for Scalable Networking in a Virtualized Server. In: 16th International Conference on Computer Communications and NetworksGoogle Scholar
- A. Menon, A.L. Cox, and W. Zwaenepoel. Optimizing network virtualization in Xen. In Proceedings of the 2006 USENIX Annual Technical Conference, pages 15--28, June 2006 Google Scholar
Digital Library
- L. Cherkasova and R. Gardner. Measuring CPU overhead for I/O processing in the Xen virtual machine monitor. In USENIX Annual Technical Conference, Apr. 2005 Google Scholar
Digital Library
- Diego Ongaro , Alan L. Cox , Scott Rixner, Scheduling I/O in virtual machine monitors, Proceedings of the fourth ACM SIG-PLAN/SIGOPS international conference on Virtual execution environments, March 05-07, 2008, Seattle, WA, USA Google Scholar
Digital Library
- Susan J. Eggers, Joel S. Emer, Henry M. Levy, Jack L. Lo, Rebecca L. Stamm , Dean M. Tullsen, Simultaneous Multithreading: A Platform for Next-Generation Processors, IEEE Micro, v.17 n.5, p.12--19, September 1997 Google Scholar
Digital Library
- Xudong Zheng, Jiangang Duan, Shameem F Akhter, Zhidong Yu, Hui Lv, A Consolidation Workload Characterization Study on Modern Platform, CMG'09Google Scholar
- UHLIG, R., NEIGER, G., RODGERS, D., SANTONI, A. L., MARTINS, F. C. M., ANDERSON, A. V., BENNETT, S. M., KAGI, A., LEUNG, F. H., AND SIMTH, L. 2005. Intel Virtualization Technology. IEEE Computer. 38, 5, 48--56 Google Scholar
Digital Library
- Yaozu Dong, Zhao Yu, Greg Rose: SR-IOV Networking in Xen: Architecture, Design and Implementation. Workshop on I/O Virtualization 2008 Google Scholar
Digital Library
- DONG, Y., YANG, X., LI, X., LI, J., TIAN, K., AND GUAN, H. 2010. High Performance Network Virtualization with SR-IOV. In Proceeding of the 16th IEEE International Symposium on High-Performance Computer Architecture (HPCA'10). IEEE, Bangalore, India, 271--280Google Scholar
- L. Cherkasova, D. Gupta, and A. Vahdat. Comparison of the Three CPU Schedulers in Xen. ACM SIGMETRICS Performance Evaluation Review, 35(2):42--51, 2007 Google Scholar
Digital Library
- Credit Scheduler. http://wiki.xensource.com/xenwiki/CreditSchedulerGoogle Scholar
- RAJ, H., AND SCHWAN, K. 2007. High performance and scalable I/O virtualization via self-virtualized devices. In Proceeding of the 16th international symposium on high performance distributed computing (HPDC'07). ACM, Monterrey, CA, 179--188 Google Scholar
Digital Library
- K. J. Duda and D. R. Cheriton. Borrowed-virtual-time (BVT) scheduling: supporting latency-sensitive threads in a general-purpose scheduler. In Proceedings of the 17th ACM SOSP, 1999. Google Scholar
Digital Library
- GUO, D., LIAO, G., AND BHUYAN, L. N. 2009. Performance characterization and cache-aware core scheduling in a virtualized multi-core server under 10GbE. In Proceeding of 2009 IEEE International Symposium on Workload Characterization (IISWC'09). IEEE, Austin, TX, 168--177 Google Scholar
Digital Library
- Yaozu Dong, Xiaowei Yang, Xiaoyong Li, Jianhui Li, Kun Tian, Haibing Guan. High performance network virtualization with SR-IOV. HPCA'2010. pp.1~10Google Scholar
- SANTOS, J. R., TURNER, Y. JANAKIRAMAN, G., AND PRATT, I. 2008. Bridging the gap between software and hardware techniques for I/O virtualization, In Proceeding of the USENIX Annual Technical Conference (USENIX'08). USENIX, Boston, MA, 29--42. Google Scholar
Digital Library
- Hui Lv, Xudong Zheng, Zhiteng Huang, Jiangang Duan, Tackling the Challenges of Server Consolidation on Multi-Core Systems. IISWC'2010 Google Scholar
Digital Library
- Open-iscsi project http://www.open-iscsi.org/Google Scholar
- J. Calandrino and J. Anderson. On the design and implementation of a cache-aware multicore real-time scheduler. In Proceedings of the 21st Euromicro Conference on Real-Time Systems, July 2009. Google Scholar
Digital Library
- Arcangeli, Andrea ; Eidus, Izik ; Wright, Chris: Increasing memory density by using KSM. http://www.kernel.org/doc/ols/2009/#19--28. Version: 2009Google Scholar
- LIAO, G., BHUYAN, L. N., WU, W., YU, H., AND KING, S. R. 2010. A new TCB cache to efficiently manage TCP sessions for Web servers. In Proceeding of the 6th ACM/IEEE Symposium on Architecture for Networking and Communication Systems (ANCS'10). ACM, San Diego, CA, 1--10. Google Scholar
Digital Library
- Jun Nakajima, Qian Lin, Sheng Yang, Min Zhu, Shang Gao, Mingyuan Xia, Peijie Yu, Yaozu Dong, Zhengwei Qi, Kai Chen, Haibing Guan: Optimizing virtual machines using hybrid virtualization. SAC 2011: 573--578 Google Scholar
Digital Library
- A. J. Bernstein, Program Analysis for Parallel Processing, IEEE Trans. on Electronic Computers". EC-15, pp. 757--62, 1966Google Scholar
Cross Ref
- X. Zhang, A. E. Eichenberger, Y. Luo, K. O'Brien , K. O'Brien, Exploiting Parallelism with Dependence-Aware Scheduling, In Proceedings of the 18th International Conference on Parallel Architecture and Compilation Techniques (PACT'09) (Raleigh, NC, USA, Sept. 2009), ACM, pp. 193--202 Google Scholar
Digital Library
Index Terms
Virtualization challenges: a view from server consolidation perspective
Recommendations
Virtualization challenges: a view from server consolidation perspective
VEE '12: Proceedings of the 8th ACM SIGPLAN/SIGOPS conference on Virtual Execution EnvironmentsServer consolidation, by running multiple virtual machines on top of a single platform with virtualization, provides an efficient solu-tion to parallelism and utilization of modern multi-core processors system. However, the performance and scalability ...
Virtualization-Based Operation Support Systems: Performance Evaluation and Systems Design
APNOMS '08: Proceedings of the 11th Asia-Pacific Symposium on Network Operations and Management: Challenges for Next Generation Network Operations and Service ManagementRecent advances in virtualization technologies have allowed telecommunications carriers to apply virtualization-based operation support systems. By separating logical view of computing resources from physical view, virtualization is expected to help ...
Two Optimization Mechanisms to Improve the Isolation Property of Server Consolidation in Virtualized Multi-core Server
HPCC '10: Proceedings of the 2010 IEEE 12th International Conference on High Performance Computing and CommunicationsVirtualization brings many benefits such as improving system utilization and reducing cost through server consolidation. However, it also introduces isolation problem when running multiple virtual machine workloads in one physical platform. Additionally,...







Comments