Abstract
Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2% of the total transferred data, 69.1% of the total migration time and achieves the network traffic reduction from 50.1% to 70.3%.
- Distcc. http://code.google.com/p/distcc/.Google Scholar
- Superfasthash. http://www.azillionmonkeys.com/qed/hash.html.Google Scholar
- Sysbench. http://sysbench.sourceforge.net/.Google Scholar
- Tpc-w. http://www.tpc.org/tpcw/.Google Scholar
- A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using ksm. In Proceedings of the linux symposium, pages 19--28, 2009.Google Scholar
- N. Boboroff, A. Kochut, and K. Beaty. Dynamic placement of virtual machines for managing sla violations. In IFIP/IEEE International Symposium on Integrated Network Management, pages 119--128, 2007.Google Scholar
Cross Ref
- B. Bollobas, T. I. Fenner, and A. M. Frieze. An algorithm for finding hamilton paths and cycles in random graphs. Combinatorica, 7(4): 327--341, 1987. Google Scholar
Digital Library
- M. S. Borella, D. Swider, U. S, and B. G.B. Internet packet loss: Measurement and implications for end-to-end qos. In Proceedings of ICPP Workshps, pages 3--12, 1998. Google Scholar
Digital Library
- E. Bugnion, S. Devine, Kinshuk, Govil, and M. Rosenblum. Disco: running commodity operating systems on scalable multiprocessors. ACM Transactions on Computer Systems, 15(4):412--447, 1997. Google Scholar
Digital Library
- C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of NSDI, pages 273--286, 2005. Google Scholar
Digital Library
- U. Deshpande, X. Wang, and K. Gopalan. Live gang migration of virtual machines. In Proceedings of HPDC, pages 135--146, 2011. Google Scholar
Digital Library
- G. W. Dunlap, S. T. Kin, S. Cinar, M. A. Basrai, and P. M. Chen. Revirt: Enabling intrusion analysis through virtual-machine logging and replay. In Proceedings of OSDI, pages 211--224, 2002. Google Scholar
Digital Library
- C. Guo, G. Lu, D. Li, H.Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. Bcube: A high performance, server-centric network architecture for modular data centers. In SIGCOMM, pages 63--74, 2009. Google Scholar
Digital Library
- D. Gupta, S. Lee, M. Vrable, S. Savage, A. C. Snoeren, G. Varghese, G.M. Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. Communications of the ACM, 53(10): 85--93, 2010. Google Scholar
Digital Library
- H. Jin, L. Deng, and S. Wu. Live virtual machine migration with adaptive memory compression. In Proceedings of CLUSTER, pages 1--10, 2009.Google Scholar
Cross Ref
- A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: the linux virtual machine monitor. In Proceedings of the Linux Symposium, pages 225--230, 2007.Google Scholar
- M. J. Knieser, F. G. Wolff, C. A. Papachristou, D. J. Weyer, and D. R. McIntyre. A technique for high ratio lzw compression. In Design, Automation & Test in Europe, pages 10--16, 2003. Google Scholar
Digital Library
- H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannel, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. Snowflock: Rapid virtual machine cloning for cloud computing. In Proceedings of EuroSys, pages 1--12, 2009. Google Scholar
Digital Library
- H. Liu, H. Jin, and X. Liao. Live migration of virtual machine based on full system trace and replay. In Proceedings of HPDC, pages 101--110, 2009. Google Scholar
Digital Library
- R. E. Miller and J. W. Thatcher, editors. Complexity of Computer Computations. Plenum Press., New York, 1972.Google Scholar
Cross Ref
- G. Milos, D. Murray, S. Hand, and M. A. Fetterman. Satori: Enlightened page sharing. In USENIX Annual Technical Conference, pages 1--14, 2009. Google Scholar
Digital Library
- S. B. Moon, J. Kurose, P. Skelly, and D. Towsley. Correlation of packet delay and loss in the internet. Technical report, 1998. Google Scholar
Digital Library
- R. Nathuji and K. Schwan. Virtualpower: Coordinated power management in virtualized enterprise systems. In ACM Symposium on Operating Systems Principles, pages 265--278, 2007. Google Scholar
Digital Library
- R. Nathuji, A. Kansal, and A. Ghaffarkhah. Q-clouds: Managing performance interference effects for qos-aware clouds. In Proceedings of EuroSys, pages 237--250, 2010. Google Scholar
Digital Library
- M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In USENIX '05 Technical Program, 2005. Google Scholar
Digital Library
- B. Nicolae, J. Bresnahan, and K. Keahey. Going back and forth: Efficient multideployment and multisnapshotting on clouds. In Proceedings of HPDC, pages 147--158, 2011. Google Scholar
Digital Library
- M. R, Hines, and K. Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proceedings of VEE, pages 51--60, 2009. Google Scholar
Digital Library
- C. A. Waldspurger. Memory resource management in vmware esx server. In Proceedings of OSDI, pages 181--194, 2002. Google Scholar
Digital Library
- Y. Zhao and W. Huang. Adaptive distributed load balancing algorithm based on live migration of virtual machines in cloud. In Fifth International Joint Conference on INC, IMS and IDC, pages 170--175, 2009. Google Scholar
Digital Library
- J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Trans. on Information Theory, 23(3):337--343, 1997. Google Scholar
Digital Library
Index Terms
VMScatter: migrate virtual machines to many hosts
Recommendations
VMScatter: migrate virtual machines to many hosts
VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environmentsLive virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16Single-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...
SRVM: Hypervisor Support for Live Migration with Passthrough SR-IOV Network Devices
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution EnvironmentsSingle-Root I/O Virtualization (SR-IOV) is a specification that allows a single PCI Express (PCIe) device (ysical function or PF) to be used as multiple PCIe devices (virtual functions or VF). In a virtualization system, each VF can be directly assigned ...







Comments