skip to main content
research-article

VMScatter: migrate virtual machines to many hosts

Published:16 March 2013Publication History
Skip Abstract Section

Abstract

Live virtual machine migration is a technique often used to migrate an entire OS with running applications in a non-disruptive fashion. Prior works concerned with one-to-one live migration with many techniques have been proposed such as pre-copy, post-copy and log/replay. In contrast, we propose VMScatter, a one-to-many migration method to migrate virtual machines from one to many other hosts simultaneously. First, by merging the identical pages within or across virtual machines, VMScatter multicasts only a single copy of these pages to associated target hosts for avoiding redundant transmission. This is impactful practically when the same OS and similar applications running in the virtual machines where there are plenty of identical pages. Second, we introduce a novel grouping algorithm to decide the placement of virtual machines, distinguished from the previous schedule algorithms which focus on the workload for load balance or power saving, we also focus on network traffic, which is a critical metric in data-intensive data centers. Third, we schedule the multicast sequence of packets to reduce the network overhead introduced by joining or quitting the multicast groups of target hosts. Compared to traditional live migration technique in QEMU/KVM, VMScatter reduces 74.2% of the total transferred data, 69.1% of the total migration time and achieves the network traffic reduction from 50.1% to 70.3%.

References

  1. Distcc. http://code.google.com/p/distcc/.Google ScholarGoogle Scholar
  2. Superfasthash. http://www.azillionmonkeys.com/qed/hash.html.Google ScholarGoogle Scholar
  3. Sysbench. http://sysbench.sourceforge.net/.Google ScholarGoogle Scholar
  4. Tpc-w. http://www.tpc.org/tpcw/.Google ScholarGoogle Scholar
  5. A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using ksm. In Proceedings of the linux symposium, pages 19--28, 2009.Google ScholarGoogle Scholar
  6. N. Boboroff, A. Kochut, and K. Beaty. Dynamic placement of virtual machines for managing sla violations. In IFIP/IEEE International Symposium on Integrated Network Management, pages 119--128, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  7. B. Bollobas, T. I. Fenner, and A. M. Frieze. An algorithm for finding hamilton paths and cycles in random graphs. Combinatorica, 7(4): 327--341, 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. M. S. Borella, D. Swider, U. S, and B. G.B. Internet packet loss: Measurement and implications for end-to-end qos. In Proceedings of ICPP Workshps, pages 3--12, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. E. Bugnion, S. Devine, Kinshuk, Govil, and M. Rosenblum. Disco: running commodity operating systems on scalable multiprocessors. ACM Transactions on Computer Systems, 15(4):412--447, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of NSDI, pages 273--286, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. U. Deshpande, X. Wang, and K. Gopalan. Live gang migration of virtual machines. In Proceedings of HPDC, pages 135--146, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. G. W. Dunlap, S. T. Kin, S. Cinar, M. A. Basrai, and P. M. Chen. Revirt: Enabling intrusion analysis through virtual-machine logging and replay. In Proceedings of OSDI, pages 211--224, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. C. Guo, G. Lu, D. Li, H.Wu, X. Zhang, Y. Shi, C. Tian, Y. Zhang, and S. Lu. Bcube: A high performance, server-centric network architecture for modular data centers. In SIGCOMM, pages 63--74, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. D. Gupta, S. Lee, M. Vrable, S. Savage, A. C. Snoeren, G. Varghese, G.M. Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. Communications of the ACM, 53(10): 85--93, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. H. Jin, L. Deng, and S. Wu. Live virtual machine migration with adaptive memory compression. In Proceedings of CLUSTER, pages 1--10, 2009.Google ScholarGoogle ScholarCross RefCross Ref
  16. A. Kivity, Y. Kamay, D. Laor, U. Lublin, and A. Liguori. Kvm: the linux virtual machine monitor. In Proceedings of the Linux Symposium, pages 225--230, 2007.Google ScholarGoogle Scholar
  17. M. J. Knieser, F. G. Wolff, C. A. Papachristou, D. J. Weyer, and D. R. McIntyre. A technique for high ratio lzw compression. In Design, Automation & Test in Europe, pages 10--16, 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannel, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. Snowflock: Rapid virtual machine cloning for cloud computing. In Proceedings of EuroSys, pages 1--12, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. H. Liu, H. Jin, and X. Liao. Live migration of virtual machine based on full system trace and replay. In Proceedings of HPDC, pages 101--110, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. R. E. Miller and J. W. Thatcher, editors. Complexity of Computer Computations. Plenum Press., New York, 1972.Google ScholarGoogle ScholarCross RefCross Ref
  21. G. Milos, D. Murray, S. Hand, and M. A. Fetterman. Satori: Enlightened page sharing. In USENIX Annual Technical Conference, pages 1--14, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. S. B. Moon, J. Kurose, P. Skelly, and D. Towsley. Correlation of packet delay and loss in the internet. Technical report, 1998. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. R. Nathuji and K. Schwan. Virtualpower: Coordinated power management in virtualized enterprise systems. In ACM Symposium on Operating Systems Principles, pages 265--278, 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. R. Nathuji, A. Kansal, and A. Ghaffarkhah. Q-clouds: Managing performance interference effects for qos-aware clouds. In Proceedings of EuroSys, pages 237--250, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In USENIX '05 Technical Program, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. B. Nicolae, J. Bresnahan, and K. Keahey. Going back and forth: Efficient multideployment and multisnapshotting on clouds. In Proceedings of HPDC, pages 147--158, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. M. R, Hines, and K. Gopalan. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In Proceedings of VEE, pages 51--60, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. C. A. Waldspurger. Memory resource management in vmware esx server. In Proceedings of OSDI, pages 181--194, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Y. Zhao and W. Huang. Adaptive distributed load balancing algorithm based on live migration of virtual machines in cloud. In Fifth International Joint Conference on INC, IMS and IDC, pages 170--175, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. J. Ziv and A. Lempel. A universal algorithm for sequential data compression. IEEE Trans. on Information Theory, 23(3):337--343, 1997. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. VMScatter: migrate virtual machines to many hosts

      Recommendations

      Comments

      Login options

      Check if you have access through your login credentials or your institution to get full access on this article.

      Sign in

      Full Access

      • Published in

        cover image ACM SIGPLAN Notices
        ACM SIGPLAN Notices  Volume 48, Issue 7
        VEE '13
        July 2013
        194 pages
        ISSN:0362-1340
        EISSN:1558-1160
        DOI:10.1145/2517326
        Issue’s Table of Contents
        • cover image ACM Conferences
          VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
          March 2013
          210 pages
          ISBN:9781450312660
          DOI:10.1145/2451512

        Copyright © 2013 ACM

        Publisher

        Association for Computing Machinery

        New York, NY, United States

        Publication History

        • Published: 16 March 2013

        Check for updates

        Qualifiers

        • research-article

      PDF Format

      View or Download as a PDF file.

      PDF

      eReader

      View online with eReader.

      eReader
      About Cookies On This Site

      We use cookies to ensure that we give you the best experience on our website.

      Learn more

      Got it!