skip to main content
research-article

Evaluation of delta compression techniques for efficient live migration of large virtual machines

Published:09 March 2011Publication History
Skip Abstract Section

Abstract

Despite the widespread support for live migration of Virtual Machines (VMs) in current hypervisors, these have significant shortcomings when it comes to migration of certain types of VMs. More specifically, with existing algorithms, there is a high risk of service interruption when migrating VMs with high workloads and/or over low-bandwidth networks. In these cases, VM memory pages are dirtied faster than they can be transferred over the network, which leads to extended migration downtime. In this contribution, we study the application of delta compression during the transfer of memory pages in order to increase migration throughput and thus reduce downtime. The delta compression live migration algorithm is implemented as a modification to the KVM hypervisor. Its performance is evaluated by migrating VMs running different type of workloads and the evaluation demonstrates a significant decrease in migration downtime in all test cases. In a benchmark scenario the downtime is reduced by a factor of 100. In another scenario a streaming video server is live migrated with no perceivable downtime to the clients while the picture is frozen for eight seconds using standard approaches. Finally, in an enterprise application scenario, the delta compression algorithm successfully live migrates a very large system that fails after migration using the standard algorithm. Finally, we discuss some general effects of delta compression on live migration and analyze when it is beneficial to use this technique.

References

  1. P. Anedda. Suspending, migrating and resuming HPC virtual clusters. Future Generation Computer Systems, 26(8):1063--1072, 2010. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. P. Barham, B. Dragovic, K. Fraser, S. Hand, T. Harris, A. Ho, R. Neugebauer, I. Pratt, and A.Warfield. Xen and the art of virtualization. In SOSP '03: Proceedings of the nineteenth ACM symposium on Operating systems principles, pages 164--177. ACM, October 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Bitmover. Lmbench, 2010. http://www.bitmover.com/lmbench/, visisted June 2010.Google ScholarGoogle Scholar
  4. R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In VEE '07: Proceedings of the 3rd international conference on Virtual execution environments, pages 169--179. ACM, June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Citrix Systems. Xen. http://www.xen.org, visited October 2010.Google ScholarGoogle Scholar
  6. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proceedings of the 2nd ACM/USENIX Symposium on Networked Systems Design and Implementation (NSDI), pages 273--286. ACM, May 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. S. Hacking and B. Hudzia. Improving the live migration process of large enterprise applications. In VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computing, pages 51--58. ACM, June 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. E. Harney, S. Goasguen, J. Martin, M. Murphy, and M. Westall. The efficacy of live virtual machine migrations over the internet. In VTDC '07: Proceedings of the 3rd international workshop on Virtualization technology in distributed computing, pages 1--7. ACM, November 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. M. D. Hill. Aspects of cache memory and instruction buffer performance. PhD thesis, University of California, Berkeley, 1987. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. W. Huang, Q. Gao, J. Liu, and D. K. Panda. High performance virtual machine migration with RDMA over modern interconnects. Technical report, IBM T. J. Watson Research Center, 2007.Google ScholarGoogle Scholar
  11. Kernel Based Virtual Machine. KVM - kernel-based virtualization machine white paper, 2006. http://kvm.qumranet.com/kvmwiki, visited October 2010.Google ScholarGoogle Scholar
  12. P. Liu, Z. Yang, X. Song, Y. Zhou, H. Chen, and B. Zang. Heterogeneous live migration of virtual machines. Technical report, Parallel Processing Institute, Fudan University, 2009.Google ScholarGoogle Scholar
  13. N. Megiddo and D. S. Modha. ARC: A self-tuning, low overhead replacement cache. In FAST '03: Proceedings of the 2nd USENIX Conference on File and Storage Technologies, pages 115--130. USENIX Association, March 2003. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. S. Potter. Using binary delta compression (BDC) technology to update Windows XP and Windows Server 2003, October 2005. http://www.microsoft.com/downloads/details.aspx?FamilyID=4789196c-d60a-497c-ae89-101a3754bad6, visited October 2010.Google ScholarGoogle Scholar
  15. D. Pountain. Run-length encoding. Byte, 12(6):317--319, 1987.Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. K. K. Ramakrishnan, P. Shenoy, and J. Van der Merwe. Live data center migration acrossWANs: a robust cooperative context aware approach. In INM '07: Proceedings of the 2007 SIGCOMM workshop on Internet network management, pages 262--267. ACM, August 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. B. Rochwerger, D. Breitgand, E. Levy, A. Galis, K. Nagin, I. Llorente, R. Montero, Y. Wolfsthal, E. Elmroth, J. Caceres, M. Ben-Yehuda, W. Emmerich, and F. Galan. The RESERVOIR model and architecture for open federated cloud computing. IBM Journal of Research and Development, 53(4):1--11, 2009. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. C. P. Sapuntzaki, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the migration of virtual computers. SIGOPS Oper. Syst. Rev., 36(SI):377--390, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. F. Travostino. Seamless live migration of virtual machines over the MAN/WAN. In SC '06: Proceedings of the 2006 ACM/IEEE conference on Supercomputing, page 290. ACM, November 2006. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. VMWare. VMWare. http://www.vmware.com, visited October 2010.Google ScholarGoogle Scholar
  21. VMWARE. VMware VMotion: Live migration of virtual machines without service interruption datasheet, 2007. http://www.vmware.com/files/pdf/VMware-VMotion-DS-EN.pdf, visited October 2010.Google ScholarGoogle Scholar
  22. R. A. Wagner and M. J. Fischer. The string-to-string correction problem. J. ACM, 21(1):168--173, 1974. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. M. Zhao and R. J. Figueiredo. Experimental study of virtual machine migration in support of reservation of cluster resources. In VTDC '07: Proceedings of the 3rd international workshop on Virtualization technology in distributed computing, pages 1--8. ACM, June 2007. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Evaluation of delta compression techniques for efficient live migration of large virtual machines

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM SIGPLAN Notices
          ACM SIGPLAN Notices  Volume 46, Issue 7
          VEE '11
          July 2011
          231 pages
          ISSN:0362-1340
          EISSN:1558-1160
          DOI:10.1145/2007477
          Issue’s Table of Contents
          • cover image ACM Conferences
            VEE '11: Proceedings of the 7th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
            March 2011
            250 pages
            ISBN:9781450306874
            DOI:10.1145/1952682

          Copyright © 2011 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 9 March 2011

          Check for updates

          Qualifiers

          • research-article

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!