Abstract
Virtual machine (VM) migration demands distinct properties under resource oversubscription and workload surges. We present enlightened post-copy, a new mechanism for VMs under contention that evicts the target VM with fast execution transfer and short total duration. This design contrasts with common live migration, which uses the down time of the migrated VM as its primary metric; it instead focuses on recovering the aggregate performance of the VMs being affected. In enlightened post-copy, the guest OS identifies memory state that is expected to encompass the VM's working set. The hypervisor accordingly transfers its state, mitigating the performance impact on the migrated VM resulting from post-copy transfer. We show that our implementation, with modest instrumentation in guest Linux, resolves VM contention up to several times faster than live migration.
- AWStextbar Amazon Elastic Compute Cloud (EC2) - Scalable Cloud Hosting. http://aws.amazon.com/ec2.Google Scholar
- memcached - a distributed memory object caching system. http://memcached.org.Google Scholar
- OLTPBenchmark. http://oltpbenchmark.com/wiki.Google Scholar
- The Apache Cassandra Project. http://cassandra.apache.org.Google Scholar
- userfaultfd v4 [LWN.net]. https://lwn.net/Articles/644532.Google Scholar
- Virtio - KVM. http://www.linux-kvm.org/page/Virtio.Google Scholar
- VMware vSere vMotion Architecture, Performance and Best Practices in VMware vSere 5. http://www.vmware.com/files/pdf/vmotion-perf-vsere5.pdf.Google Scholar
- Yahoo! Cloud Serving Benchmark (YCSB). https://github.com/brianfrankcooper/YCSB/wiki.Google Scholar
- R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live Wide-Area Migration of Virtual Machines Including Local Persistent State. In Proceedings of the Third International Conference on Virtual Execution Environments (VEE '07), San Diego, CA, USA, June 2007.Google Scholar
Digital Library
- R. Bryant, A. Tumanov, O. Irzak, A. Scannell, K. Joshi, M. Hiltunen, A. Lagar-Cavilla, and E. de Lara. Kaleidoscope: Cloud Micro-elasticity via VM State Coloring. In Proceedings of the Sixth ACM European Conference on Computer Systems (EuroSys '11), Salzburg, Austria, April 2011.Google Scholar
Digital Library
- R. Chandra, N. Zeldovich, C. Sapuntzakis, and M. S. Lam. The Collective: A Cache-based System Management Architecture. In Proceedings of the Second Conference on Symposium on Networked Systems Design & Implementation - Volume 2 (NSDI '05), Boston, MA, USA, May 2005.Google Scholar
- C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In Proceedings of the Second Conference on Symposium on Networked Systems Design & Implementation - Volume 2 (NSDI '05), Boston, MA, USA, May 2005.Google Scholar
- S. Das, D. Agrawal, and A. El Abbadi. ElasTraS: An Elastic, Scalable, and Self-managing Transactional Database for the Cloud. ACM Transactions on Database Systems, 38(1), April 2013.Google Scholar
- A. J. Elmore, S. Das, D. Agrawal, and A. El Abbadi. Zeyr: Live Migration in Shared Nothing Databases for Elastic Cloud Platforms. In Proceedings of the 2011 ACM SIGMOD International Conference on Management of Data (SIGMOD '11), Athens, Greece, June 2011.Google Scholar
Digital Library
- S. Hacking and B. Hudzia. Improving the Live Migration Process of Large Enterprise Applications. In Proceedings of the Third International Workshop on Virtualization Technologies in Distributed Computing (VTDC '09), Barcelona, Spain, June 2009.Google Scholar
Digital Library
- M. R. Hines, U. Deshpande, and K. Gopalan. Post-copy Live Migration of Virtual Machines. SIGOPS Operating Systems Review, 43(3), July 2009.Google Scholar
- M. R. Hines and K. Gopalan. Post-copy Based Live Virtual Machine Migration Using Adaptive Pre-paging and Dynamic Self-ballooning. In Proceedings of the 2009 ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '09), Washington, DC, USA, March 2009.Google Scholar
Digital Library
- K.-Y. Hou, K. G. Shin, and J.-L. Sung. Application-assisted Live Migration of Virtual Machines with Java Applications. In Proceedings of the Tenth ACM European Conference on Computer Systems (EuroSys '15), Bordeaux, France, April 2015.Google Scholar
- K. Z. Ibrahim, S. Hofmeyr, C. Iancu, and E. Roman. Optimized Pre-copy Live Migration for Memory Intensive Applications. In Proceedings of 2011 International Conference for High Performance Computing, Networking, Storage and Analysis (SC '11), Seattle, WA, USA, November 2011.Google Scholar
Digital Library
- A. Koto, H. Yamada, K. Ohmura, and K. Kono. Towards Unobtrusive VM Live Migration for Cloud Computing Platforms. In Proceedings of the Third ACM SIGOPS Asia-Pacific Conference on Systems (APSys '12), Seoul, South Korea, July 2012.Google Scholar
Digital Library
- M. Kozuch, M. Satyanarayanan, T. Bressoud, and Y. Ke. Efficient State Transfer for Internet Suspend/Resume. Intel Research Pittsburgh Technical Report IRP-TR-02-03, May 2002.Google Scholar
- M. A. Kozuch and M. Satyanarayanan. Internet Suspend/Resume. In Proceedings of the Fourth IEEE Workshop on Mobile Computing Systems and Applications, Callicoon, NY, USA, June 2002.Google Scholar
Digital Library
- H. A. Lagar-Cavilla, J. A. Whitney, A. M. Scannell, P. Patchin, S. M. Rumble, E. de Lara, M. Brudno, and M. Satyanarayanan. SnowFlock: Rapid Virtual Machine Cloning for Cloud Computing. In Proceedings of the Fourth ACM European Conference on Computer Systems (EuroSys '09), Nuremberg, Germany, April 2009.Google Scholar
Digital Library
- H. Liu, H. Jin, X. Liao, L. Hu, and C. Yu. Live Migration of Virtual Machine Based on Full System Trace and Replay. In Proceedings of the Eighteenth ACM International Symposium on High Performance Distributed Computing (HPDC '09), Garching, Germany, June 2009.Google Scholar
Digital Library
- J. Lo, E. Wohlstadter, and A. Mesbah. Live Migration of JavaScript Web Apps. In Proceedings of the Twenty-Second International Conference on World Wide Web (WWW '13 Companion), Rio de Janeiro, Brazil, May 2013.Google Scholar
Digital Library
- P. Lu, A. Barbalace, and B. Ravindran. HSG-LM: Hybrid-copy Speculative Guest OS Live Migration Without Hypervisor. In Proceedings of the Sixth International Systems and Storage Conference (SYSTOR '13), Haifa, Israel, June 2013.Google Scholar
Digital Library
- A. J. Mashtizadeh, M. Cai, G. Tarasuk-Levin, R. Koller, T. Garfinkel, and S. Setty. XvMotion: Unified Virtual Machine Migration over Long Distance. In Proceedings of the 2014 USENIX Annual Technical Conference (USENIX ATC '14), iladelia, PA, USA, June 2014.Google Scholar
- G. Miłós, D. G. Murray, S. Hand, and M. A. Fetterman. Satori: Enlightened Page Sharing. In Proceedings of the 2009 USENIX Annual Technical Conference (USENIX ATC '09), San Diego, CA, USA, June 2009.Google Scholar
- T. Mishima and Y. Fujiwara. Madeus: Database Live Migration Middleware Under Heavy Workloads for Cloud Environment. In Proceedings of the 2015 ACM SIGMOD International Conference on Management of Data (SIGMOD '15), Melbourne, Australia, May 2015.Google Scholar
Digital Library
- M. Nelson, B.-H. Lim, and G. Hutchins. Fast Transparent Migration for Virtual Machines. In Proceedings of the 2005 USENIX Annual Technical Conference (USENIX ATC '05), Anaheim, CA, USA, April 2005.Google Scholar
- C. Peng, M. Kim, Z. Zhang, and H. Lei. VDN: Virtual Machine Image Distribution Network for Cloud Data Centers. In Proceedings of INFOCOM 2012, Orlando, FL, USA, March 2012.Google Scholar
Cross Ref
- J. Reich, O. Laadan, E. Brosh, A. Sherman, V. Misra, J. Nieh, and D. Rubenstein. VMTorrent: Virtual Appliances On-demand. In Proceedings of the ACM SIGCOMM 2010 Conference (SIGCOMM '10), New Delhi, India, August 2010.Google Scholar
Digital Library
- J. Reich, O. Laadan, E. Brosh, A. Sherman, V. Misra, J. Nieh, and D. Rubenstein. VMTorrent: Scalable P2P Virtual Machine Streaming. In Proceedings of the Eighth International Conference on Emerging Networking Experiments and Technologies (CoNEXT '12), Nice, France, December 2012.Google Scholar
Digital Library
- C. Sapuntzakis, D. Brumley, R. Chandra, N. Zeldovich, J. Chow, M. S. Lam, and M. Rosenblum. Virtual Appliances for Deploying and Maintaining Software. In Proceedings of the Seventeenth USENIX Conference on System Administration (LISA '03), San Diego, CA, USA, October 2003.Google Scholar
- C. Sapuntzakis and M. S. Lam. Virtual Appliances in the Collective: A Road to Hassle-free Computing. In Proceedings of the Ninth Conference on Hot Topics in Operating Systems - Volume 9 (HotOS '03), Lihue, HI, USA, May 2003.Google Scholar
- C. P. Sapuntzakis, R. Chandra, B. Pfaff, J. Chow, M. S. Lam, and M. Rosenblum. Optimizing the Migration of Virtual Computers. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI '02), Boston, MA, USA, December 2002.Google Scholar
Cross Ref
- M. Satyanarayanan, B. Gilbert, M. Toups, N. Tolia, A. Surie, D. R. O'Hallaron, A. Wolbach, J. Harkes, A. Perrig, D. J. Farber, M. A. Kozuch, C. J. Helfrich, P. Nath, and H. A. Lagar-Cavilla. Pervasive Personal Computing in an Internet Suspend/Resume System. IEEE Internet Computing, 11(2), March 2007.Google Scholar
- A. Shribman and B. Hudzia. Pre-Copy and Post-copy VM Live Migration for Memory Intensive Applications. In Proceedings of the Eighteenth International Conference on Parallel Processing Workshops (Euro-Par '12), Rhodes Island, Greece, August 2012.Google Scholar
- X. Song, J. Shi, R. Liu, J. Yang, and H. Chen. Parallelizing Live Migration of Virtual Machines. In Proceedings of the Ninth ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '13), Houston, TX, USA, March 2013.Google Scholar
Digital Library
- P. Sv\"ard, B. Hudzia, J. Tordsson, and E. Elmroth. Evaluation of Delta Compression Techniques for Efficient Live Migration of Large Virtual Machines. In Proceedings of the Seventh ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '11), Newport Beach, CA, USA, March 2011.Google Scholar
- C. A. Waldspurger. Memory Resource Management in VMware ESX Server. In Proceedings of the Fifth Symposium on Operating Systems Design and Implementation (OSDI '02), Boston, MA, USA, December 2002.Google Scholar
Digital Library
- C. Wang, F. Mueller, C. Engelmann, and S. L. Scott. Proactive Process-level Live Migration and Back Migration in HPC Environments. Journal of Parallel and Distributed Computing, 72(2), February 2012.Google Scholar
Digital Library
- A. Whitaker, R. S. Cox, M. Shaw, and S. D. Gribble. Constructing Services with Interposable Virtual Hardware. In Proceedings of the First Conference on Symposium on Networked Systems Design and Implementation - Volume 1 (NSDI '04), San Francisco, CA, USA, March 2004.Google Scholar
- T. Wood, K. K. Ramakrishnan, P. Shenoy, and J. van der Merwe. CloudNet: Dynamic Pooling of Cloud Resources by Live WAN Migration of Virtual Machines. In Proceedings of the Seventh ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE '11), Newport Beach, CA, USA, March 2011.Google Scholar
Digital Library
Index Terms
Urgent Virtual Machine Eviction with Enlightened Post-Copy
Recommendations
Urgent Virtual Machine Eviction with Enlightened Post-Copy
VEE '16: Proceedings of the12th ACM SIGPLAN/SIGOPS International Conference on Virtual Execution EnvironmentsVirtual machine (VM) migration demands distinct properties under resource oversubscription and workload surges. We present enlightened post-copy, a new mechanism for VMs under contention that evicts the target VM with fast execution transfer and short ...
Virtual Machine Migration Method between Different Hypervisor Implementations and Its Evaluation
WAINA '12: Proceedings of the 2012 26th International Conference on Advanced Information Networking and Applications WorkshopsVirtualization technologies are an important building block for cloud services. Each service will run on virtual machines (VMs) deployed over different hyper visors in the future. Therefore, a VM migration method between different hyper visor ...
Toward dependency-aware live virtual machine migration
VTDC '09: Proceedings of the 3rd international workshop on Virtualization technologies in distributed computingThe most powerful characteristic of any machine virtualization technology is its ability to adapt to both its underlying infrastructure and the applications it supports. Possibly the most dynamic feature of machine virtualization is the ability to ...







Comments