Abstract
Modern offices are crowded with personal computers. While studies have shown these to be idle most of the time, they remain powered, consuming up to 60% of their peak power. Hardware-based solutions engendered by PC vendors (e.g., low-power states, Wake-on-LAN) have proved unsuccessful because, in spite of user inactivity, these machines often need to remain network active in support of background applications that maintain network presence. Recent proposals have advocated the use of consolidation of idle desktop Virtual Machines (VMs). However, desktop VMs are often large, requiring gigabytes of memory. Consolidating such VMs creates large network transfers lasting in the order of minutes and utilizes server memory inefficiently. When multiple VMs migrate concurrently, networks become congested, and the resulting migration latencies are prohibitive. We present partial VM migration, an approach that transparently migrates only the working set of an idle VM. It creates a partial replica of the desktop VM on the consolidation server by copying only VM metadata, and it transfers pages to the server on-demand, as the VM accesses them. This approach places desktop PCs in low-power mode when inactive and switches them to running mode when pages are needed by the VM running on the consolidation server. To ensure that desktops save energy, we have developed sleep scheduling and prefetching algorithms, as well as the context-aware selective resume framework, a novel approach to reduce the latency of power mode transition operations in commodity PCs. Jettison, our software prototype of partial VM migration for off-the-shelf PCs, can deliver 44--91% energy savings during idle periods of at least 10 minutes, while providing low migration latencies of about 4 seconds and migrating minimal state that is under an order of magnitude of the VM’s memory footprint.
Supplemental Material
Available for Download
Supplemental movie, appendix, image and software files for, Energy-Oriented Partial Desktop Virtual Machine Migration
- Mike Accetta, Robert Baron, William Bolosky, David Golub, Richard Rashid, Avadis Tevanian, and Michael Young. 1986. Mach: A new kernel foundation for UNIX development. In Summer USENIX Conference.Google Scholar
- Acer, Inc. 2012. Acer Aspire S3. Retrieved from http://us.acer.com/ac/en/US/content/series/aspiresseries.Google Scholar
- Acid3 Test. 2012. The Acid3 Test. Retrieved from http://acid3.acidtests.org/.Google Scholar
- Advanced Micro Devices, Inc. 2009. AMD I/O Virtualization Technology (IOMMU) Specification. Retrieved from http://support.amd.com/us/Embedded_TechDocs/34434-IOMMU-Rev_1.26_2-11-09.pdf.Google Scholar
- Yuvraj Agarwal, Ranveer Chandra, Alec Wolman, Paramvir Bahl, Kevin Chin, and Rajesh Gupta. 2007. Wireless wakeups revisited: Energy management for VOIP over Wi-Fi smartphones. In 5th International Conference on Mobile Systems, Applications and Services (MobiSys’07). Google Scholar
Digital Library
- Yuvraj Agarwal, Steve Hodges, James Scott, Ranveer Chandra, Paramvir Bahl, and Rajesh Gupta. 2009. Somniloquy: Augmenting network interfaces to reduce PC energy usage. In USENIX Symposium on Networked Systems Design and Implementation (NSDI’09). Google Scholar
Digital Library
- Yuvraj Agarwal, Stefan Savage, and Rajesh Gupta. 2010. SleepServer: A software-only approach for reducing the energy consumption of PCs within enterprise environments. In USENIX Annual Technical Conference (USENIX ATC’10). Google Scholar
Digital Library
- Thomas E. Anderson, David E. Culler, and David A. Patterson. 1995. A case for NOW (networks of workstations). IEEE Micro 15, 1 (Feb. 1995), 54--64. Google Scholar
Digital Library
- Apple, Inc. 2012. MacBook Air. Retrieved from http://www.apple.com/macbookair/performance.html.Google Scholar
- Remzi H. Arpaci, Andrea C. Dusseau, Amin M. Vahdat, Lok T. Liu, Thomas E. Anderson, and David A. Patterson. 1995. The interaction of parallel and sequential workloads on a network of workstations. In ACM SIGMETRICS Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’95). Google Scholar
Digital Library
- Moonish Badaloo. 2006. An Examination of Server Consolidation: Trends that Can Drive Efficiencies and Help Businesses Gain a Competitive Edge. Retrieved from http://www.ibm.com/systems/optimizeit/pdf/server_consolidation_whitepaper.pdf.Google Scholar
- Ammon Barak, Shai Guday, and Richard G. Wheeler. 1993. The MOSIX Distributed Operating System—Load Balancing for UNIX. Vol. 672. Springer-Verlag. Google Scholar
Digital Library
- Ricardo A. Baratto, Shaya Potter, Gong Su, and Jason Nieh. 2004. MobiDesk: Mobile virtual desktop computing. In International Conference on Mobile Computing and Networking (MobiCom’04). Philadelphia, PA. Google Scholar
Digital Library
- Paul Barham, Boris Dragovic, Keir Fraser, Steven Hand, Tim Harris, Alex Ho, Rolf Neugebauer, Ian Pratt, and Andrew Warfield. 2003. Xen and the art of virtualization. In 19th Symposium on Operating Systems Principles (SOSP’03). Google Scholar
Digital Library
- Luiz André Barroso and Urs Hölzle. 2007. The case for energy-proportional computing. IEEE Computer 40, 12 (Dec 2007). Google Scholar
Digital Library
- Jeffrey Bickford and Ramón Cáceres. 2013. Towards synchronization of live virtual machines among mobile devices. In 14th Workshop on Mobile Computing Systems and Applications (HotMobile’13). Google Scholar
Digital Library
- Roy Bryant, Alexey Tumanov, Olga Irzak, Adin Scannell, Kaustubh Joshi, Matti Hiltunen, Horacio Andrés Lagar-Cavilla, and Eyal de Lara. 2011. Kaleidoscope: Cloud micro-elasticity via VM state coloring. In ACM European Conference on Computer Systems (EuroSys’11). Google Scholar
Digital Library
- California Energy Commission. 2006. California Commercial End-Use, CEC-400-2006-005. Retrieved from http://www.energy.ca.gov/2006publications/CEC-400-2006-005/CEC-400-2006-005.PDF.Google Scholar
- Peter M. Chen and Brian D. Noble. 2001. When virtual is better than real. In 8th IEEE Workshop on Hot Topics in Operating Systems (HotOS’01). Google Scholar
Digital Library
- Citrix Systems, Inc. 2011. Citrix VDI-in-a-Box. Retrieved from http://www.citrix.com/site/resources/dynamic/salesdocs/VDIinaBox_Datasheet.pdf.Google Scholar
- Christopher Clark, Keir Fraser, Steven Hand, Jacob Gorm Hansen, Eric Jul, Christian Limpach, Ian Pratt, and Andrew Warfield. 2005. Live migration of virtual machines. In 2nd Conference on Symposium on Networked Systems Design and Implementation (NSDI’05). Google Scholar
Digital Library
- Brendan Cully, Geoffrey Lefebvre, Dutch Meyer, Mike Feeley, Norm Hutchinson, and Andrew Warfield. 2008. Remus: High availability via asynchronous virtual machine replication. In 5th USENIX Symposium on Networked Systems Design and Implementation (NSDI’08). Google Scholar
Digital Library
- Tathagata Das, Pradeep Padala, Venkat Padmanabhan, Ramachandran Ramjee, and Kang G. Shin. 2010. LiteGreen: Saving energy in networked desktops using virtualization. In USENIX Annual Technical Conference (USENIX ATC’10). Google Scholar
Digital Library
- Tim Dierks and Eric Rescorla. 2008. The TLS Protocol: Version 1.2. Retrieved from https://tools.ietf.org/html/rfc5246.Google Scholar
- Fahad R. Dogar, Peter Steenkiste, and Konstantina Papagiannaki. 2010. Catnap: Exploiting high bandwidth wireless interfaces to save energy for mobile devices. In International Conference on Mobile Systems, Applications and Services (MobiSys’10). Google Scholar
Digital Library
- Yaozu Dong, Zhao Yu, and Greg Rose. 2008. SR-IOV networking in xen: Architecture, design and implementation. In First Workshop on I/O Virtualization (WIOV’08). Google Scholar
Digital Library
- Fred Douglis and John Ousterhout. 1991. Transparent process migration: Design alternatives and the sprite implementation. Software Practical Experience 21, 8 (Aug. 1991), 757--785. Google Scholar
Digital Library
- Facebook, Inc. 2012. Facebook Chat. Retrieved from http://www.facebook.com/sitetour/chat.php.Google Scholar
- Xiaobo Fan, Wolf-Dietrich Weber, and Luiz André Barroso. 2007. Power provisioning for a warehouse-sized computer. In ACM International Symposium on Computer Architecture (ISCA’07). Google Scholar
Digital Library
- Jason Flinn and M. Satyanarayanan. 1999. Energy-Aware adaptation for mobile applications. In 17th ACM Symposium on Operating System Principles (SOSP’99). Google Scholar
Digital Library
- Kevin Fograrty. 2011. The Year of the Virtual Desktop Fails to Materialize--Again. Retrieved from http://www.cio.com/article/691303/The_Year_of_the_Virtual_Desktop_Fails _to_Materialize_Again.Google Scholar
- James Glanz. 2012. Power Pollution and the Internet: Data Centers Waste Vast Amounts of Energy, Belying Industry Image. Retrieved from http://nyti.ms/1sW5bMM.Google Scholar
- Robert P. Goldberg. 1973. Architectural Principles for Virtual Computer Systems. Technical Report. Harvard University.Google Scholar
- Google, Inc. 2012a. Gmail. Retrieved from http://gmail.com.Google Scholar
- Google, Inc. 2012b. Google Docs. Retrieved from http://docs.google.com.Google Scholar
- K. Govil, E. Chan, and H. Wasserman. 1995. Comparing algorithms for dynamic speed-setting of a low power CPU. In International Conference on Mobile Computing and Networking (MobiCom’95). Google Scholar
Digital Library
- Chamara Gunaratne, Ken Christensen, and Bruce Nordman. 2005. Managing energy consumption costs in desktop PCs and LAN switches with proxying, split TCP connections, and scaling of link speed. International Journal of Network Management 15, 5 (Sep. 2005), 297--310. Google Scholar
Digital Library
- Hewlett-Packard Corporation, Intel Corporation, Microsoft Corporation, Phoenix Technologies Ltd, and Toshiba Corporation. 2009. Advanced Configuration and Power Interface Specification. Retrieved from http://www.acpi.info/DOWNLOADS/ACPIspec40.pdf.Google Scholar
- Michael R. Hines and Kartik Gopalan. 2009. Post-copy based live virtual machine migration using adaptive pre-paging and dynamic self-ballooning. In ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’09). Google Scholar
Digital Library
- Intel Corporation. 2006. Intel® Centrino® Mobile Technology Wake on Wireless LAN Feature: Technical Brief. Retrieved from http://www.intel.com/network/connectivity/resources/doc_library/tech_brief/wowlan_tech_brief.pdf.Google Scholar
- Intel Corporation. 2011a. Intel® Virtualization Technology for Directed I/O: Architecture Specification. Retrieved from http://goo.gl/VscXC.Google Scholar
- Intel Corporation. 2011b. PCI-SIG SR-IOV Primer: An Introduction to SR-IOV Technology. Retrieved from http://www.intel.com/content/dam/doc/application-note/pci-sig-sr-iov-primer-sr-iov-technology-paper.pdf. (Jan 2011).Google Scholar
- Intel Corporation. 2011c. Vision Paper: Intelligent Desktop Virtualization. Retrieved from http://www.intel.com/content/dam/doc/white-paper/intelligent-desktop-virtualization-overview-paper.pdf.Google Scholar
- Intel Corporation, Microsoft Corporation, and Toshiba Corporation. 1999. Advanced Configuration and Power Interface Specification. Retrieved from http://www.acpi.info/DOWNLOADS/ACPIspec10b.pdf.Google Scholar
- Miguel Jimeno, Ken Christensen, and Bruce Nordman. 2008. A network connection proxy to enable hosts to sleep and save energy. In 27th IEEE International Performance Computing and Communications Conference.Google Scholar
Cross Ref
- Asim Kadav and Michael M. Swift. 2008. Live migration of direct-access devices. In 1st Workshop on I/O Virtualization (WIOV’08). Google Scholar
Digital Library
- Michael Kozuch and M. Satyanarayanan. 2002. Internet suspend/resume. In 4th IEEE Workshop on Mobile Computing Systems and Applications (WMCSA’02). Google Scholar
Digital Library
- Horacio Andrés Lagar-Cavilla, Joseph Andrew Whitney, Adin Matthew Scannell, Philip Patchin, Stephen M. Rumble, Eyal de Lara, Michael Brudno, and Mahadev Satyanarayanan. 2009. SnowFlock: Rapid virtual machine cloning for cloud computing. In 4th ACM European Conference on Computer Systems (EuroSys’09). Google Scholar
Digital Library
- Joshua LeVasseur, Volkmar Uhlig, Jan Stoess, and Stefan Götz. 2004. Unmodified device driver reuse and improved system dependability via virtual machines. In 6th Symposium on Operating Systems Design and Implementation (OSDI’04). Google Scholar
Digital Library
- Lieberman Software Corporation. 2006. White Paper: Wake on LAN Technology. Retrieved from http://www. liebsoft.com/pdfs/Wake_On_LAN.pdf.Google Scholar
- Michael R. Marty and Mark D. Hill. 2007. Virtual hierarchies to support server consolidation. In 34th International Symposium on Computer Architecture (ISCA’07). Google Scholar
Digital Library
- David Meisner, Brian T. Gold, and Thomas F. Wenisch. 2009. PowerNap: Eliminating server idle power. In 14th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’09). Google Scholar
Digital Library
- Miron Livny, Michael J. Litzkow, and Matt W. Mutka. 1988. Condor—A hunter of idle workstations. In 8th International Conference of Distributed Computing Systems (ICDCS’88).Google Scholar
- Dejan S. Milojicic, Fred Douglis, Yves Paindaveine, Richard Wheeler, and Songnian Zhou. 2000. Process migration. Computer Surveys 32, 3 (Sep 2000), 241--299. Google Scholar
Digital Library
- Sergiu Nedevschi, Jaideep Chandrashekar, Junda Liu, Bruce Nordman, Sylvia Ratnasamy, and Nina Taf. 2009. Skilled in the art of being idle: Reducing energy waste in networked systems. In 6th USENIX Symposium on Networked Systems Design and Implementation (NSDI’09). Boston, MA. Google Scholar
Digital Library
- Gil Neiger, Amy Santoni, Felix Leung, Dion Rodgers, and Rich Uhlig. 2006. Intel® Virtualization Technology: Hardware support for efficient processor virtualization. Intel® Technology Journal 10, 3 (Aug 2006).Google Scholar
Cross Ref
- Brian D. Noble, M. Satyanarayanan, Dushyanth Narayanan, James Eric Tilton, Jason Flinn, and Kevin R. Walker. 1997. Agile application-aware adaptation for mobility. In 16th ACM Symposium on Operating System Principles (SOSP’97). Google Scholar
Digital Library
- Oracle Corporation. 2012. Oracle Virtual Desktop Infrastructure. Retrieved from http://www.oracle.com/us/virtual-desktop-infrastructure-ds-067844.pdf.Google Scholar
- M. L. Powell and B. P. Miller. 1983. Process migration in DEMOS/MP. In 9th Symposium on Operating Systems Principles (SOSP’83). Google Scholar
Digital Library
- Shriram Rajagopalan, Brendan Cully, Ryan O’Connor, and Andrew Warfield. 2012. SecondSite: Disaster tolerance as a service. In ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’12). Google Scholar
Digital Library
- Joshua Reich, Michel Goraczko, Aman Kansal, and Jitendra Padhye. 2010. Sleepless in Seattle no longer. In 2010 USENIX Annual Technical Conference. Google Scholar
Digital Library
- T. Richardson, Q. Stafford-Fraser, K.R. Wood, and A. Hopper. 1998. Virtual network computing. IEEE Internet Computing 2, 1 (Jan/Feb. 1998). Google Scholar
Digital Library
- Michiel Ronsse, Koen De Bosschere, Mark Christiaens, Jacques Chassin de Kergommeaux, and Dieter Kranzlmüller. 2003. Record/Replay for nondeterministic program executions. Communications of the ACM 46, 9 (Sep. 2003), 62--67. Google Scholar
Digital Library
- Constantine P. Sapuntzakis, Ramesh Chandra, Ben Pfaff, Jim Chow, Monica S. Lam, and Mendel Rosenblum. 2002. Optimizing the migration of virtual computers. In 5th Symposium on Operating Systems Design and Implementation (OSDI’02). Google Scholar
Digital Library
- Brian K. Schmidt, Monica S. Lam, and J. Duane Northcutt. 1999. The interactive performance of SLIM: A stateless, thin-client architecture. In 17th ACM Symposium on Operating Systems Principles (SOSP’99). Google Scholar
Digital Library
- L. H. Seawright and R. A. MacKinnon. 1979. VM/370—A study of multiplicity and usefulness. IBM Systems Journal 18, 1 (Mar. 1979), 4--17. Google Scholar
Digital Library
- Siddhartha Sen, Jacob R. Lorch, Richard Hughes, Carlos Garcia Jurado Suarez, Brian Zill, Weverton Cordeiro, and Jitendra Padhye. 2012. Don’t lose sleep over availability: The GreenUp decentralized wakeup service. In 9th USENIX Symposium on Networked Systems Design and Implementation (NSDI’12). Google Scholar
Digital Library
- Eugene Shih, Paramvir Bahl, and Michael J. Sinclair. 2002. Wake on wireless: An event driven energy saving strategy for battery operated devices. In 8th Annual International Conference on Mobile Computing and Networking (MOBICOM’02). Google Scholar
Digital Library
- Jacob Sorber, Nilanjan Banerjee, Mark D. Corner, and Sami Rollins. 2005. Turducken: Hierarchical power management for mobile devices. In 3rd International Conference on Mobile Systems, Applications and Services (Mobisys’05). Google Scholar
Digital Library
- Ruben Spruijt. 2010. Local Storage for VDI Done Right--Part 1. Retrieved from http://www.brianmadden.com/blogs/rubenspruijt/archive/2010/11/27/vdi-and-storage-deep-impact.aspx.Google Scholar
- Etienne Le Sueur and Gernot Heiser. 2010. Dynamic voltage and frequency scaling: The laws of diminishing returns. In Workshop on Power Aware Computing and Systems (HotPower’10). Google Scholar
Digital Library
- SunSpider Benchmark. 2012. SunSpider 0.9.1 JavaScript Benchmark. Retrieved from http://www.webkit.org/perf/sunspider-0.9.1/sunspider-0.9.1/driver.html.Google Scholar
- Ajay Surie, H. Andrés Lagar-Cavilla, Eyal de Lara, and M. Satyanarayanan. 2008. Low-bandwidth VM migration via opportunistic replay. In 9th Workshop on Mobile Computing Systems and Applications (HotMobile’08). Google Scholar
Digital Library
- Petter Svärd, Benoit Hudzia, and Johan Tordsson. 2011. Evaluation of delta compression techniques for efficient live migration of large virtual machines. In ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’11). Google Scholar
Digital Library
- M. Theimer, K. Lantz, and D. Cheriton. 1985. Preemptable remote execution facilities for the v-system. In 10th Symposium on Operating System Principles (SOSP’85). Google Scholar
Digital Library
- Niraj Tolia, Zhikui Wang, Manish Marwah, Cullen Bash, Parthasarathy Ranganathan, and Xiaoyun Zhu. 2008. Delivering energy proportionality with non energy-proportional systems—optimizing the ensemble. In Workshop on Power Aware Computing and Systems (HotPower’08). Google Scholar
Digital Library
- Andrew Tucker and David Comay. 2004. Solaris zones: Operating system support for server consolidation. In 3rd Virtual Machine Research and Technology Symposium (VM’04), Works-In-Progress.Google Scholar
- U.S. Department of Energy. 2013. Enegy-Efficient Computer Use. http://energy.gov/energysaver/articles/energy-efficient-computer-use. (Jan 2013).Google Scholar
- U.S. Environmental Protection Agency. 2013. ENERGY STAR® Program Requirements for Computers. http://www.energystar.gov/ia/partners/product_specs/program_reqs/Computers_Program_Requirements.pdf. (Jan 2013).Google Scholar
- VMware, Inc. 2013. Virtual Desktop Infrastructure. Retrieved from http://www.vmware.com/pdf/virtual_ desktop_infrastructure_wp.pdf.Google Scholar
- C. A. Waldspurger. 2002. Memory resource management in VMWare ESX Server. In 5th Symposium on Operating Systems Design and Implementation (OSDI’02). Boston, MA. Google Scholar
Digital Library
- Andrew Warfield, Steven Hand, Keir Fraser, and Tim Deegan. 2005. Facilitating the development of soft devices. In USENIX Annual Technical Conference (USENIX ATC’05). Anaheim, CA, USA. Google Scholar
Digital Library
- Carrie A. Webber, Judy A. Robertson, Marla C. McWhinney, Richard E. Brown, Margaret J. Pinckard, and John F. Busch. 2006. After-hours power status of office equipment in the USA. Energy 31, 14 (Nov 2006), 2487--2502.Google Scholar
Cross Ref
- Mark Weiser, Brent Welch, Alan Demers, and Scott Shenker. 1994. Scheduling for reduced CPU energy. In Symposium on Operating Systems Design and Implementation (OSDI’94). Google Scholar
Digital Library
- Andrew Whitaker, Richard S. Cox, Marianne Shaw, and Steven D. Gribble. 2004. Constructing services with interposable virtual hardware. In 1st Symposium on Networked Systems Design and Implementation (NSDI’04). Google Scholar
Digital Library
- Timothy Wood, Prashant Shenoy, K. K. Ramakrishnan, and Jacobus Van der Merwe. 2011. CloudNet: Dynamic pooling of cloud resources by live WAN migration of virtual machines. In ACM SIGPLAN/SIGOPS International Conference on Virtual Execution Environments (VEE’11). Google Scholar
Digital Library
- Eric J. Wright, Eyal de Lara, and Ashvin Goel. 2011. Vision: The case for context-aware selective resume. In International Workshop on Mobile Cloud Computing and Services (MCS’11). Google Scholar
Digital Library
- Lei Xia, Jack Lange, and Peter Dinda. 2008. Towards virtual passthrough I/O on commodity devices. In 1st Workshop on I/O Virtualization (WIOV’08). Google Scholar
Digital Library
- Edward R. Zayas. 1987. Attacking the process migration bottleneck. In 11th ACM Symposium on Operating System Principles (SOSP’87). Google Scholar
Digital Library
- Heng Zeng, Carla S. Ellis, Alvin R. Lebeck, and Amin Vahdat. 2002. ECOSystem: Managing energy as a first class operating system resource. In 10th International Conference on Architectural Support for Programming Languages and Operating Systems (ASPLOS’02). Google Scholar
Digital Library
- Edwin Zhai, Gregory D. Cummings, and Yaozu Dong. 2008. Live migration with pass-through device for linux VM. In 1st Workshop on I/O Virtualization (WIOV’08).Google Scholar
- Songnian Zhou, Xiaohu Zheng, Jingwen Wang, and Pierre Delisle. 1993. Utopia: A load sharing facility for large, heterogeneous distributed computer systems. Software—Practice and Experience 23, 12 (Dec. 1993), 1305--1336. Google Scholar
Digital Library
Index Terms
Energy-Oriented Partial Desktop Virtual Machine Migration
Recommendations
Does Live Migration of Virtual Machines Cost Energy?
AINA '13: Proceedings of the 2013 IEEE 27th International Conference on Advanced Information Networking and ApplicationsLive migration, the process of moving a virtual machine (VM) interruption-free between physical hosts is a core concept in modern data centers. Power management strategies use live migration to consolidate services in a cluster environment and to switch ...
Correlation-based virtual machine migration in dynamic cloud environments
Virtual machine (VM) migration enables flexible and efficient resource management in modern data centers. Although various VM migration algorithms have been proposed to improve the utilization of physical resources in data centers, they generally focus ...






Comments