The Xen-Blanket: virtualize once, run everywhere

ABSTRACT

Current Infrastructure as a Service (IaaS) clouds operate in isolation from each other. Slight variations in the virtual machine (VM) abstractions or underlying hypervisor services prevent unified access and control across clouds. While standardization efforts aim to address these issues, they will take years to be agreed upon and adopted, if ever. Instead of standardization, which is by definition provider-centric, we advocate a user-centric approach that gives users an unprecedented level of control over the virtualization layer. We introduce the Xen-Blanket, a thin, immediately deployable virtualization layer that can homogenize today's diverse cloud infrastructures. We have deployed the Xen-Blanket across Amazon's EC2, an enterprise cloud, and a private setup at Cornell University. We show that a user-centric approach to homogenize clouds can achieve similar performance to a paravirtualized environment while enabling previously impossible tasks like cross-provider live migration. The Xen-Blanket also allows users to exploit resource management opportunities like oversubscription, and ultimately can reduce costs for users.

References

1. OpenStack. http://www.openstack.org/, Oct. 2010.
2. M. Ben-Yehuda, M. D. Day, Z. Dubitzky, M. Factor, N. Har'El, A. Gordon, A. Liguori, O. Wasserman, and B.-A. Yassour. The turtles project: Design and implementation of nested virtualization. In Proc. of USENIX OSDI, Vancouver, BC, Canada, Oct. 2010.
3. O. Berghmans. Nesting virtual machines in virtualization test frameworks. Master's thesis, University of Antwerp, May 2010.
4. B. N. Bershad, S. Savage, P. Pardyak, E. G. Sirer, M. E. Fiuczynski, D. Becker, C. Chambers, and S. Eggers. Extensibility, safety and performance in the SPIN operating system. In Proc. of ACM SOSP, Copper Mountain, CO, Dec. 1995.
5. R. Bradford, E. Kotsovinos, A. Feldmann, and H. Schiöberg. Live wide-area migration of virtual machines including local persistent state. In Proc. of ACM VEE, San Diego, CA, June 2007.
6. R. Campbell, I. Gupta, M. Heath, S. Y. Ko, M. Kozuch, M. Kunze, T. Kwan, K. Lai, H. Y. Lee, M. Lyons, D. Milojicic, D. O'Hallaron, and Y. C. Soh. Open cirrus cloud computing testbed: federated data centers for open source systems and services research. In Proc. of USENIX HotCloud, San Diego, CA, June 2009.
7. N. Chohan, C. Bunch, S. Pang, C. Krintz, N. Mostafa, S. Soman, and R. Wolski. Appscale: Scalable and open appengine application development and deployment. In Proc. of ICST CLOUDCOMP, Munich, Germany, Oct. 2009.
8. C. Clark, K. Fraser, S. Hand, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live migration of virtual machines. In Proc. of USENIX NSDI, Boston, MA, May 2005.
9. T. Clark. Rightscale. http://www.rightscale.com, 2010.
10. B. Cully, G. Lefebvre, D. Meyer, M. Feeley, N. Hutchinson, and A. Warfield. Remus: high availability via asynchronous virtual machine replication. In Proc. of USENIX NSDI, San Francisco, CA, Apr. 2008.
11. Distributed Management Task Force, Inc. (DMTF). Open virtualization format white paper version 1.00. http://http://www.dmtf.org/sites/default/files/standards/documents/DSP2017_1.0.0.pdf, Feb. 2009.
12. G. W. Dunlap, S. T. King, S. Cinar, M. A. Basrai, and P. M. Chen. ReVirt: Enabling intrusion analysis through virtual-machine logging and replay. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
13. D. R. Engler, M. F. Kaashoek, and J. W. O'Toole. Exokernel: An operating system architecture for application-level resource management. In Proc. of ACM SOSP, Copper Mountain, CO, Dec. 1995.
14. Eucalyptus Systems, Inc. Eucalyptus open-source cloud computing infrastructure - an overview. http://www.eucalyptus.com/pdf/whitepapers/Eucalyptus_Overview.pdf, Aug. 2009.
15. A. Graf and J. Roedel. Nesting the virtualized world. In Linux Plumbers Conference, Portland, OR, Sept. 2009.
16. D. Gupta, S. Lee, M. Vrable, S. Savage, A. C. Snoeren, G. Varghese, G. M. Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. In Proc. of USENIX OSDI, San Diego, CA, Dec. 2008.
17. E. M. Maximilien, A. Ranabahu, R. Engehausen, and L. C. Anderson. IBM altocumulus: a cross-cloud middleware and platform. In Proc. of ACM OOPSLA Conf., Orlando, FL, Oct. 2009.
18. M. Nelson, B.-H. Lim, and G. Hutchins. Fast transparent migration for virtual machines. In Proc. of USENIX Annual Technical Conf., Anaheim, CA, Apr. 2005.
19. , and Tofetti}rochwerger-reservoirB. Rochwerger, D. Breitgand, A. Epstein, D. Hadas, I. Loy, K. Nagin, J. Tordsson, C. Ragusa, M. Villari, S. Clayman, E. Levy, A. Maraschini, P. Massonet, H. Munoz, and G. Tofetti. Reservoir - when one cloud is not enough. IEEE Computer, 44 (3): 44--51, 2011.
20. V. Shrivastava, P. Zerfos, K. won Lee, H. Jamjoom, Y.-H. Liu, and S. Banerjee. Application-aware virtual machine migration in data centers. In Proc. of IEEE INFOCOM Mini-conference, Shanghai, China, Apr. 2011.
21. J. Sugerman, G. Venkitachalam, and B.-H. Lim. Virtualizing I/O devices on VMware workstation's hosted virtual machine monitor. In Proc. of USENIX Annual Technical Conf., Boston, MA, June 2001.
22. VMware. "VMware vsphere, the first cloud operating system, provides an evolutionary, non-disruptive path to cloud computing". http://www.vmware.com/files/pdf/cloud/VMW_09Q2_WP_Cloud_OS_P8_R1.pdf, 2009.
23. C. A. Waldspurger. Memory resource management in VMware ESX server. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
24. D. Wentzlaff, C. Gruenwald, III, N. Beckmann, K. Modzelewski, A. Belay, L. Youseff, J. Miller, and A. Agarwal. An operating system for multicore and clouds: mechanisms and implementation. In Proc. of ACM SoCC, Indianapolis, IN, June 2010.
25. A. Whitaker, M. Shaw, and S. D. Gribble. Scale and performance in the Denali isolation kernel. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
26. B. White, J. Lepreau, L. Stoller, R. Ricci, S. Guruprasad, M. Newbold, M. Hibler, C. Barb, and A. Joglekar. An integrated experimental environment for distributed systems and networks. In Proc. of USENIX OSDI, Boston, MA, Dec. 2002.
27. D. Williams, E. Elnikety, M. Eldehiry, H. Jamjoom, H. Huang, and H. Weatherspoon. Unshackle the cloud! In Proc. of USENIX HotCloud, Portland, OR, June 2011.
28. D. Williams, H. Jamjoom, Y.-H. Liu, and H. Weatherspoon. Overdriver: Handling memory overload in an oversubscribed cloud. In Proc. of ACM VEE, Newport Beach, CA, Mar. 2011.
29. T. Wood, G. Tarasuk-Levin, P. Shenoy, P. Desnoyers, E. Cecchet, and M. D. Corner. Memory buddies: Exploiting page sharing for smart colocation in virtualized data centers. In Proc. of ACM VEE, Washington, DC, Mar. 2009.
30. F. Zhang, J. Chen, H. Chen, and B. Zang. CloudVisor: Retrofitting protection of virtual machines in multi-tenant cloud with nested virtualization. In Proc. of ACM SOSP, Cascais, Portugal, Oct. 2011.

Index Terms

• Software and its engineering

  • Software creation and management

    • Designing software

  • Software organization and properties

    • Contextual software domains

      • Operating systems