skip to main content
research-article

Introspection-based memory de-duplication and migration

Authors Info & Claims
Published:16 March 2013Publication History
Skip Abstract Section

Abstract

Memory virtualization abstracts a physical machine's memory resource and presents to the virtual machines running on it a piece of physical memory that could be shared, compressed and moved. To optimize the memory resource utilization by fully leveraging the flexibility afforded by memory virtualization, it is essential that the hypervisor have some sense of how the guest VMs use their allocated physical memory. One way to do this is virtual machine introspection (VMI), which interprets byte values in a guest memory space into semantically meaningful data structures. However, identifying a guest VM's memory usage information such as free memory pool is non-trivial. This paper describes a bootstrapping VM introspection technique that could accurately extract free memory pool information from multiple versions of Windows and Linux without kernel version-specific hard-coding, how to apply this technique to improve the efficiency of memory de-duplication and memory state migration, and the resulting improvement in memory de-duplication speed, gain in additional memory pages de-duplicated, and reduction in traffic loads associated with memory state migration.

References

  1. Mac developer library, technical note tn2118, kernel core dumps. http://developer.apple.com/library/mac/#technotes/tn2004/tn2118.html.Google ScholarGoogle Scholar
  2. Amazon ec2. amazon's web service for virtual machine privision. http://aws.amazon.com/ec2/.Google ScholarGoogle Scholar
  3. Crash, linux crash dump analysis tool. http://people.redhat.com/anderson/.Google ScholarGoogle Scholar
  4. Microsoft debug interface access sdk. http://msdn.microsoft.com/en-us/library/x93ctkx8.aspx.Google ScholarGoogle Scholar
  5. Specjbb2005. http://www.spec.org/jbb2005/,natexlaba.Google ScholarGoogle Scholar
  6. Specweb2009. http://www.spec.org/web2009/,natexlabb.Google ScholarGoogle Scholar
  7. Sysmark2007. http://www.bapco.com/products/sysmark2007preview/.Google ScholarGoogle Scholar
  8. Microsoft portable executable and common object file format specification. ReVision, page 97, 2010.Google ScholarGoogle Scholar
  9. A. Arcangeli, I. Eidus, and C. Wright. Increasing memory density by using KSM, pages 19--28. Linux Symposium, 2009.Google ScholarGoogle Scholar
  10. R. Bryant, A. Tumanov, O. Irzak, A. Scannell, K. Joshi, M. Hiltunen, A. Lagar-Cavilla, and E. de Lara. Kaleidoscope: cloud micro-elasticity via vm state coloring. EuroSys '11, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. C. Clark, K. Fraser, S. H, J. G. Hansen, E. Jul, C. Limpach, I. Pratt, and A. Warfield. Live Migration of Virtual Machines. In NSDI, 2005. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. B. Dolan-Gavitt, T. Leek, M. Zhivich, J. Giffin, and W. Lee. Virtuoso: Narrowing the semantic gap in virtual machine introspection. SP '11, pages 297--312, 2011. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. T. Garfinkel and M. Rosenblum. A virtual machine introspection based architecture for intrusion detection. In NDSS, 2003.Google ScholarGoogle Scholar
  14. D. Gupta, S. Lee, M. Vrable, S. Savage, A. C. Snoeren, G. Varghese, G. M. Voelker, and A. Vahdat. Difference engine: Harnessing memory redundancy in virtual machines. OSDI '08, 2008. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. D. Magenheimer. Transcendent Memory on Xen, page 3. XenSummit, February 2009.Google ScholarGoogle Scholar
  16. D. G. Murray, S. H, and M. A. Fetterman. Satori: Enlightened page sharing. ATEC '09, 2009.Google ScholarGoogle Scholar
  17. B. D. Payne, M. D. P. D. A. Carbone, and W. Lee. Secure and flexible monitoring of virtual machines. ACSAC 2007, 2007.Google ScholarGoogle ScholarCross RefCross Ref
  18. M. Russinovich, D. A. Solomon, and A. Ionescu. Microsoft Windows Internals: Including Windows Server 2008 and Windows Vista, 5th Edition. Microsoft Press, Redmond, WA, USA, 2009. ISBN 0735625301. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. M. Russinovich, D. A. Solomon, and A. Ionescu. Windows Internals: Covering Windows Server 2008 R2 and Windows 7. Microsoft Press, Redmond, WA, USA, 2011. ISBN 0735648735. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. M. E. Russinovich and D. A. Solomon. Microsoft Windows Internals, 4th Edition: Microsoft Windows Server 2003, Windows XP, and Windows 2000. Microsoft Press, Redmond, WA, USA, 2004. ISBN 0735619174. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. M. Schwidefsky, R. Mansell, D. Osisek, H. Franke, H. Raj, and J. H. Choi. Collaborative memory management in hosted linux environments. In OLS06, pages 313--331, 2006.Google ScholarGoogle Scholar
  22. C. A. Waldspurger. Memory resource management in vmware esx server. SIGOPS Oper. Syst. Rev., 36: 181--194, 2002. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Introspection-based memory de-duplication and migration

Recommendations

Comments

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Sign in

Full Access

  • Published in

    cover image ACM SIGPLAN Notices
    ACM SIGPLAN Notices  Volume 48, Issue 7
    VEE '13
    July 2013
    194 pages
    ISSN:0362-1340
    EISSN:1558-1160
    DOI:10.1145/2517326
    Issue’s Table of Contents
    • cover image ACM Conferences
      VEE '13: Proceedings of the 9th ACM SIGPLAN/SIGOPS international conference on Virtual execution environments
      March 2013
      210 pages
      ISBN:9781450312660
      DOI:10.1145/2451512

    Copyright © 2013 ACM

    Publisher

    Association for Computing Machinery

    New York, NY, United States

    Publication History

    • Published: 16 March 2013

    Check for updates

    Qualifiers

    • research-article

PDF Format

View or Download as a PDF file.

PDF

eReader

View online with eReader.

eReader
About Cookies On This Site

We use cookies to ensure that we give you the best experience on our website.

Learn more

Got it!