Abstract
A large amount of duplicate data typically exists across volumes of virtual machines in cloud computing infrastructures. Deduplication allows reclaiming these duplicates while improving the cost-effectiveness of large-scale multitenant infrastructures. However, traditional archival and backup deduplication systems impose prohibitive storage overhead for virtual machines hosting latency-sensitive applications. Primary deduplication systems reduce such penalty but rely on special cluster filesystems, centralized components, or restrictive workload assumptions. Also, some of these systems reduce storage overhead by confining deduplication to off-peak periods that may be scarce in a cloud environment.
We present DEDIS, a dependable and fully decentralized system that performs cluster-wide off-line deduplication of virtual machines’ primary volumes. DEDIS works on top of any unsophisticated storage backend, centralized or distributed, as long as it exports a basic shared block device interface. Also, DEDIS does not rely on data locality assumptions and incorporates novel optimizations for reducing deduplication overhead and increasing its reliability.
The evaluation of an open-source prototype shows that minimal I/O overhead is achievable even when deduplication and intensive storage I/O are executed simultaneously. Also, our design scales out and allows collocating DEDIS components and virtual machines in the same servers, thus, sparing the need of additional hardware.
- Rami Al-Rfou, Nikhil Patwardhan, and Phanindra Bhagavatula. 2010. Deduplication and Compression Benchmarking in Filebench. Technical Report.Google Scholar
- Darrell Anderson. 2002. Fstress: A Flexible Network File Service Benchmark. Technical Report. Duke University.Google Scholar
- Deepavali Bhagwat, Kave Eshghi, Darrell D. E. Long, and Mark Lillibridge. 2009. Extreme binning: Scalable, parallel deduplication for chunk-based file backup. In Proceedings of International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS).Google Scholar
Cross Ref
- William J. Bolosky, Scott Corbin, David Goebel, and John R. Douceur. 2000. Single instance storage in Windows 2000. In Proceedings of USENIX Windows System Symposium (WSS). Google Scholar
Digital Library
- Citrix Systems, Inc. 2014. Blktap documentation. Retrieved from http://wiki.xen.org/wiki/Blktap2.Google Scholar
- Austin T. Clements, Irfan Ahmad, Murali Vilayannur, and Jinyuan Li. 2009. Decentralized deduplication in SAN cluster file systems. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Russell Coker. 2015. Bonnie++ web page. Retrieved from http://www.coker.com.au/bonnie++/.Google Scholar
- D. Iacono. 2013. Enterprise storage: Efficient,virtualized and flash optimized. IDC White Paper.Google Scholar
- Biplob Debnath, Sudipta Sengupta, and Jin Li. 2010. Chunk stash: Speeding up inline storage deduplication using flash memory. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Wei Dong, Fred Douglis, Kai Li, Hugo Patterson, Sazzala Reddy, and Philip Shilane. 2011. Tradeoffs in scalable data routing for deduplication clusters. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- John R. Douceur, Atul Adya, William J. Bolosky, Dan Simon, and Marvin Theimer. 2002. Reclaiming Space from Duplicate Files in a Serverless Distributed File System. Technical Report MSR-TR-2002-30. Microsoft Research.Google Scholar
- Ahmed El-Shimi, Ran Kalach, Ankit Kumar, Adi Oltean, Jin Li, and Sudipta Sengupta. 2012. Primary data deduplication large scale study and system design. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- EMC. 2012. New Digital Universe Study Reveals Big Data Gap. http://www.emc.com/about/news/press/2012/20121211-01.htm. (2012).Google Scholar
- Davide Frey, Anne-Marie Kermarrec, and Konstantinos Kloudas. 2012. Probabilistic deduplication for cluster-based storage systems. In Proceedings of the Third ACM Symposium on Cloud Computing (SOCC). Google Scholar
Digital Library
- Yinjin Fu, Hong Jiang, and Nong Xiao. 2012. A scalable inline cluster deduplication framework for big data protection. In Proceedings of ACM/IFIP/USENIX International Middleware Conference. Google Scholar
Digital Library
- Fanglu Guo and Petros Efstathopoulos. 2011. Building a high-performance deduplication system. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- HP. 2011. Complete storage and data protection architecture for VMware vSphere. White Paper (2011).Google Scholar
- Bo Hong and Darrell D. E. Long. 2004. Duplicate data elimination in a san file system. In Proceedings of Conference on Mass Storage Systems (MSST).Google Scholar
- Keren Jin and Ethan L. Miller. 2009. The effectiveness of deduplication on virtual machine disk images. In Proceedings of International Systems and Storage Conference (SYSTOR). Google Scholar
Digital Library
- Jones, M. 2010. Virtio: An I/O virtualization framework for linux. IBM White Paper (2010).Google Scholar
- Michal Kaczmarczyk, Marcin Barczynski, Wojciech Kilian, and Cezary Dubnicki. 2012. Reducing impact of data fragmentation caused by in-line deduplication. In Proceedings of International Systems and Storage Conference (SYSTOR). Google Scholar
Digital Library
- Jürgen Kaiser, Dirk Meister, André Brinkmann, and Sascha Effert. 2012. Design of an exact data deduplication cluster. In Proceedings of Conference on Mass Storage Systems (MSST).Google Scholar
Cross Ref
- Jeffrey Katcher. 1997. PostMark: A New File System Benchmark. Technical Report. NetApp.Google Scholar
- Ricardo Koller and Raju Rangaswami. 2010a. I/O deduplication: Utilizing content similarity to improve I/O performance. ACM Transactions on Storage 6, 3 (Sept. 2010), 13:1--13:26. Google Scholar
Digital Library
- Ricardo Koller and Raju Rangaswami. 2010b. I/O deduplication: Utilizing content similarity to improve I/O performance. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- Lessfs. 2014. Lessfs page. Retrieved from http://www.lessfs.com/wordpress/.Google Scholar
- Yan-Kit Li, Min Xu, Chun-Ho Ng, and Patrick P. C. Lee. 2014. Efficient hybrid inline and out-of-line deduplication for backup storage. Trans. Storage 11, 1 (2014), 2:1--2:21. Google Scholar
Digital Library
- Anthony Liguori and Eric Van Hensbergen. 2008. Experiences with content addressable storage and virtual disks. In Proceedings of USENIX Workshop on I/O Virtualization (WIOV). Google Scholar
Digital Library
- Mark Lillibridge, Kave Eshghi, Deepavali Bhagwat, Vinay Deolalikar, Greg Trezise, and Peter Camble. 2009. Sparse indexing: Large scale, inline deduplication using sampling and locality. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- D. Meister and A. Brinkmann. 2010. dedupv1: Improving deduplication throughput using solid state drives (SSD). In Proceedings of Conference on Mass Storage Systems (MSST). Google Scholar
Digital Library
- Dutch T. Meyer, Gitika Aggarwal, Brendan Cully, Geoffrey Lefebvre, Michael J. Feeley, Norman C. Hutchinson, and Andrew Warfield. 2008. Parallax: Virtual disks for virtual machines. In Proceedings of European Conference on Computer Systems (EuroSys). Google Scholar
Digital Library
- Dutch T. Meyer and William J. Bolosky. 2011. A study of practical deduplication. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- Dutch T. Meyer and William J. Bolosky. 2012. A study of practical deduplication. ACM Transactions on Storage 7, 4 (2012), 14:1--14:20. Google Scholar
Digital Library
- Chun-Ho Ng, Mingcao Ma, Tsz-Yeung Wong, Patrick P. C. Lee, and John C. S. Lui. 2011. Live deduplication storage of virtual machine images in an open-source cloud. In Proceedings of ACM/IFIP/USENIX International Middleware Conference. Google Scholar
Digital Library
- William Norcott. 2015. IOzone web page. Retrieved from http://www.iozone.org/.Google Scholar
- Michael A. Olson, Keith Bostic, and Margo Seltzer. 1999. Berkeley DB. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Opendedup. 2014. Opendedup web page. Retrieved from http://opendedup.org.Google Scholar
- OpenSolaris. 2014. ZFS documentation. Retrieved from http://www.freebsd.org/doc/en/books/handbook/filesystems-zfs.html.Google Scholar
- OpenStack Foundation. 2014. OpenStack web page. Retrieved from https://www.openstack.org.Google Scholar
- OpenStack Foundation. 2016. Cinder documentation. Retrieved from http://docs.openstack.org/developer/cinder/.Google Scholar
- T. Ozawa and M. Kazutaka. 2014. ACCORD web page. Retrieved from http://www.osrg.net/accord/.Google Scholar
- Joao Paulo and Jose Pereira. 2011. Model checking a decentralized storage deduplication protocol. In Fast Abstract in Latin-American Symposium on Dependable Computing.Google Scholar
- J. Paulo and J. Pereira. 2014a. Distributed exact deduplication for primary storage infrastructures. In Distributed Applications and Interoperable Systems. Google Scholar
Digital Library
- João Paulo and José Pereira. 2014b. A survey and classification of storage deduplication systems. Comput. Surveys 47, 1 (2014), 11:1--11:30. Google Scholar
Digital Library
- J. Paulo, P. Reis, J. Pereira, and A. Sousa. 2012. DEDISbench: A benchmark for deduplicated storage systems. In Proceedings of International Symposium on Secure Virtual Infrastructures (DOA-SVI).Google Scholar
- J. Paulo, P. Reis, J. Pereira, and A. Sousa. 2013. Towards an accurate evaluation of deduplicated storage systems. International Journal of Computer Systems Science and Engineering 29, 1, 1:73--1:83.Google Scholar
- Sean Quinlan and Sean Dorward. 2002. Venti: A new approach to archival storage. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- Sean Rhea, Russ Cox, and Alex Pesterev. 2008. Fast, inexpensive content-addressed storage in foundation. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Rusty Russell. 2008. Virtio: Towards a de-facto standard for virtual I/O devices. SIGOPS Operating Systems Review 42, 5 (2008), 95--103. Google Scholar
Digital Library
- Philip Shilane, Grant Wallace, Mark Huang, and Windsor Hsu. 2012. Delta compressed and deduplicated storage using stream-informed locality. In Proceedings of USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage). Google Scholar
Digital Library
- Kiran Srinivasan, Tim Bisson, Garth Goodson, and Kaladhar Voruganti. 2012. iDedup: Latency-aware, inline data deduplication for primary storage. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- Vasily Tarasov, Amar Mudrankit, Will Buik, Philip Shilane, Geoff Kuenning, and Erez Zadok. 2012. Generating realistic datasets for deduplication analysis. In Poster Session of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Y. Tsuchiya and T. Watanabe. 2011. DBLK: Deduplication for primary block storage. In Proceedings of Conference on Mass Storage Systems (MSST). Google Scholar
Digital Library
- Cristian Ungureanu, Benjamin Atkin, Akshat Aranya, Salil Gokhale, Stephen Rago, Grzegorz Calkowski, Cezary Dubnicki, and Aniruddha Bohra. 2010. HydraFS: A high-throughput file system for the HYDRAstor content-addressable storage system. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
- Jiansheng Wei, Hong Jiang, Ke Zhou, and Dan Feng. 2010. MAD2: A scalable high-throughput exact deduplication approach for network backup services. In Proceedings of Conference on Mass Storage Systems (MSST). Google Scholar
Digital Library
- Avani Wildani, Ethan L. Miller, and Ohad Rodeh. 2013. HANDS: A heuristically arranged non-backup in-line deduplication system. In Proceedings of the International Conference on Data Engineering (ICDE). Google Scholar
Digital Library
- Wen Xia, Hong Jiang, Dan Feng, and Yu Hua. 2011. SiLo: A similarity-locality based near-exact deduplication scheme with low RAM overhead and high throughput. In Proceedings of USENIX Annual Technical Conference (ATC). Google Scholar
Digital Library
- Tianming Yang, Hong Jiang, Dan Feng, Zhongying Niu, Ke Zhou, and Yaping Wan. 2010. DEBAR: A scalable high-performance de-duplication storage system for backup and archiving. In Proceedings of International Parallel & Distributed Processing Symposium (IPDPS).Google Scholar
Cross Ref
- Lawrence L. You, Kristal T. Pollack, and Darrell D. E. Long. 2005. Deep store: An archival storage system architecture. In Proceedings of International Conference on Data Engineering (ICDE). Google Scholar
Digital Library
- Benjamin Zhu, Kai Li, and Hugo Patterson. 2008. Avoiding the disk bottleneck in the data domain deduplication file system. In Proceedings of USENIX Conference on File and Storage Technologies (FAST). Google Scholar
Digital Library
Index Terms
(auto-classified)Efficient Deduplication in a Distributed Primary Storage Infrastructure
Recommendations
Distributed Exact Deduplication for Primary Storage Infrastructures
Proceedings of the 14th IFIP WG 6.1 International Conference on Distributed Applications and Interoperable Systems - Volume 8460Deduplication of primary storage volumes in a cloud computing environment is increasingly desirable, as the resulting space savings contribute to the cost effectiveness of a large scale multi-tenant infrastructure. However, traditional archival and ...
Live deduplication storage of virtual machine images in an open-source cloud
Middleware'11: Proceedings of the 12th ACM/IFIP/USENIX international conference on MiddlewareDeduplication is an approach of avoiding storing data blocks with identical content, and has been shown to effectively reduce the disk space for storing multi-gigabyte virtual machine (VM) images. However, it remains challenging to deploy deduplication ...
Live deduplication storage of virtual machine images in an open-source cloud
Middleware '11: Proceedings of the 12th International Middleware ConferenceDeduplication is an approach of avoiding storing data blocks with identical content, and has been shown to effectively reduce the disk space for storing multi-gigabyte virtual machine (VM) images. However, it remains challenging to deploy deduplication ...






Comments