skip to main content
research-article

An Energy-Efficient and Reliable Storage Mechanism for Data-Intensive Academic Archive Systems

Published:20 March 2015Publication History
Skip Abstract Section

Abstract

Previous studies proposed energy-efficient solutions, such as multispeed disks and disk spin-down methods, to conserve power in their respective storage systems. However, in most cases, the authors did not analyze the reliability of their solutions. According to research conducted by Google and the IDEMA standard, frequently setting the disk status to standby mode will increase the disk’s Annual Failure Rate and reduce its lifespan. To resolve the issue, we propose an evaluation function called E3SaRC (Economic Evaluation of Energy Saving with Reliability Constraint), which considers the cost of hardware failure when applying energy-saving schemes. We also present an adaptive write cache mechanism called CacheRAID. The mechanism tries to mitigate the random access problems that implicitly exist in RAID techniques and thereby reduce the energy consumption of RAID disks. CacheRAID also addresses the issue of system reliability by applying a control mechanism to the spin-down algorithm. Our experimental results show that the CacheRAID storage system can reduce the power consumption of the conventional software RAID 5 system by 65% to 80%. Moreover, according to the E3SaRC measurement, the overall saved cost of CacheRAID is the largest among the systems that we compared.

References

  1. Ian F. Adams, Mark W. Storer, and Ethan L. Miller. 2012. Analysis of workload behavior in scientific and historical long-term data repositories. Trans. Storage 8, 2, Article 6 (May 2012), 27 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Tseng-Yi Chen, Hsiu-Lien Yeh, Hsin-Wen Wei, Mei-ju Sun, Tsan-sheng Hsu, and Wei-Kuan Shih. 2014. An effective monitoring framework and user interface design. Software: Practice and Experience (2014). DOI: http://dx.doi.org/10.1002/spe.2248Google ScholarGoogle Scholar
  3. Tseng-Yi Chen, Tsung-Tai Yeh, Hsin-Wen Wei, Yu-Xun Fang, Wei-Kuan Shih, and Tsan-sheng Hsu. 2012. CacheRAID: An efficient adaptive write cache policy to conserve RAID disk array energy. In Proceedings of the 2012 IEEE/ACM 5th International Conference on Utility and Cloud Computing (UCC’12). IEEE Computer Society, 117--124. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Dennis Colarelli and Dirk Grunwald. 2002. Massive arrays of idle disks for storage archives. In Proceedings of the 2002 ACM/IEEE Conference on Supercomputing (SC’02). IEEE Computer Society Press, 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Gerry Cole. 2000. Estimating Drive Reliability in Desktop Computers and Consumer Electronics. Segate Technical Report TP-338.1. Seagate Personal Storage Group, Longmont, Colorado.Google ScholarGoogle Scholar
  6. Seagate Corporation. 2014. Hard Drive Datasheet. Retrieved from http://www.seagate.com/www-content/productcontent/enterprise-hdd-fam/enterprisecapacity-3-5-hdd/constellation-es-4/en-us/docs/enterprise-capacity-3-5-hdd-v4-ds1791-3-1403us.pdf.Google ScholarGoogle Scholar
  7. Yuhui Deng. 2011. What is the future of disk drives, death or rebirth? ACM Comput. Surv. 43, 3, Article 23 (April 2011), 27 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. John F. Gantz, Christopher Chute, Alex Manfrediz, Stephen Minton, David Reinsel, Wolfgang Schlichting, and Anna Toncheva. 2008. An updated forecast of worldwide information growth through 2011. Retrieved March 2, 2005, from http://www.cs.rpi.edu/∼bermaf/2008-diverse-exploding-digital-universe.pdf.Google ScholarGoogle Scholar
  9. Satoshi Hikida, Hieu Hanh Le, and Haruo Yokota. 2012. A power saving storage method that considers individual disk rotation. In Proceedings of the 17th International Conference on Database Systems for Advanced Applications - Volume Part II (DASFAA’12). Springer-Verlag, 138--149. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. International Disk Drive Equipment & Materials Association (IDEMA). 1998. Specification of hard disk drive reliability. IDEMA Standard R2-98 (1998).Google ScholarGoogle Scholar
  11. IETF. 2000. Internet Small Computer Systems Interface. Retrieved from http://www.ietf.org/rfc/rfc3720.txt.Google ScholarGoogle Scholar
  12. Facebook Inc. 2012. Flashcache. Retrieved Dec. 9, 2013, from https://github.com/facebook/flashcache.Google ScholarGoogle Scholar
  13. SanDisk Inc. 2013. Specifications of SanDisk Extreme II SSD. Retrieved from http://www.sandisk.com/products/ssd/sata/extreme-ii/?capacity=480GB.Google ScholarGoogle Scholar
  14. IOzone. 2006. IOzone Filesystem Benchmark. Retrieved from http://www.iozone.org/.Google ScholarGoogle Scholar
  15. Nikolai Joukov and Josef Sipek. 2008. GreenFS: Making enterprise computers greener by protecting them better. SIGOPS Oper. Syst. Rev. 42, 4 (April 2008), 69--80. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Rini T. Kaushik and Milind Bhandarkar. 2010. GreenHDFS: Towards an energy-conserving, storage-efficient, hybrid hadoop compute cluster. In Proceedings of the 2010 International Conference on Power Aware Computing and Systems (HotPower’10). USENIX Association, 1--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. IXBT Labs. 2005. HDD diet: Power consumption and heat dissipation. Retrieved from http://ixbtlabs.com/articles2/storage/hddpower.html.Google ScholarGoogle Scholar
  18. Xiaozhou Li, Mark Lillibridge, and Mustafa Uysal. 2011. Reliability analysis of deduplicated and erasure-coded storage. SIGMETRICS Perform. Eval. Rev. 38, 3 (Jan. 2011), 4--9. Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. Dushyanth Narayanan, Austin Donnelly, and Antony Rowstron. 2008. Write off-loading: Practical power management for enterprise storage. Trans. Storage 4, 3, Article 10 (Nov. 2008), 23 pages. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. John Ousterhout, Parag Agrawal, David Erickson, Christos Kozyrakis, Jacob Leverich, David Mazières, Subhasish Mitra, Aravind Narayanan, Guru Parulkar, Mendel Rosenblum, Stephen M. Rumble, Eric Stratmann, and Ryan Stutsman. 2010. The case for RAMClouds: Scalable high-performance storage entirely in DRAM. SIGOPS Oper. Syst. Rev. 43, 4 (Jan. 2010), 92--105. Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Eduardo Pinheiro and Ricardo Bianchini. 2004. Energy conservation techniques for disk array-based servers. In Proceedings of the 18th Annual International Conference on Supercomputing (ICS’04). ACM, 68--78. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Eduardo Pinheiro, Wolf-Dietrich Weber, and Luiz André Barroso. 2007. Failure trends in a large disk drive population. In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST’07). USENIX Association, 2--2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  23. Bianca Schroeder and Garth A. Gibson. 2007. Disk failures in the real world: What does an MTTF of 1,000,000 hours mean to you? In Proceedings of the 5th USENIX Conference on File and Storage Technologies (FAST’07). USENIX Association, Article 1. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Academia Sinica. 2008. Taiwan e-Learning and Digital Archives Program. Retrieved from http://teldap.tw/en/index.html.Google ScholarGoogle Scholar
  25. Gokul Soundararajan, Vijayan Prabhakaran, Mahesh Balakrishnan, and Ted Wobber. 2010. Extending SSD lifetimes with disk-based write caches. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, 8--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Mark W. Storer, Kevin M. Greenan, Ethan L. Miller, and Kaladhar Voruganti. 2008. Pergamum: Replacing tape with energy efficient, reliable, disk-based archival storage. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). 1--16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. George W. Tyndall. 2010. Role of the head disk interface in HOD reliability. Retrieved from http://www.idema.org/wp-content/downloads/1921.pdf.Google ScholarGoogle Scholar
  28. Vijay Vasudevan, David G. Andersen, Michael Kaminsky, Jason Franklin, Michael A. Kozuch, Iulian Moraru, Padmanabhan Pillai, and Lawrence Tan. 2011. Challenges and opportunities for efficient computing with FAWN. SIGOPS Oper. Syst. Rev. 45, 1 (Feb. 2011), 34--44. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Akshat Verma, Ricardo Koller, Luis Useche, and Raju Rangaswami. 2010. SRCMap: Energy proportional storage using dynamic consolidation. In Proceedings of the 8th USENIX Conference on File and Storage Technologies (FAST’10). USENIX Association, 20--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. An-I Andy Wang, Geoff Kuenning, Peter Reiher, and Gerald Popek. 2006. The conquest file system: Better performance through a disk/persistent-RAM hybrid design. Trans. Storage 2, 3 (Aug. 2006), 309--348. Google ScholarGoogle ScholarDigital LibraryDigital Library
  31. Jun Wang, Huijun Zhu, and Dong Li. 2008. eRAID: Conserving energy in conventional disk-based RAID system. IEEE Trans. Comput. 57, 3 (March 2008), 359--374. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Charles Weddle, Mathew Oldham, Jin Qian, An-I Andy Wang, Peter Reiher, and Geoff Kuenning. 2007. PARAID: A gear-shifting power-aware RAID. Trans. Storage 3, 3, Article 13 (Oct. 2007). Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Li Xiao, Tan Yu-An, and Sun Zhizhuo. 2011. Semi-RAID: A reliable energy-aware RAID data layout for sequential data access. In Proceedings of the 2011 IEEE 27th Symposium on Mass Storage Systems and Technologies (MSST’11). IEEE Computer Society, 1--11. Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. Tao Xie. 2008. SEA: A striping-based energy-aware strategy for data placement in RAID-structured storage systems. IEEE Trans. Comput. 57, 6 (June 2008), 748--761. Google ScholarGoogle ScholarDigital LibraryDigital Library
  35. Tao Xie and Yao Sun. 2011. Understanding the relationship between energy conservation and reliability in parallel disk arrays. J. Parallel Distrib. Comput. 71, 2 (Feb. 2011), 198--210. Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Xin Xu, Kayo Teramoto, Allan Morales, and H. Howie Huang. 2013. DUAL: Reliability-aware power management in data centers. In Proceedings of the 2013 13th IEEE/ACM International Symposium on Cluster, Cloud and Grid Computing (CCGrid’13). IEEE Computer Society, 530--537.Google ScholarGoogle Scholar
  37. Tsung-Tai Yeh, Hsin-Wen Wei, Shin-Hao Liu, Pei-Chi Huang, Tsan sheng Hsu, and Yen-Chiu Chen. 2010. The development of digital archives management tools for iRODS. In Proceedings iRODS User Group Meeting. Retrieved from http://wiki.irods.org/index.php/iRODS_User_Meetings.Google ScholarGoogle Scholar
  38. Shu Yin, Xiaojun Ruan, A. Manzanares, and Xiao Qin. 2009. How reliable are parallel disk systems when energy-saving schemes are involved? In Proceedings of the IEEE International Conference on Cluster Computing and Workshops, 2009 (CLUSTER’09). IEEE Computer Society, 1--9.Google ScholarGoogle Scholar
  39. Qingbo Zhu, Zhifeng Chen, Lin Tan, Yuanyuan Zhou, Kimberly Keeton, and John Wilkes. 2005. Hibernator: Helping disk arrays sleep through the winter. SIGOPS Oper. Syst. Rev. 39, 5 (Oct. 2005), 177--190. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Qingbo Zhu, Francis M. David, Christo F. Devaraj, Zhenmin Li, Yuanyuan Zhou, and Pei Cao. 2004. Reducing energy consumption of disk storage using power-aware cache management. In Proceedings of the 10th International Symposium on High Performance Computer Architecture (HPCA’04). IEEE Computer Society, 118--118. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. An Energy-Efficient and Reliable Storage Mechanism for Data-Intensive Academic Archive Systems

        Recommendations

        Comments

        Login options

        Check if you have access through your login credentials or your institution to get full access on this article.

        Sign in

        Full Access

        • Published in

          cover image ACM Transactions on Storage
          ACM Transactions on Storage  Volume 11, Issue 2
          March 2015
          123 pages
          ISSN:1553-3077
          EISSN:1553-3093
          DOI:10.1145/2747982
          • Editor:
          • Darrell Long
          Issue’s Table of Contents

          Copyright © 2015 ACM

          Publisher

          Association for Computing Machinery

          New York, NY, United States

          Publication History

          • Published: 20 March 2015
          • Accepted: 1 January 2015
          • Revised: 1 December 2014
          • Received: 1 April 2014
          Published in tos Volume 11, Issue 2

          Permissions

          Request permissions about this article.

          Request Permissions

          Check for updates

          Qualifiers

          • research-article
          • Research
          • Refereed

        PDF Format

        View or Download as a PDF file.

        PDF

        eReader

        View online with eReader.

        eReader
        About Cookies On This Site

        We use cookies to ensure that we give you the best experience on our website.

        Learn more

        Got it!