skip to main content
research-article

ZoneTier: A Zone-based Storage Tiering and Caching Co-design to Integrate SSDs with SMR Drives

Authors Info & Claims
Published:10 July 2019Publication History
Skip Abstract Section

Abstract

Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zone-based storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.

References

  1. Mark Abashkin, Assaf Natanzon, and Eitan Bachmat. 2015. Integrated caching and tiering according to use and QoS requirements. In Proceedings of the 34th International Performance on Computing and Communications Conference (IPCCC’15). IEEE, 1--8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Abutalib Aghayev, Mansour Shafaei, and Peter Desnoyers. 2015. Skylight: A window on shingled disk operation. ACM Trans. Storage 11, 4 (2015), 16. Google ScholarGoogle ScholarDigital LibraryDigital Library
  3. Abutalib Aghayev, Theodore Ts’o, Garth Gibson, and Peter Desnoyers. 2017. Evolving Ext4 for shingled disks. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, 105--120. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Trevor Blackwell, Jeffrey Harris, and Margo I. Seltzer. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of the USENIX Technical Conference on Unix and Advanced Computing Systems, New Orleans, Louisiana. 23--23. Google ScholarGoogle ScholarDigital LibraryDigital Library
  5. Feng Chen, David A. Koufaty, and Xiaodong Zhang. 2011. Hystor: Making the best use of solid-state drives in high performance storage systems. In Proceedings of the International Conference on Supercomputing. ACM, 22--32. Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. INCITS T10 Technical Committee. {n.d.}. Information Technology—Zoned Block Commands-2 (ZBC-2). Retrieved from https://standards.incits.org/apps/group_public/project/details.php?project_id=487.Google ScholarGoogle Scholar
  7. INCITS T13 Technical Committee. {n.d.}. Information Technology—Zoned Device ATA Command Set-2 (ZAC-2). Retrieved from https://standards.incits.org/apps/group_public/project/details.php?project_id=447.Google ScholarGoogle Scholar
  8. Tim Feldman and Garth Gibson. 2013. Shingled magnetic recording areal density increase requires new data management. login: USENIX Mag. 38, 3 (2013).Google ScholarGoogle Scholar
  9. Jorge Guerra, Himabindu Pucha, Joseph S. Glider, Wendy Belluomini, and Raju Rangaswami. 2011. Cost effective storage using extent-based dynamic tiering. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’11), Vol. 11. 20--20. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Alireza Haghdoost, Weiping He, Jerry Fredin, and David H. C. Du. 2017. On the accuracy and scalability of intensive I/O workload replay. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, Santa Clara, CA, 315--328. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Shinichi Hayashi and Norihisa Komoda. 2013. Evaluation of SSD tier method and SSD cache method in tiered storage system. In Proceedings of the Technical Meeting on “Information Systems,” IEE Japan (IS’13). 51--56.Google ScholarGoogle Scholar
  12. Weiping He and David H. C. Du. 2017. SMaRT: An approach to shingled magnetic recording translation. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, Santa Clara, CA, 121--134. Google ScholarGoogle ScholarDigital LibraryDigital Library
  13. Western Digital hgst. {n.d.}. Libzbc: ZBC Device Manipulation Library. Retrieved from https://github.com/hgst/libzbc.Google ScholarGoogle Scholar
  14. Sai Huang, Qingsong Wei, Dan Feng, Jianxi Chen, and Cheng Chen. 2016. Improving flash-based disk cache with lazy adaptive replacement. ACM Trans. Storage 12, 2 (2016), 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Song Jiang and Xiaodong Zhang. 2002. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. ACM SIGMETRICS Perform. Eval. Rev. 30, 1 (2002), 31--42. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 30th Symposium on Mass Storage Systems and Technologies (MSST’14). IEEE, 1--6.Google ScholarGoogle ScholarCross RefCross Ref
  17. Stephanie N. Jones, Ahmed Amer, Ethan L. Miller, Darrell D. E. Long, Rekha Pitchumani, and Christina R. Strong. 2016. Classifying data to reduce long-term data movement in shingled write disks. ACM Trans. Storage 12, 1 (2016), 2. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Linux Kernel. {n.d.}. Libaio: Linux Kernel AIO Access Library.Google ScholarGoogle Scholar
  19. Hyojun Kim, Sangeetha Seshadri, Clement L. Dickey, and Lawrence Chiu. 2014. Evaluating phase change memory for enterprise storage systems: A study of caching and tiering approaches. ACM Trans. Storage 10, 4 (2014), 15. Google ScholarGoogle ScholarDigital LibraryDigital Library
  20. Cheng Li, Philip Shilane, Fred Douglis, Darren Sawyer, and Hyong Shim. 2014. Assert (! defined (sequential I/O)). In Proceedings of the USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’14). Google ScholarGoogle ScholarDigital LibraryDigital Library
  21. Cheng Li, Philip Shilane, Fred Douglis, Hyong Shim, Stephen Smaldone, and Grant Wallace. 2014. Nitro: A capacity-optimized SSD cache for primary storage. In Proceedings of the USENIX Annual Technical Conference. 501--512. Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. Peter Macko, Xiongzi Ge, John Haskins Jr., James Kelley, David Slik, Keith A. Smith, and Maxim G. Smith. 2017. SMORE: A cold data object store for SMR drives. In Proceedings of the 34th Symposium on Mass Storage Systems and Technologies (MSST’17). IEEE.Google ScholarGoogle Scholar
  23. Adam Manzanares, Noah Watkins, Cyril Guyot, Damien LeMoal, Carlos Maltzahn, and Zvonimr Bandic. 2016. ZEA, a data management approach for SMR. In Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’16). USENIX Association. Google ScholarGoogle ScholarDigital LibraryDigital Library
  24. Nimrod Megiddo and Dharmendra S. Modha. 2003. ARC: A self-tuning, low overhead replacement cache. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’03), vol. 3. 115--130. Google ScholarGoogle ScholarDigital LibraryDigital Library
  25. Michael Mesnier, Feng Chen, Tian Luo, and Jason B. Akers. 2011. Differentiated storage services. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles. ACM, 57--70. Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Microsoft. {n.d.}. ReFS Overview. Retrieved from https://docs.microsoft.com/en-us/windows-server/storage/refs/refs-overview.Google ScholarGoogle Scholar
  27. Yuanjiang Ni, Ji Jiang, Dejun Jiang, Xiaosong Ma, Jin Xiong, and Yuangang Wang. 2016. S-RAC: SSD friendly caching for data center workloads. In Proceedings of the 9th ACM International on Systems and Storage Conference. ACM, 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Kazuichi Oe, Takeshi Nanri, and Koji Okamura. 2015. On-the-fly automated storage tiering with caching and both proactive and observational migration. In Proceedings of the 23rd International Symposium on Computing and Networking (CANDAR’15). IEEE, 371--377. Google ScholarGoogle ScholarDigital LibraryDigital Library
  29. Kazuichi Oe and Koji Okamura. 2014. A hybrid storage system composed of on-the-fly automated storage tiering (OTF-AST) and caching. In Proceedings of the 2nd International Symposium on Computing and Networking (CANDAR’14). IEEE, 406--411. Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Dongchul Park, Chung-I Lin, and David H. C. Du. 2012. H-SWD: A novel shingled write disk scheme based on hot and cold data identification. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST’12).Google ScholarGoogle Scholar
  31. Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst. 10, 1 (1992), 26--52. Google ScholarGoogle ScholarDigital LibraryDigital Library
  32. Mohit Saxena, Michael M. Swift, and Yiying Zhang. 2012. FlashTier: A lightweight, consistent and durable storage cache. In Proceedings of the 7th ACM European Conference on Computer Systems. ACM, 267--280. Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Anand Suresh, Garth Gibson, and Greg Ganger. 2012. Shingled magnetic recording for big data applications. Carnegie Mellon University Parallel Data Lab Technical Report CMU-PD L-12--105.Google ScholarGoogle Scholar
  34. Chunling Wang, Dandan Wang, Yupeng Chai, Chuanwen Wang, and Diansen Sun. 2017. Larger, cheaper, but faster: SSD-SMR hybrid storage boosted by a New SMR-oriented cache framework. In Proceedings of the 34th Symposium on Mass Storage Systems and Technologies (MSST’17). IEEE, 1--11.Google ScholarGoogle Scholar
  35. Fenggang Wu, Ziqi Fan, Ming-Chang Yang, Baoquan Zhang, Xiongzi Ge, and David H. C. Du. 2017. Performance evaluation of host aware shingled magnetic recording (HA-SMR) drives. IEEE Trans. Comput. 66, 11 (2017), 1932--1945.Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Fenggang Wu, Ming-Chang Yang, Ziqi Fan, Baoquan Zhang, Xiongzi Ge, and David H. C. Du. 2016. Evaluating host aware SMR drives. In Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’16). USENIX Association. Google ScholarGoogle ScholarDigital LibraryDigital Library
  37. Wenjian Xiao, Huanqing Dong, Liuying Ma, Zhenjun Liu, and Qiang Zhang. 2016. HS-BAS: A hybrid storage system based on band awareness of shingled write disk. In Proceedings of the IEEE 34th International Conference on Computer Design (ICCD’16). IEEE, 64--71.Google ScholarGoogle ScholarCross RefCross Ref
  38. Xuchao Xie, Liquan Xiao, Xiongzi Ge, and Qiong Li. 2018. SMRC: An endurable SSD cache for host-aware shingled magnetic recording drives. IEEE Access 6 (2018), 20916--20928.Google ScholarGoogle ScholarCross RefCross Ref
  39. Xuchao Xie, Tianye Yang, Qiong Li, Dengping Wei, and Liquan Xiao. 2018. Duchy: Achieving both SSD durability and controllable SMR cleaning overhead in hybrid storage systems. In Proceedings of the 47th International Conference on Parallel Processing. ACM, 81. Google ScholarGoogle ScholarDigital LibraryDigital Library
  40. Weixia Xu, Yutong Lu, Qiong Li, Enqiang Zhou, Zhenlong Song, Yong Dong, Wei Zhang, Dengping Wei, Xiaoming Zhang, Haitao Chen et al. 2014. Hybrid hierarchy storage system in MilkyWay-2 supercomputer. Front. Comput. Sci. 8, 3 (2014), 367--377. Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Jingpei Yang, Ned Plasson, Greg Gillis, Nisha Talagala, Swaminathan Sundararaman, and Robert Wood. 2013. HEC: Improving endurance of high performance flash-based cache devices. In Proceedings of the 6th International Systems and Storage Conference. ACM, 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  42. Ming-Chang Yang, Yuan-Hao Chang, Fenggang Wu, Tei-Wei Kuo, and David H. C. Du. 2017. Virtual persistent cache: Remedy the long latency behavior of host-aware shingled magnetic recording drives. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (ICCAD’17). IEEE, 17--24. Google ScholarGoogle ScholarDigital LibraryDigital Library
  43. Ming-Chang Yang, Yuan-Hao Chang, Fenggang Wu, Tei-Wei Kuo, and David H. C. Du. 2019. On Improving the write responsiveness for host-aware SMR drives. IEEE Trans. Comput. 68, 1 (Jan. 2019).Google ScholarGoogle ScholarCross RefCross Ref
  44. Yuanyuan Zhou, James Philbin, and Kai Li. 2001. The multi-queue replacement algorithm for second-level buffer caches. In Proceedings of the USENIX Annual Technical Conference, General Track. 91--104. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. ZoneTier: A Zone-based Storage Tiering and Caching Co-design to Integrate SSDs with SMR Drives

    Recommendations

    Comments

    Login options

    Check if you have access through your login credentials or your institution to get full access on this article.

    Sign in

    Full Access

    • Published in

      cover image ACM Transactions on Storage
      ACM Transactions on Storage  Volume 15, Issue 3
      August 2019
      173 pages
      ISSN:1553-3077
      EISSN:1553-3093
      DOI:10.1145/3336116
      • Editor:
      • Sam H. Noh
      Issue’s Table of Contents

      Copyright © 2019 ACM

      Publisher

      Association for Computing Machinery

      New York, NY, United States

      Publication History

      • Published: 10 July 2019
      • Accepted: 1 May 2019
      • Revised: 1 April 2019
      • Received: 1 January 2018
      Published in tos Volume 15, Issue 3

      Permissions

      Request permissions about this article.

      Request Permissions

      Check for updates

      Qualifiers

      • research-article
      • Research
      • Refereed

    PDF Format

    View or Download as a PDF file.

    PDF

    eReader

    View online with eReader.

    eReader

    HTML Format

    View this article in HTML Format .

    View HTML Format
    About Cookies On This Site

    We use cookies to ensure that we give you the best experience on our website.

    Learn more

    Got it!