Abstract
Integrating solid-state drives (SSDs) and host-aware shingled magnetic recording (HA-SMR) drives can potentially build a cost-effective high-performance storage system. However, existing SSD tiering and caching designs in such a hybrid system are not fully matched with the intrinsic properties of HA-SMR drives due to their lacking consideration of how to handle non-sequential writes (NSWs). We propose ZoneTier, a zone-based storage tiering and caching co-design, to effectively control all the NSWs by leveraging the host-aware property of HA-SMR drives. ZoneTier exploits real-time data layout of SMR zones to optimize zone placement, reshapes NSWs generated from zone demotions to SMR preferred sequential writes, and transforms the inevitable NSWs to cleaning-friendly write traffics for SMR zones. ZoneTier can be easily extended to match host-managed SMR drives using proactive cleaning policy. We implemented a prototype of ZoneTier with user space data management algorithms and real SSD and HA-SMR drives, which are manipulated by the functions provided by libzbc and libaio. Our experiments show that ZoneTier can reduce zone relocation overhead by 29.41% on average, shorten performance recovery time of HA-SMR drives from cleaning by up to 33.37%, and improve performance by up to 32.31% than existing hybrid storage designs.
- Mark Abashkin, Assaf Natanzon, and Eitan Bachmat. 2015. Integrated caching and tiering according to use and QoS requirements. In Proceedings of the 34th International Performance on Computing and Communications Conference (IPCCC’15). IEEE, 1--8. Google Scholar
Digital Library
- Abutalib Aghayev, Mansour Shafaei, and Peter Desnoyers. 2015. Skylight: A window on shingled disk operation. ACM Trans. Storage 11, 4 (2015), 16. Google Scholar
Digital Library
- Abutalib Aghayev, Theodore Ts’o, Garth Gibson, and Peter Desnoyers. 2017. Evolving Ext4 for shingled disks. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, 105--120. Google Scholar
Digital Library
- Trevor Blackwell, Jeffrey Harris, and Margo I. Seltzer. 1995. Heuristic cleaning algorithms in log-structured file systems. In Proceedings of the USENIX Technical Conference on Unix and Advanced Computing Systems, New Orleans, Louisiana. 23--23. Google Scholar
Digital Library
- Feng Chen, David A. Koufaty, and Xiaodong Zhang. 2011. Hystor: Making the best use of solid-state drives in high performance storage systems. In Proceedings of the International Conference on Supercomputing. ACM, 22--32. Google Scholar
Digital Library
- INCITS T10 Technical Committee. {n.d.}. Information Technology—Zoned Block Commands-2 (ZBC-2). Retrieved from https://standards.incits.org/apps/group_public/project/details.php?project_id=487.Google Scholar
- INCITS T13 Technical Committee. {n.d.}. Information Technology—Zoned Device ATA Command Set-2 (ZAC-2). Retrieved from https://standards.incits.org/apps/group_public/project/details.php?project_id=447.Google Scholar
- Tim Feldman and Garth Gibson. 2013. Shingled magnetic recording areal density increase requires new data management. login: USENIX Mag. 38, 3 (2013).Google Scholar
- Jorge Guerra, Himabindu Pucha, Joseph S. Glider, Wendy Belluomini, and Raju Rangaswami. 2011. Cost effective storage using extent-based dynamic tiering. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’11), Vol. 11. 20--20. Google Scholar
Digital Library
- Alireza Haghdoost, Weiping He, Jerry Fredin, and David H. C. Du. 2017. On the accuracy and scalability of intensive I/O workload replay. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, Santa Clara, CA, 315--328. Google Scholar
Digital Library
- Shinichi Hayashi and Norihisa Komoda. 2013. Evaluation of SSD tier method and SSD cache method in tiered storage system. In Proceedings of the Technical Meeting on “Information Systems,” IEE Japan (IS’13). 51--56.Google Scholar
- Weiping He and David H. C. Du. 2017. SMaRT: An approach to shingled magnetic recording translation. In Proceedings of the 15th USENIX Conference on File and Storage Technologies (FAST’17). USENIX Association, Santa Clara, CA, 121--134. Google Scholar
Digital Library
- Western Digital hgst. {n.d.}. Libzbc: ZBC Device Manipulation Library. Retrieved from https://github.com/hgst/libzbc.Google Scholar
- Sai Huang, Qingsong Wei, Dan Feng, Jianxi Chen, and Cheng Chen. 2016. Improving flash-based disk cache with lazy adaptive replacement. ACM Trans. Storage 12, 2 (2016), 8. Google Scholar
Digital Library
- Song Jiang and Xiaodong Zhang. 2002. LIRS: An efficient low inter-reference recency set replacement policy to improve buffer cache performance. ACM SIGMETRICS Perform. Eval. Rev. 30, 1 (2002), 31--42. Google Scholar
Digital Library
- Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 30th Symposium on Mass Storage Systems and Technologies (MSST’14). IEEE, 1--6.Google Scholar
Cross Ref
- Stephanie N. Jones, Ahmed Amer, Ethan L. Miller, Darrell D. E. Long, Rekha Pitchumani, and Christina R. Strong. 2016. Classifying data to reduce long-term data movement in shingled write disks. ACM Trans. Storage 12, 1 (2016), 2. Google Scholar
Digital Library
- Linux Kernel. {n.d.}. Libaio: Linux Kernel AIO Access Library.Google Scholar
- Hyojun Kim, Sangeetha Seshadri, Clement L. Dickey, and Lawrence Chiu. 2014. Evaluating phase change memory for enterprise storage systems: A study of caching and tiering approaches. ACM Trans. Storage 10, 4 (2014), 15. Google Scholar
Digital Library
- Cheng Li, Philip Shilane, Fred Douglis, Darren Sawyer, and Hyong Shim. 2014. Assert (! defined (sequential I/O)). In Proceedings of the USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’14). Google Scholar
Digital Library
- Cheng Li, Philip Shilane, Fred Douglis, Hyong Shim, Stephen Smaldone, and Grant Wallace. 2014. Nitro: A capacity-optimized SSD cache for primary storage. In Proceedings of the USENIX Annual Technical Conference. 501--512. Google Scholar
Digital Library
- Peter Macko, Xiongzi Ge, John Haskins Jr., James Kelley, David Slik, Keith A. Smith, and Maxim G. Smith. 2017. SMORE: A cold data object store for SMR drives. In Proceedings of the 34th Symposium on Mass Storage Systems and Technologies (MSST’17). IEEE.Google Scholar
- Adam Manzanares, Noah Watkins, Cyril Guyot, Damien LeMoal, Carlos Maltzahn, and Zvonimr Bandic. 2016. ZEA, a data management approach for SMR. In Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’16). USENIX Association. Google Scholar
Digital Library
- Nimrod Megiddo and Dharmendra S. Modha. 2003. ARC: A self-tuning, low overhead replacement cache. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’03), vol. 3. 115--130. Google Scholar
Digital Library
- Michael Mesnier, Feng Chen, Tian Luo, and Jason B. Akers. 2011. Differentiated storage services. In Proceedings of the 23rd ACM Symposium on Operating Systems Principles. ACM, 57--70. Google Scholar
Digital Library
- Microsoft. {n.d.}. ReFS Overview. Retrieved from https://docs.microsoft.com/en-us/windows-server/storage/refs/refs-overview.Google Scholar
- Yuanjiang Ni, Ji Jiang, Dejun Jiang, Xiaosong Ma, Jin Xiong, and Yuangang Wang. 2016. S-RAC: SSD friendly caching for data center workloads. In Proceedings of the 9th ACM International on Systems and Storage Conference. ACM, 8. Google Scholar
Digital Library
- Kazuichi Oe, Takeshi Nanri, and Koji Okamura. 2015. On-the-fly automated storage tiering with caching and both proactive and observational migration. In Proceedings of the 23rd International Symposium on Computing and Networking (CANDAR’15). IEEE, 371--377. Google Scholar
Digital Library
- Kazuichi Oe and Koji Okamura. 2014. A hybrid storage system composed of on-the-fly automated storage tiering (OTF-AST) and caching. In Proceedings of the 2nd International Symposium on Computing and Networking (CANDAR’14). IEEE, 406--411. Google Scholar
Digital Library
- Dongchul Park, Chung-I Lin, and David H. C. Du. 2012. H-SWD: A novel shingled write disk scheme based on hot and cold data identification. In Proceedings of the 10th USENIX Conference on File and Storage Technologies (FAST’12).Google Scholar
- Mendel Rosenblum and John K. Ousterhout. 1992. The design and implementation of a log-structured file system. ACM Trans. Comput. Syst. 10, 1 (1992), 26--52. Google Scholar
Digital Library
- Mohit Saxena, Michael M. Swift, and Yiying Zhang. 2012. FlashTier: A lightweight, consistent and durable storage cache. In Proceedings of the 7th ACM European Conference on Computer Systems. ACM, 267--280. Google Scholar
Digital Library
- Anand Suresh, Garth Gibson, and Greg Ganger. 2012. Shingled magnetic recording for big data applications. Carnegie Mellon University Parallel Data Lab Technical Report CMU-PD L-12--105.Google Scholar
- Chunling Wang, Dandan Wang, Yupeng Chai, Chuanwen Wang, and Diansen Sun. 2017. Larger, cheaper, but faster: SSD-SMR hybrid storage boosted by a New SMR-oriented cache framework. In Proceedings of the 34th Symposium on Mass Storage Systems and Technologies (MSST’17). IEEE, 1--11.Google Scholar
- Fenggang Wu, Ziqi Fan, Ming-Chang Yang, Baoquan Zhang, Xiongzi Ge, and David H. C. Du. 2017. Performance evaluation of host aware shingled magnetic recording (HA-SMR) drives. IEEE Trans. Comput. 66, 11 (2017), 1932--1945.Google Scholar
Digital Library
- Fenggang Wu, Ming-Chang Yang, Ziqi Fan, Baoquan Zhang, Xiongzi Ge, and David H. C. Du. 2016. Evaluating host aware SMR drives. In Proceedings of the 8th USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’16). USENIX Association. Google Scholar
Digital Library
- Wenjian Xiao, Huanqing Dong, Liuying Ma, Zhenjun Liu, and Qiang Zhang. 2016. HS-BAS: A hybrid storage system based on band awareness of shingled write disk. In Proceedings of the IEEE 34th International Conference on Computer Design (ICCD’16). IEEE, 64--71.Google Scholar
Cross Ref
- Xuchao Xie, Liquan Xiao, Xiongzi Ge, and Qiong Li. 2018. SMRC: An endurable SSD cache for host-aware shingled magnetic recording drives. IEEE Access 6 (2018), 20916--20928.Google Scholar
Cross Ref
- Xuchao Xie, Tianye Yang, Qiong Li, Dengping Wei, and Liquan Xiao. 2018. Duchy: Achieving both SSD durability and controllable SMR cleaning overhead in hybrid storage systems. In Proceedings of the 47th International Conference on Parallel Processing. ACM, 81. Google Scholar
Digital Library
- Weixia Xu, Yutong Lu, Qiong Li, Enqiang Zhou, Zhenlong Song, Yong Dong, Wei Zhang, Dengping Wei, Xiaoming Zhang, Haitao Chen et al. 2014. Hybrid hierarchy storage system in MilkyWay-2 supercomputer. Front. Comput. Sci. 8, 3 (2014), 367--377. Google Scholar
Digital Library
- Jingpei Yang, Ned Plasson, Greg Gillis, Nisha Talagala, Swaminathan Sundararaman, and Robert Wood. 2013. HEC: Improving endurance of high performance flash-based cache devices. In Proceedings of the 6th International Systems and Storage Conference. ACM, 10. Google Scholar
Digital Library
- Ming-Chang Yang, Yuan-Hao Chang, Fenggang Wu, Tei-Wei Kuo, and David H. C. Du. 2017. Virtual persistent cache: Remedy the long latency behavior of host-aware shingled magnetic recording drives. In Proceedings of the IEEE/ACM International Conference on Computer-Aided Design (ICCAD’17). IEEE, 17--24. Google Scholar
Digital Library
- Ming-Chang Yang, Yuan-Hao Chang, Fenggang Wu, Tei-Wei Kuo, and David H. C. Du. 2019. On Improving the write responsiveness for host-aware SMR drives. IEEE Trans. Comput. 68, 1 (Jan. 2019).Google Scholar
Cross Ref
- Yuanyuan Zhou, James Philbin, and Kai Li. 2001. The multi-queue replacement algorithm for second-level buffer caches. In Proceedings of the USENIX Annual Technical Conference, General Track. 91--104. Google Scholar
Digital Library
Index Terms
ZoneTier: A Zone-based Storage Tiering and Caching Co-design to Integrate SSDs with SMR Drives
Recommendations
Improving runtime performance of deduplication system with host-managed SMR storage drives
DAC '18: Proceedings of the 55th Annual Design Automation ConferenceDue to the cost consideration for data storage, high-areal-density shingled-magnetic-recording (SMR) drives and data deduplication techniques are getting popular in many data storage services for the improvement of profit per storage unit. However, ...
KFR: optimal cache management with <u>K</u>-<u>f</u>ramed <u>r</u>eclamation for drive-managed SMR disks
DAC '20: Proceedings of the 57th ACM/EDAC/IEEE Design Automation ConferenceShingled Magnetic Recording (SMR) disks have been proposed as a promising solution to satisfy the increasing capacity need in the big data era. Drive-Managed SMR (DM-SMR) disk which acts as a traditional block device is favored for providing high ...
Modeling Drive-Managed SMR Performance
Special Issue on MSST 2017 and Regular PapersAccurately modeling drive-managed Shingled Magnetic Recording (SMR) disks is a challenge, requiring an array of approaches including both existing disk modeling techniques as well as new techniques for inferring internal translation layer algorithms. In ...






Comments