Abstract
We introduce Skylight, a novel methodology that combines software and hardware techniques to reverse engineer key properties of drive-managed Shingled Magnetic Recording (SMR) drives. The software part of Skylight measures the latency of controlled I/O operations to infer important properties of drive-managed SMR, including type, structure, and size of the persistent cache; type of cleaning algorithm; type of block mapping; and size of bands. The hardware part of Skylight tracks drive head movements during these tests, using a high-speed camera through an observation window drilled through the cover of the drive. These observations not only confirm inferences from measurements, but resolve ambiguities that arise from the use of latency measurements alone. We show the generality and efficacy of our techniques by running them on top of three emulated and two real SMR drives, discovering valuable performance-relevant details of the behavior of the real SMR drives.
- Ahmed Amer, Darrell D. E. Long, Ethan L. Miller, Jehan-Francois Paris, and S. J. Thomas Schwarz. 2010. Design issues for a shingled write disk system. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--12. DOI:http://dx.doi.org/10.1109/MSST.2010.5496991 Google Scholar
Digital Library
- Jens Axboe. 2015. Flexible I/O Tester. git://git.kernel.dk/fio.git.Google Scholar
- Lakshmi N. Bairavasundaram, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Garth R. Goodson, and Bianca Schroeder. 2008. An analysis of data corruption in the storage stack. Trans. Storage 4, 3, Article 8 (Nov. 2008), 28 pages. DOI:http://dx.doi.org/10.1145/1416944.1416947 Google Scholar
Digital Library
- Luc Bouganim, Bjorn Jnsson, and Philippe Bonnet. 2009. uFLIP: Understanding flash IO patterns. In Proceedings of the International Conference on Innovative Data Systems Research (CIDR). Asilomar, California.Google Scholar
- Yuval Cassuto, Marco A. A. Sanvido, Cyril Guyot, David R. Hall, and Zvonimir Z. Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--14. DOI:http://dx.doi.org/10.1109/MSST.2010.5496971 Google Scholar
Digital Library
- Feng Chen, David A. Koufaty, and Xiaodong Zhang. 2009. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In Proceedings of the 11th International Joint Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’09). ACM, New York, NY, 181--192. DOI:http://dx.doi.org/10.1145/1555349.1555371 Google Scholar
Digital Library
- Jonathan Darrel Coker and David Robison Hall. 2013. Indirection memory architecture with reduced memory requirements for shingled magnetic recording devices. (Nov. 5, 2013). US Patent 8,578,122.Google Scholar
- Linux Device-Mapper. 2001. Device-Mapper Resource Page. https://sourceware.org/dm/.Google Scholar
- Elizabeth A. Dobisz, Z. Z. Bandic, Tsai-Wei Wu, and T. Albrecht. 2008. Patterned media: Nanofabrication challenges of future disk drives. Proc. IEEE 96, 11 (Nov. 2008), 1836--1846. DOI:http://dx.doi.org/10.1109/JPROC.2008.2007600Google Scholar
Cross Ref
- DRAMeXchange. 2014. NAND Flash Spot Price. (Sept. 2014). http://dramexchange.com.Google Scholar
- Robert M. Fallone and William B. Boyle. 2013. Data storage device employing a run-length mapping table and a single address mapping table. (May 14, 2013). US Patent 8,443,167.Google Scholar
- Tim Feldman. 2014a. Host-aware SMR. OpenZFS Developer Summit. Available from https://www.youtube.com/watch?v=b1yqjV8qemU.Google Scholar
- Tim Feldman. 2014b. Personal communication. (Aug. 2014).Google Scholar
- Tim Feldman and Garth Gibson. 2013. Shingled magnetic recording: Areal density increase requires new data management. USENIX 38, 3 (2013).Google Scholar
- Timothy Richard Feldman. 2011. Dynamic storage regions. (Feb. 14, 2011). US Patent Appl. 13/026,535.Google Scholar
- Garth Gibson and Greg Ganger. 2011. Principles of Operation for Shingled Disk Devices. Technical Report CMU-PDL-11-107. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.Google Scholar
- Garth Gibson and Milo Polte. 2009. Directions for Shingled-Write and Two-Dimensional Magnetic Recording System Architectures: Synergies with Solid-State Disks. Technical Report CMU-PDL-09-104. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.Google Scholar
- Jongmin Gim and Youjip Won. 2010. Extract and infer quickly: Obtaining sector geometry of modern hard disk drives. ACM Trans Storage (TOS) 6, 2, Article 6 (July 2010), 26 pages. DOI:http://dx.doi.org/10.1145/1807060.1807063 Google Scholar
Digital Library
- David Hall, John H. Marcos, and Jonathan D. Coker. 2012. Data handling algorithms for autonomous shingled magnetic recording hdds. IEEE Trans Magn 48, 5, 1777--1781.Google Scholar
Cross Ref
- David Robison Hall. 2014. Shingle-written magnetic recording (SMR) device with hybrid E-region. (April 1, 2014). US Patent 8,687,303.Google Scholar
- Weiping He and David H. C. Du. 2014. Novel address mappings for shingled write disks. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’14). USENIX Association, Berkeley, CA, 5--5. http://dl.acm.org/citation.cfm?id=2696578.2696583 Google Scholar
Digital Library
- HGST. 2014. HGST Unveils Intelligent, Dynamic Storage Solutions to Transform the Data Center. (Sept. 2014). Available from http://www.hgst.com/press-room/.Google Scholar
- INCITS T10 Technical Committee. 2014. Information technology—Zoned Block Commands (ZBC). Draft Standard T10/BSR INCITS 536. American National Standards Institute, Inc. Available from http://www.t10.org/drafts.htm.Google Scholar
- Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 2014 IEEE 30th Symposium on Mass Storage Systems and Technologies (MSST). 1--6. DOI:http://dx.doi.org/10.1109/MSST.2014.6855539Google Scholar
Cross Ref
- Jesung Kim, Jong Min Kim, S. H. Noh, Sang Lyul Min, and Yookun Cho. 2002. A space-efficient flash translation layer for CompactFlash systems. IEEE Trans. Consumer Electron. 48, 2 (May 2002), 366--375. DOI:http://dx.doi.org/10.1109/TCE.2002.1010143 Google Scholar
Digital Library
- Elie Krevat, Joseph Tucek, and Gregory R. Ganger. 2011. Disks are like snowflakes: No two are alike. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems (HotOS’13). USENIX Association, Berkeley, CA, 14--14. http://dl.acm.org/citation.cfm?id=1991596.1991615 Google Scholar
Digital Library
- Andrew Krioukov, Lakshmi N. Bairavasundaram, Garth R. Goodson, Kiran Srinivasan, Randy Thelen, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dussea. 2008. Parity lost and parity regained. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, Berkeley, CA, Article 9, 15 pages. http://dl.acm.org/citation.cfm?id=1364813.1364822 Google Scholar
Digital Library
- Mark H. Kryder, Edward C. Gage, Terry W. McDaniel, William A. Challener, Robert E. Rottmayer, Ganping Ju, Yiao-Tee Hsia, and M. Fatih Erden. 2008. Heat assisted magnetic recording. Proc. IEEE 96, 11 (Nov. 2008), 1810--1835. DOI:http://dx.doi.org/10.1109/JPROC.2008.2004315Google Scholar
Cross Ref
- Quoc M. Le, Kumar Sathyanarayana Raju, Ahmed Amer, and JoAnne Holliday. 2011. Workload impact on shingled write disks: All-writes can be alright. In Proceedings of the 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’11). IEEE Computer Society, Washington, DC, 444--446. DOI:http://dx.doi.org/10.1109/MASCOTS.2011.58 Google Scholar
Digital Library
- Damien Le Moal, Zvonimir Bandic, and Cyril Guyot. 2012. Shingled file system host-side management of Shingled magnetic recording disks. In Proceedings of the 2012 IEEE International Conference on Consumer Electronics (ICCE). 425--426. DOI:http://dx.doi.org/10.1109/ICCE.2012.6161799Google Scholar
Cross Ref
- Libata FAQ. 2011. https://ata.wiki.kernel.org/index.php/Libata_FAQ.Google Scholar
- Chung-I Lin, Dongchul Park, Weiping He, and David H. C. Du. 2012. H-SWD: Incorporating hot data identification into Shingled write disks. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 321--330. DOI:http://dx.doi.org/10.1109/MASCOTS.2012.44 Google Scholar
Digital Library
- Chanik Park, Wonmoon Cheon, Jeonguk Kang, Kangho Roh, Wonhee Cho, and Jin-Soo Kim. 2008. A reconfigurable FTL (Flash Translation Layer) architecture for NAND flash-based applications. ACM Trans. Embed. Comput. Syst. 7, 4, Article 38 (Aug. 2008), 23 pages. DOI:http://dx.doi.org/10.1145/1376804.1376806 Google Scholar
Digital Library
- S. N. Piramanayagam. 2007. Perpendicular recording media for hard disk drives. J. Appl. Phys. 102, 1 (July 2007), 011301. DOI:http://dx.doi.org/10.1063/1.2750414Google Scholar
Cross Ref
- Rekha Pitchumani, Andy Hospodor, Ahmed Amer, Yangwook Kang, Ethan L. Miller, and Darrell D. E. Long. 2012. Emulating a Shingled write disk. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 339--346. DOI:http://dx.doi.org/10.1109/MASCOTS.2012.46 Google Scholar
Digital Library
- Sundar Poudyal. 2013. Partial write system. (March 13, 2013). US Patent Appl. 13/799,827.Google Scholar
- Drew Riley. 2013. Samsung’s SSD Global Summit: Samsung: Flexing Its Dominance In The NAND Market. (Aug. 2013). http://www.tomshardware.com/reviews/samsung-global-ssd-summit-2013,3570.html.Google Scholar
- Mendel Rosenblum and John K. Ousterhout. 1991. The design and implementation of a log-structured file system. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (SOSP’91). ACM, New York, NY, 1--15. DOI:http://dx.doi.org/10.1145/121132.121137 Google Scholar
Digital Library
- SATA-IO. 2011. Serial ATA Revision 3.1 Specification. Technical Report. SATA-IO.Google Scholar
- Steven W. Schlosser, Jiri Schindler, Stratos Papadomanolakis, Minglong Shao, Anastassia Ailamaki, Christos Faloutsos, and Gregory R. Ganger. 2005. On multidimensional data and modern disks. In Proceedings of the 4th Conference on USENIX Conference on File and Storage Technologies—Volume 4 (FAST’05). USENIX Association, Berkeley, CA, 17--17. http://dl.acm.org/citation.cfm?id=1251028.1251045 Google Scholar
Digital Library
- Seagate 2013a. Seagate Desktop HDD: ST5000DM000, ST4000DM001. Product Manual 100743772. Seagate Technology LLC.Google Scholar
- Seagate 2013b. Seagate Technology PLC Fiscal Fourth Quarter and Year End 2013 Financial Results Supplemental Commentary. (July 2013). Available from http://www.seagate.com/investors.Google Scholar
- Seagate 2013c. Terascale HDD. Data sheet DS1793.1-1306US. Seagate Technology PLC.Google Scholar
- Seagate 2014. Seagate Ships Worlds First 8TB Hard Drives. (Aug. 2014). Available from http://www.seagate.com/about/newsroom/.Google Scholar
- Nisha Talagala, Remzi H. Arpaci-Dusseau, and David Patterson. 1999. Microbenchmark-based Extraction of Local and Global Disk Characteristics. Technical Report UCB/CSD-99-1063. EECS Department, University of California, Berkeley. http://www.eecs.berkeley.edu/Pubs/TechRpts/1999/6275.html. Google Scholar
- Sophia Tan, Weiya Xi, Zhi Yong Ching, Chao Jin, and Chun Teck Lim. 2013. Simulation for a Shingled magnetic recording disk. IEEE Trans. Magn. 49, 6 (June 2013), 2677--2681. DOI:http://dx.doi.org/10.1109/TMAG.2013.2245872Google Scholar
Cross Ref
- David A. Thompson and John S. Best. 2000. The future of magnetic data storage techology. IBM J. Res. Dev. 44, 3 (May 2000), 311--322. DOI:http://dx.doi.org/10.1147/rd.443.0311 Google Scholar
Digital Library
- Sumei Wang, Yao Wang, and Randall H. Victora. 2013. Shingled magnetic recording on bit patterned media at 10 Tb/in2. IEEE Trans. Magn. 49, 7 (July 2013), 3644--3647. DOI:http://dx.doi.org/10.1109/TMAG.2012.2237545Google Scholar
Cross Ref
- R. Wood, Mason Williams, A Kavcic, and Jim Miles. 2009. The feasibility of magnetic recording at 10 terabits per square inch on conventional media. IEEE Trans. Magn. 45, 2 (Feb. 2009), 917--923. DOI:http://dx.doi.org/10.1109/TMAG.2008.2010676Google Scholar
Cross Ref
- Bruce L. Worthington, Gregory R. Ganger, Yale N. Patt, and John Wilkes. 1995. On-line extraction of SCSI disk drive parameters. In Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’95/PERFORMANCE’95). ACM, New York, NY, 146--156. DOI:http://dx.doi.org/10.1145/223587.223604 Google Scholar
Digital Library
Index Terms
Skylight—A Window on Shingled Disk Operation
Recommendations
SMRDB: key-value data store for shingled magnetic recording disks
SYSTOR '15: Proceedings of the 8th ACM International Systems and Storage ConferenceShingled Magnetic Recording (SMR) disks employ a shingled write process that overlaps the data tracks on the disk surface like the shingles on a roof, thereby increasing disk areal density with minimal manufacturing changes. While these disks have the ...
Understanding the SWD-based RAID System
CCBD '14: Proceedings of the 2014 International Conference on Cloud Computing and Big DataThe emergence of big data needs more and more storage capacity, and hard disk drive (HDD) plays a very important role in storage supplying. However, because of super paramagnetic effect, the growth of the areal density of HDD will quickly reach the ...
Enabling File-Oriented Fast Secure Deletion on Shingled Magnetic Recording Drives
DAC '19: Proceedings of the 56th Annual Design Automation Conference 2019Existing secure deletion approaches are inefficient in erasing data permanently because file systems have no knowledge of the data layout on the storage device, nor is the storage device aware of file information within the file systems. This ...






Comments