skip to main content
research-article

Skylight—A Window on Shingled Disk Operation

Published:16 October 2015Publication History
Skip Abstract Section

Abstract

We introduce Skylight, a novel methodology that combines software and hardware techniques to reverse engineer key properties of drive-managed Shingled Magnetic Recording (SMR) drives. The software part of Skylight measures the latency of controlled I/O operations to infer important properties of drive-managed SMR, including type, structure, and size of the persistent cache; type of cleaning algorithm; type of block mapping; and size of bands. The hardware part of Skylight tracks drive head movements during these tests, using a high-speed camera through an observation window drilled through the cover of the drive. These observations not only confirm inferences from measurements, but resolve ambiguities that arise from the use of latency measurements alone. We show the generality and efficacy of our techniques by running them on top of three emulated and two real SMR drives, discovering valuable performance-relevant details of the behavior of the real SMR drives.

References

  1. Ahmed Amer, Darrell D. E. Long, Ethan L. Miller, Jehan-Francois Paris, and S. J. Thomas Schwarz. 2010. Design issues for a shingled write disk system. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--12. DOI:http://dx.doi.org/10.1109/MSST.2010.5496991 Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Jens Axboe. 2015. Flexible I/O Tester. git://git.kernel.dk/fio.git.Google ScholarGoogle Scholar
  3. Lakshmi N. Bairavasundaram, Andrea C. Arpaci-Dusseau, Remzi H. Arpaci-Dusseau, Garth R. Goodson, and Bianca Schroeder. 2008. An analysis of data corruption in the storage stack. Trans. Storage 4, 3, Article 8 (Nov. 2008), 28 pages. DOI:http://dx.doi.org/10.1145/1416944.1416947 Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Luc Bouganim, Bjorn Jnsson, and Philippe Bonnet. 2009. uFLIP: Understanding flash IO patterns. In Proceedings of the International Conference on Innovative Data Systems Research (CIDR). Asilomar, California.Google ScholarGoogle Scholar
  5. Yuval Cassuto, Marco A. A. Sanvido, Cyril Guyot, David R. Hall, and Zvonimir Z. Bandic. 2010. Indirection systems for shingled-recording disk drives. In Proceedings of the 2010 IEEE 26th Symposium on Mass Storage Systems and Technologies (MSST) (MSST’10). IEEE Computer Society, Washington, DC, 1--14. DOI:http://dx.doi.org/10.1109/MSST.2010.5496971 Google ScholarGoogle ScholarDigital LibraryDigital Library
  6. Feng Chen, David A. Koufaty, and Xiaodong Zhang. 2009. Understanding intrinsic characteristics and system implications of flash memory based solid state drives. In Proceedings of the 11th International Joint Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’09). ACM, New York, NY, 181--192. DOI:http://dx.doi.org/10.1145/1555349.1555371 Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Jonathan Darrel Coker and David Robison Hall. 2013. Indirection memory architecture with reduced memory requirements for shingled magnetic recording devices. (Nov. 5, 2013). US Patent 8,578,122.Google ScholarGoogle Scholar
  8. Linux Device-Mapper. 2001. Device-Mapper Resource Page. https://sourceware.org/dm/.Google ScholarGoogle Scholar
  9. Elizabeth A. Dobisz, Z. Z. Bandic, Tsai-Wei Wu, and T. Albrecht. 2008. Patterned media: Nanofabrication challenges of future disk drives. Proc. IEEE 96, 11 (Nov. 2008), 1836--1846. DOI:http://dx.doi.org/10.1109/JPROC.2008.2007600Google ScholarGoogle ScholarCross RefCross Ref
  10. DRAMeXchange. 2014. NAND Flash Spot Price. (Sept. 2014). http://dramexchange.com.Google ScholarGoogle Scholar
  11. Robert M. Fallone and William B. Boyle. 2013. Data storage device employing a run-length mapping table and a single address mapping table. (May 14, 2013). US Patent 8,443,167.Google ScholarGoogle Scholar
  12. Tim Feldman. 2014a. Host-aware SMR. OpenZFS Developer Summit. Available from https://www.youtube.com/watch?v=b1yqjV8qemU.Google ScholarGoogle Scholar
  13. Tim Feldman. 2014b. Personal communication. (Aug. 2014).Google ScholarGoogle Scholar
  14. Tim Feldman and Garth Gibson. 2013. Shingled magnetic recording: Areal density increase requires new data management. USENIX 38, 3 (2013).Google ScholarGoogle Scholar
  15. Timothy Richard Feldman. 2011. Dynamic storage regions. (Feb. 14, 2011). US Patent Appl. 13/026,535.Google ScholarGoogle Scholar
  16. Garth Gibson and Greg Ganger. 2011. Principles of Operation for Shingled Disk Devices. Technical Report CMU-PDL-11-107. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.Google ScholarGoogle Scholar
  17. Garth Gibson and Milo Polte. 2009. Directions for Shingled-Write and Two-Dimensional Magnetic Recording System Architectures: Synergies with Solid-State Disks. Technical Report CMU-PDL-09-104. CMU Parallel Data Laboratory. http://repository.cmu.edu/pdl/7.Google ScholarGoogle Scholar
  18. Jongmin Gim and Youjip Won. 2010. Extract and infer quickly: Obtaining sector geometry of modern hard disk drives. ACM Trans Storage (TOS) 6, 2, Article 6 (July 2010), 26 pages. DOI:http://dx.doi.org/10.1145/1807060.1807063 Google ScholarGoogle ScholarDigital LibraryDigital Library
  19. David Hall, John H. Marcos, and Jonathan D. Coker. 2012. Data handling algorithms for autonomous shingled magnetic recording hdds. IEEE Trans Magn 48, 5, 1777--1781.Google ScholarGoogle ScholarCross RefCross Ref
  20. David Robison Hall. 2014. Shingle-written magnetic recording (SMR) device with hybrid E-region. (April 1, 2014). US Patent 8,687,303.Google ScholarGoogle Scholar
  21. Weiping He and David H. C. Du. 2014. Novel address mappings for shingled write disks. In Proceedings of the 6th USENIX Conference on Hot Topics in Storage and File Systems (HotStorage’14). USENIX Association, Berkeley, CA, 5--5. http://dl.acm.org/citation.cfm?id=2696578.2696583 Google ScholarGoogle ScholarDigital LibraryDigital Library
  22. HGST. 2014. HGST Unveils Intelligent, Dynamic Storage Solutions to Transform the Data Center. (Sept. 2014). Available from http://www.hgst.com/press-room/.Google ScholarGoogle Scholar
  23. INCITS T10 Technical Committee. 2014. Information technology—Zoned Block Commands (ZBC). Draft Standard T10/BSR INCITS 536. American National Standards Institute, Inc. Available from http://www.t10.org/drafts.htm.Google ScholarGoogle Scholar
  24. Chao Jin, Wei-Ya Xi, Zhi-Yong Ching, Feng Huo, and Chun-Teck Lim. 2014. HiSMRfs: A high performance file system for shingled storage array. In Proceedings of the 2014 IEEE 30th Symposium on Mass Storage Systems and Technologies (MSST). 1--6. DOI:http://dx.doi.org/10.1109/MSST.2014.6855539Google ScholarGoogle ScholarCross RefCross Ref
  25. Jesung Kim, Jong Min Kim, S. H. Noh, Sang Lyul Min, and Yookun Cho. 2002. A space-efficient flash translation layer for CompactFlash systems. IEEE Trans. Consumer Electron. 48, 2 (May 2002), 366--375. DOI:http://dx.doi.org/10.1109/TCE.2002.1010143 Google ScholarGoogle ScholarDigital LibraryDigital Library
  26. Elie Krevat, Joseph Tucek, and Gregory R. Ganger. 2011. Disks are like snowflakes: No two are alike. In Proceedings of the 13th USENIX Conference on Hot Topics in Operating Systems (HotOS’13). USENIX Association, Berkeley, CA, 14--14. http://dl.acm.org/citation.cfm?id=1991596.1991615 Google ScholarGoogle ScholarDigital LibraryDigital Library
  27. Andrew Krioukov, Lakshmi N. Bairavasundaram, Garth R. Goodson, Kiran Srinivasan, Randy Thelen, Andrea C. Arpaci-Dusseau, and Remzi H. Arpaci-Dussea. 2008. Parity lost and parity regained. In Proceedings of the 6th USENIX Conference on File and Storage Technologies (FAST’08). USENIX Association, Berkeley, CA, Article 9, 15 pages. http://dl.acm.org/citation.cfm?id=1364813.1364822 Google ScholarGoogle ScholarDigital LibraryDigital Library
  28. Mark H. Kryder, Edward C. Gage, Terry W. McDaniel, William A. Challener, Robert E. Rottmayer, Ganping Ju, Yiao-Tee Hsia, and M. Fatih Erden. 2008. Heat assisted magnetic recording. Proc. IEEE 96, 11 (Nov. 2008), 1810--1835. DOI:http://dx.doi.org/10.1109/JPROC.2008.2004315Google ScholarGoogle ScholarCross RefCross Ref
  29. Quoc M. Le, Kumar Sathyanarayana Raju, Ahmed Amer, and JoAnne Holliday. 2011. Workload impact on shingled write disks: All-writes can be alright. In Proceedings of the 2011 IEEE 19th Annual International Symposium on Modelling, Analysis, and Simulation of Computer and Telecommunication Systems (MASCOTS’11). IEEE Computer Society, Washington, DC, 444--446. DOI:http://dx.doi.org/10.1109/MASCOTS.2011.58 Google ScholarGoogle ScholarDigital LibraryDigital Library
  30. Damien Le Moal, Zvonimir Bandic, and Cyril Guyot. 2012. Shingled file system host-side management of Shingled magnetic recording disks. In Proceedings of the 2012 IEEE International Conference on Consumer Electronics (ICCE). 425--426. DOI:http://dx.doi.org/10.1109/ICCE.2012.6161799Google ScholarGoogle ScholarCross RefCross Ref
  31. Libata FAQ. 2011. https://ata.wiki.kernel.org/index.php/Libata_FAQ.Google ScholarGoogle Scholar
  32. Chung-I Lin, Dongchul Park, Weiping He, and David H. C. Du. 2012. H-SWD: Incorporating hot data identification into Shingled write disks. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 321--330. DOI:http://dx.doi.org/10.1109/MASCOTS.2012.44 Google ScholarGoogle ScholarDigital LibraryDigital Library
  33. Chanik Park, Wonmoon Cheon, Jeonguk Kang, Kangho Roh, Wonhee Cho, and Jin-Soo Kim. 2008. A reconfigurable FTL (Flash Translation Layer) architecture for NAND flash-based applications. ACM Trans. Embed. Comput. Syst. 7, 4, Article 38 (Aug. 2008), 23 pages. DOI:http://dx.doi.org/10.1145/1376804.1376806 Google ScholarGoogle ScholarDigital LibraryDigital Library
  34. S. N. Piramanayagam. 2007. Perpendicular recording media for hard disk drives. J. Appl. Phys. 102, 1 (July 2007), 011301. DOI:http://dx.doi.org/10.1063/1.2750414Google ScholarGoogle ScholarCross RefCross Ref
  35. Rekha Pitchumani, Andy Hospodor, Ahmed Amer, Yangwook Kang, Ethan L. Miller, and Darrell D. E. Long. 2012. Emulating a Shingled write disk. In Proceedings of the 2012 IEEE 20th International Symposium on Modeling, Analysis and Simulation of Computer and Telecommunication Systems (MASCOTS’12). IEEE Computer Society, Washington, DC, 339--346. DOI:http://dx.doi.org/10.1109/MASCOTS.2012.46 Google ScholarGoogle ScholarDigital LibraryDigital Library
  36. Sundar Poudyal. 2013. Partial write system. (March 13, 2013). US Patent Appl. 13/799,827.Google ScholarGoogle Scholar
  37. Drew Riley. 2013. Samsung’s SSD Global Summit: Samsung: Flexing Its Dominance In The NAND Market. (Aug. 2013). http://www.tomshardware.com/reviews/samsung-global-ssd-summit-2013,3570.html.Google ScholarGoogle Scholar
  38. Mendel Rosenblum and John K. Ousterhout. 1991. The design and implementation of a log-structured file system. In Proceedings of the 13th ACM Symposium on Operating Systems Principles (SOSP’91). ACM, New York, NY, 1--15. DOI:http://dx.doi.org/10.1145/121132.121137 Google ScholarGoogle ScholarDigital LibraryDigital Library
  39. SATA-IO. 2011. Serial ATA Revision 3.1 Specification. Technical Report. SATA-IO.Google ScholarGoogle Scholar
  40. Steven W. Schlosser, Jiri Schindler, Stratos Papadomanolakis, Minglong Shao, Anastassia Ailamaki, Christos Faloutsos, and Gregory R. Ganger. 2005. On multidimensional data and modern disks. In Proceedings of the 4th Conference on USENIX Conference on File and Storage Technologies—Volume 4 (FAST’05). USENIX Association, Berkeley, CA, 17--17. http://dl.acm.org/citation.cfm?id=1251028.1251045 Google ScholarGoogle ScholarDigital LibraryDigital Library
  41. Seagate 2013a. Seagate Desktop HDD: ST5000DM000, ST4000DM001. Product Manual 100743772. Seagate Technology LLC.Google ScholarGoogle Scholar
  42. Seagate 2013b. Seagate Technology PLC Fiscal Fourth Quarter and Year End 2013 Financial Results Supplemental Commentary. (July 2013). Available from http://www.seagate.com/investors.Google ScholarGoogle Scholar
  43. Seagate 2013c. Terascale HDD. Data sheet DS1793.1-1306US. Seagate Technology PLC.Google ScholarGoogle Scholar
  44. Seagate 2014. Seagate Ships Worlds First 8TB Hard Drives. (Aug. 2014). Available from http://www.seagate.com/about/newsroom/.Google ScholarGoogle Scholar
  45. Nisha Talagala, Remzi H. Arpaci-Dusseau, and David Patterson. 1999. Microbenchmark-based Extraction of Local and Global Disk Characteristics. Technical Report UCB/CSD-99-1063. EECS Department, University of California, Berkeley. http://www.eecs.berkeley.edu/Pubs/TechRpts/1999/6275.html. Google ScholarGoogle Scholar
  46. Sophia Tan, Weiya Xi, Zhi Yong Ching, Chao Jin, and Chun Teck Lim. 2013. Simulation for a Shingled magnetic recording disk. IEEE Trans. Magn. 49, 6 (June 2013), 2677--2681. DOI:http://dx.doi.org/10.1109/TMAG.2013.2245872Google ScholarGoogle ScholarCross RefCross Ref
  47. David A. Thompson and John S. Best. 2000. The future of magnetic data storage techology. IBM J. Res. Dev. 44, 3 (May 2000), 311--322. DOI:http://dx.doi.org/10.1147/rd.443.0311 Google ScholarGoogle ScholarDigital LibraryDigital Library
  48. Sumei Wang, Yao Wang, and Randall H. Victora. 2013. Shingled magnetic recording on bit patterned media at 10 Tb/in2. IEEE Trans. Magn. 49, 7 (July 2013), 3644--3647. DOI:http://dx.doi.org/10.1109/TMAG.2012.2237545Google ScholarGoogle ScholarCross RefCross Ref
  49. R. Wood, Mason Williams, A Kavcic, and Jim Miles. 2009. The feasibility of magnetic recording at 10 terabits per square inch on conventional media. IEEE Trans. Magn. 45, 2 (Feb. 2009), 917--923. DOI:http://dx.doi.org/10.1109/TMAG.2008.2010676Google ScholarGoogle ScholarCross RefCross Ref
  50. Bruce L. Worthington, Gregory R. Ganger, Yale N. Patt, and John Wilkes. 1995. On-line extraction of SCSI disk drive parameters. In Proceedings of the 1995 ACM SIGMETRICS Joint International Conference on Measurement and Modeling of Computer Systems (SIGMETRICS’95/PERFORMANCE’95). ACM, New York, NY, 146--156. DOI:http://dx.doi.org/10.1145/223587.223604 Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Skylight—A Window on Shingled Disk Operation

            Recommendations

            Comments

            Login options

            Check if you have access through your login credentials or your institution to get full access on this article.

            Sign in

            Full Access

            PDF Format

            View or Download as a PDF file.

            PDF

            eReader

            View online with eReader.

            eReader
            About Cookies On This Site

            We use cookies to ensure that we give you the best experience on our website.

            Learn more

            Got it!