Abstract
Modern solid-state disks achieve high data transfer rates due to their massive internal parallelism. However, out-of-place updates for flash memory incur garbage collection costs when valid data needs to be copied during space reclamation. The root cause of this extra cost is that solid-state disks are not always able to accurately determine data lifetime and group together data that expires before the space needs to be reclaimed. Real-time systems found in autonomous vehicles, industrial control systems, and assembly-line robots store data from hundreds of sensors and often have predictable data lifetimes. These systems require guaranteed high storage bandwidth for read and write operations by mission-critical real-time tasks. In this article, we depart from the traditional block device interface to guarantee the high throughput needed to process large volumes of data. Using data lifetime information from the application layer, our proposed real-time design, called Telomere, is able to intelligently lay out data in NAND flash memory and eliminate valid page copies during garbage collection. Telomere’s real-time admission control is able to guarantee tasks their required read and write operations within their periods. Under randomly generated tasksets containing 500 tasks, Telomere achieves 30% higher throughput with a 5% storage cost compared to pre-existing techniques.
- [1] . 2016. Autonomous Mini Rally Car Teaches Itself to Powerslide. Retrieved November 20, 2021 from https://spectrum.ieee.org/cars-that-think/transportation/self-driving/autonomous-mini-rally-car-teaches-itself-to-powerslide.Google Scholar
- [2] . 2008. Design tradeoffs for SSD performance. In Proceedings of the USENIX Annual Technical Conference (ATC’08). Google Scholar
Digital Library
- [3] . 2013. Google’s Self-Driving Car Gathers Nearly 1 GB/sec. Retrieved November 20, 2021 from http://www.kurzweilai.net/googles-self-driving-car-gathers-nearly-1-gbsec/.Google Scholar
- [4] . 1990. A stack-based resource allocation policy for realtime processes. In Proceedings of the Real-Time Systems Symposium (RTSS’90).Google Scholar
Cross Ref
- [5] . 2020. How the world’s beaches are readying for a summer of social distancing. Washington Post. Retrieved November 20, 2021 from https://www.washingtonpost.com/world/2020/06/27/how-worlds-beaches-are-readying-summer-social-distancing/.Google Scholar
- [6] . 2005. Measuring the performance of schedulability tests. Real-Time Systems 30, 1-2 (2005), 129–154. Google Scholar
Digital Library
- [7] . 2019. From open-channel SSDs to zoned namespaces. In Proceedings of the Linux Storage and Filesystems Conference (Vault’19).Google Scholar
- [8] . 2013. The necessary death of the block device interface. In Proceedings of the Biennial Conference on Innovative Data Systems Research (CIDR’13).Google Scholar
- [9] . 2017. LightNVM: The Linux open-channel SSD subsystem. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’17). Google Scholar
Digital Library
- [10] . 2016. Internal parallelism of flash memory-based solid-state drives. ACM Transactions on Storage 12, 3 (2016), Article 13, 39 pages. Google Scholar
Digital Library
- [11] . 2011. Essential roles of exploiting internal parallelism of flash memory based solid state drives in high-speed data processing. In Proceedings of the IEEE International Symposium on High Performance Computer Architecture. Google Scholar
Digital Library
- [12] . 1999. Cleaning policies in mobile computers using flash memory. Journal of System Software 48, 3 (1999), 213–231. Google Scholar
Digital Library
- [13] . 2008. Deterministic service guarantees for NAND flash using partial block cleaning. In Proceedings of the IEEE/ACM/IFIP International Conference on Hardware/Software Codesign and System Synthesis. Google Scholar
Digital Library
- [14] . 2015. Purity: Building fast, highly-available enterprise flash storage from commodity components. In Proceedings of the ACM SIGMOD International Conference on Management of Data (SIGMOD’15). Google Scholar
Digital Library
- [15] . 2016. The tail at store: A revelation from millions of hours of disk and SSD deployments. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’16). Google Scholar
Digital Library
- [16] . 2018. Providing SLO compliance on NVMe SSDs through parallelism reservation. ACM Transactions on Design Automation of Electronic Systems 23, 3 (2018), Article 28, 26 pages. Google Scholar
Digital Library
- [17] . 2014. The multi-streamed solid-state drive. In Proceedings of the USENIX Workshop on Hot Topics in Storage and File Systems (HotStorage’14). Google Scholar
Digital Library
- [18] . 2011. SCM: An efficient interface for storage class memories. In Proceedings of IEEE Symposium on Mass Storage Systems and Technologies (MSST’11). Google Scholar
Digital Library
- [19] . 1995. A flash-memory based file system. In Proceedings of the USENIX Technical Conference on UNIX and Advanced Computing Systems. 155–164. Google Scholar
Digital Library
- [20] . 2015. Towards SLO complying SSDs through OPS isolation. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’15). Google Scholar
Digital Library
- [21] . 2011. Fast, energy efficient scan inside flash memory SSDs. In Proceedings of the International Workshop on Accelerating Data Management Systems.Google Scholar
- [22] . 2013. Extending the lifetime of flash-based storage through reducing write amplification from file systems. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’13). Google Scholar
Digital Library
- [23] . 2015. WARM: Improving NAND flash memory lifetime with write-hotness aware retention management. In Proceedings of the Conference on Mass Storage Systems and Technology (MSST’15).Google Scholar
Cross Ref
- [24] . 2014. A survey of address translation technologies for flash memories. ACM Computing Surveys 46, 3 (2014), 36. Google Scholar
Digital Library
- [25] . 2005. Micron Technical Report: Small-Block vs. Large-Block NAND Flash Devices.
Technical Report TN-29-07. Micron.Google Scholar - [26] . 2017. Micron Reveals Critical Technologies for Autonomous Vehicles. Retrieved November 20, 2021 from https://investors.micron.com/news-releases/news-release-details/micron-reveals-critical-technologies-autonomous-vehicles.Google Scholar
- [27] . 2018. NAND Flash Die—128Gb Die: X8 300mm MLC MT29F128G08CBECB. Retrieved November 20, 2021 from https://prod.micron.com/media/documents/products/data-sheet/nand-flash/die/l95b_die_128gb_nand.pdf.Google Scholar
- [28] . 2018. Partitioned real-time NAND flash storage. In Proceedings of the Real-Time Systems Symposium (RTSS’18).Google Scholar
Cross Ref
- [29] . 2010. How I learned to stop worrying and love flash endurance. In Proceedings of the USENIX Conference on Hot Topics in Storage and File Systems (FAST’10). Google Scholar
Digital Library
- [30] . 2013. Single Controller 4/8TB SSD. Retrieved November 20, 2021 from https://www.flashmemory summit.com/English/Collaterals/Proceedings/2013/20130815_301A_Oh.pdf.Google Scholar
- [31] . 2011. Hot data identification for flash-based storage systems using multiple Bloom filters. In Proceedings of the Conference on Massive Storage Systems and Technology (MSST’11).Google Scholar
Digital Library
- [32] . 2018. Management of next-generation NAND flash to achieve enterprise-level endurance and latency targets. ACM Transactions on Storage 14, 4 (2018), Article 33, 25 pages. Google Scholar
Digital Library
- [33] . 2016. Health-binning: Maximizing the performance and the endurance of consumer-level NAND flash. In Proceedings of the 9th ACM International Conference on Systems and Storage (SYSTOR’16). Google Scholar
Digital Library
- [34] . 2012. Real-time flash translation layer for NAND flash memory storage systems. In Proceedings of the IEEE Real-Time and Embedded Technology and Applications Symposium (RTAS’12). Google Scholar
Digital Library
- [35] . 1992. The design and implementation of a log-structured file system. ACM Transactions on Computer Systems 10, 1 (1992), 26–52. Google Scholar
Digital Library
- [36] . 2019. Tesla Cars Have a Memory Problem That May Cost You a Lot to Repair. https://insideevs.com/news/376037/tesla-mcu-emmc-memory-issue/.Google Scholar
- [37] . 2018. iNAND Automotive Embedded Flash Drives. Retrieved November 20, 2021 from https://www.sandisk.com/oem-design/automotive/inand.Google Scholar
- [38] . 2014. Flash on rails: Consistent flash performance through redundancy. In Proceedings of the USENIX Annual Technical Conference (ATC’14). Google Scholar
Digital Library
- [39] . 2014. Cosmos OpenSSD: A PCIe-Based Open Source SSD Platform. Retrieved November 20, 2021 from http://www.flashmemorysummit.com/English/Collaterals/Proceedings/\2014/20140807_301B_Song.pdf.Google Scholar
- [40] . 2020. How Drones Have Helped Fight COVID-19—And Become More Mainstream. Retrieved November 20, 2021 from https://dronedj.com/2020/06/04/.Google Scholar
- [41] . 2013. Improving flash write performance by using update frequency. In Proceedings of the International Conference on Very Large Data Bases (VLDB’13).Google Scholar
Digital Library
- [42] . 2019. Zoned Storage. Retrieved November 20, 2021 from http://zonedstorage.io.Google Scholar
- [43] . 1994. eNVy: A non-volatile, main memory storage system. ACM SIGPLAN Notices 29, 11 (1994), 86–97. Google Scholar
Digital Library
- [44] . 2017. Tiny-tail flash: Near-perfect elimination of garbage collection tail latencies in NAND SSDs. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’17). Google Scholar
Digital Library
- [45] . 2017. AutoStream: Automatic stream management for multi-streamed SSDs. In Proceedings of the ACM International Conference on Systems and Storage (SYSTOR’17). Google Scholar
Digital Library
- [46] . 2014. Don’t stack your log on my log. In Proceedings of the Workshop on Interactions of NVM/Flash with Operating Systems and Workloads (INFLOW’14).Google Scholar
- [47] . 2015. Optimizing deterministic garbage collection in NAND flash storage systems. In Proceedings of the Real-Time and Embedded Technology and Applications Symposium (RTAS’15). IEEE, Los Alamitos, CA.Google Scholar
Cross Ref
- [48] . 2013. LDPC-in-SSD: Making advanced error correction codes work effectively in solid state drives. In Proceedings of the USENIX Conference on File and Storage Technologies (FAST’13). Google Scholar
Digital Library
- [49] . 2016. A virtualized separation Kernel for mixed criticality systems. ACM Transactions on Computer Systems 34 (2016).Google Scholar
Digital Library
Index Terms
Telomere: Real-Time NAND Flash Storage
Recommendations
An Efficient NAND Flash File System for Flash Memory Storage
In this paper, we present an efficient flash file system for flash memory storage. Flash memory, especially NAND flash memory, has become a major method for data storage. Currently, a block level translation interface is required between an existing ...
A Pattern Adaptive NAND Flash Memory Storage Structure
To enhance performance of flash memory-based solid state disk (SSD), large logically chained blocks can be assembled by binding adjacent flash blocks across several flash memory chips. However, flash memory does not allow in-place overwriting and thus ...
An Efficient Memory-Mapped Key-Value Store for Flash Storage
SoCC '18: Proceedings of the ACM Symposium on Cloud ComputingPersistent key-value stores have emerged as a main component in the data access path of modern data processing systems. However, they exhibit high CPU and I/O overhead. Today, due to power limitations it is important to reduce CPU overheads for data ...






Comments