skip to main content
research-article

Data Sorting in Flash Memory

Authors Info & Claims
Published:20 March 2015Publication History
Skip Abstract Section

Abstract

Because flash memory now provides an economical solution for various portable devices and embedded systems, an NAND flash-based storage system has replaced the hard disk drive in many applications. Recently, the implementation of database systems using an NAND flash-based storage system has become an important research topic. In particular, the external sorting is an important operation in database systems. With the very distinctive characteristics of flash memory, the typical external sorting system that adopts a clustered sorting process can result in performance degradation and reduce the reliability of flash memory. In this article, we will propose an unclustered sorting method that considers the unique characteristics of flash memory, and we then propose a decision rule to exploit the advantages of both clustered and unclustered sorting. The decision rule can separate records according to their record length, sort them appropriately by the clustered and unclustered sorting, and merge the sorted results. The experimental results show that the proposed method can improve performance in an NAND flash-based storage system (i.e., solid-state drive).

References

  1. Simona Boboila and Peter Desnoyers. 2011. Performance models of flash-based solid-state drives for real workloads. In Proceedings of the IEEE Symposium on Mass Storage Systems and Technologies (MSST). Google ScholarGoogle ScholarDigital LibraryDigital Library
  2. Tyler Cossentine and Ramon Lawrence. 2013. Efficient external sorting on flash memory embedded devices. International Journal of Database Managemen Systems (IJDMS) 5, 1 (2013), Article No. 1.Google ScholarGoogle Scholar
  3. Peter Desnoyers. 2014. Analytic models of SSD write performance. ACM Transactions on Storage (TOS) 10, 2 (2014), Article No. 8. Google ScholarGoogle ScholarDigital LibraryDigital Library
  4. Samsung Electronics. 2011. NAND Flash-Memory Datasheet and SmartMedia Data Book.Google ScholarGoogle Scholar
  5. Fpers. 2015. Retrieved from http://www.myflorida.com/dmsweb/411/fpers.dat.Google ScholarGoogle Scholar
  6. Goetz Graefe. 2006. Implementing sorting in database systems. Computer Surveys 38, 3 (2006), Article No. 10. Google ScholarGoogle ScholarDigital LibraryDigital Library
  7. Donald E. Knuth. 1998. Art of Computer Programming. Addison-Wesley. Google ScholarGoogle ScholarDigital LibraryDigital Library
  8. Per-Ake Larson. 2003. External sorting: Run formation revisited. IEEE Transactions on Knowledge and Data Eng. 15, 4 (2003), 961--972. Google ScholarGoogle ScholarDigital LibraryDigital Library
  9. Per-Åke Larson and Goetz Graefe. 1998. Memory management during run generation in external sorting. ACM SIGMOD Record 27, 2 (1998), 472--483. Google ScholarGoogle ScholarDigital LibraryDigital Library
  10. Sang-Won Lee, Dong-Joo Park, Tae-Sun Chung, Dong-Ho Lee, Sangwon Park, and Ha-Joo Song. 2007. A log buffer-based flash translation layer using fully-associative sector translation. ACM Transactions on Embedded Computing Systems 6, 3 (2007), Article No. 18. Google ScholarGoogle ScholarDigital LibraryDigital Library
  11. Xiqing Li, Gordon Linoff, Stephen J. Smith, Craig Stanfill, and Kurt Thearling. 1993. A practical external sort for dhared disk MPPs. In Proceedings of the ACM/IEEE Conference on Supercomputing. 666--675. Google ScholarGoogle ScholarDigital LibraryDigital Library
  12. Track Metadata. 2015. Million Song Dataset. Retrieved from http://labrosa.ee.columbia.edu/millionsong/pages/getting-dataset.Google ScholarGoogle Scholar
  13. Hyoungmin Park and Kyuseok Shim. 2009. FAST: Flash-aware external sorting for mobile database systems. Journal of Systems and Software 82, 8 (2009), 1298--1312. Google ScholarGoogle ScholarDigital LibraryDigital Library
  14. Raghu Ramakrishnan and Johannes Gehrke. 2003. Database Management Systems. McGraw-Hill. Google ScholarGoogle ScholarDigital LibraryDigital Library
  15. Betty Salzberg, Alex Tsukerman, Jim Gray, Michael Stuewart, Susan Uren, and Bonnie Vaughan. 1990. A distributed single-input single-output external sort. In Proceedings of the ACM SIGMOD Conference. 94--101. Google ScholarGoogle ScholarDigital LibraryDigital Library
  16. Chin-Hsien Wu. 2012. Data sorting in flash memory. In Proceedings of the ACM Symposium on Applied Computing (SAC). 1847--1849. Google ScholarGoogle ScholarDigital LibraryDigital Library
  17. John Yiannis and Justin Zobel. 2007. Compression techniques for fast external sorting. International Journal on Very Large Data Bases 16, 2 (2007), 269--291. Google ScholarGoogle ScholarDigital LibraryDigital Library
  18. Weiye Zhang and Per-Ake Larson. 1997. Dynamic memory adjustment for external mergesort. In Proceedings of the 23rd International Conference on Very Large Data Bases (VLDB). 376--385. Google ScholarGoogle ScholarDigital LibraryDigital Library

Index Terms

  1. Data Sorting in Flash Memory

              Recommendations

              Comments

              Login options

              Check if you have access through your login credentials or your institution to get full access on this article.

              Sign in

              Full Access

              • Published in

                cover image ACM Transactions on Storage
                ACM Transactions on Storage  Volume 11, Issue 2
                March 2015
                123 pages
                ISSN:1553-3077
                EISSN:1553-3093
                DOI:10.1145/2747982
                • Editor:
                • Darrell Long
                Issue’s Table of Contents

                Copyright © 2015 ACM

                Publisher

                Association for Computing Machinery

                New York, NY, United States

                Publication History

                • Published: 20 March 2015
                • Accepted: 1 August 2014
                • Revised: 1 June 2014
                • Received: 1 August 2012
                Published in tos Volume 11, Issue 2

                Permissions

                Request permissions about this article.

                Request Permissions

                Check for updates

                Qualifiers

                • research-article
                • Research
                • Refereed

              PDF Format

              View or Download as a PDF file.

              PDF

              eReader

              View online with eReader.

              eReader
              About Cookies On This Site

              We use cookies to ensure that we give you the best experience on our website.

              Learn more

              Got it!