Abstract
This paper proposes tailoring image encoding for an approximate storage substrate. We demonstrate that indiscriminately storing encoded images in approximate memory generates unacceptable and uncontrollable quality degradation. The key finding is that errors in the encoded bit streams have non-uniform impact on the decoded image quality. We develop a methodology to determine the relative importance of encoded bits and store them in an approximate storage substrate. The storage cells are optimized to reduce error rate via biasing and are tuned to meet the desired reliability requirement via selective error correction. In a case study with the progressive transform codec (PTC), a precursor to JPEG XR, the proposed approximate image storage system exhibits a 2.7x increase in density of pixels per silicon volume under bounded error rates, and this achievement is additive to the storage savings of PTC compression.
- M. Awasthi, M. Shevgoor, K. Sudan, B. Rajendran, R. Balasubramanian, and V. Srinivasan. Efficient scrub mechanisms for error-prone emerging memories. In Proceedings of the 18th International Symposium on High Performance Computer Architecture, February 2012.Google Scholar
Digital Library
- R. Azevedo, J. Davis, K. Strauss, M. Manasse, P. Gopalan, and S. Yekhanin. Zombie memory: Extending memory lifetime by reviving dead blocks. In Proceedings of the 40th International Symposium on Computer Architecture, June 2013.Google Scholar
Digital Library
- F. Bedeschi, R. Fackenthal, C. Resta, E. M. Donze, M. Jagasivamani, E. C. Buda, F. Pellizzer, D. W. Chow, A. Cabrini, G. Calvi, R. Faravelli, A. Fantini, G. Torelli, D. Mills, R. Gastaldi, and G. Casagrande. A bipolar-selected phase change memory featuring multi-level cell storage. IEEE Journal of Solid-State Circuits, 44 (1): 217--227, 2009.Google Scholar
Cross Ref
- Y. Cai, E. F. Haratsch, O. Mutlu, and K. Mai. Error patterns in MLC NAND Flash memory: Measurement, characterization, and analysis. In Proceedings of the Conference on Design, Automation and Test in Europe, DATE '12, pages 521--526, San Jose, CA, USA, 2012. EDA Consortium.Google Scholar
- F. Dufaux, G. J. Sullivan, and T. Ebrahimi. The JPEG XR image coding standard. IEEE Signal Processing Magazine, 26: 195--199, June 2009.Google Scholar
Cross Ref
- R. Franzen. Kodak Lossless True Color Image Suite: PhotoCD PCD0992, 2002.Google Scholar
- F. Frescura, M. Giorni, C. Feci, and S. Cacopardi. JPEG2000 and MJPEG2000 transmission in 802.11 wireless local area networks. IEEE Transactions on Consumer Electronics, 49 (4): 861--871, Nov 2003.Google Scholar
- M. Gastpar and M. Vetterli. Source-channel communication in sensor networks. Information Processing in Sensor Networks, pages 162--177, 2003.Google Scholar
Cross Ref
- M. Gastpar, B. Rimoldi, and M. Vetterli. To code, or not to code: Lossy source-channel communication revisited. Transactions on Information Theory, pages 1147--1158, 2003.Google Scholar
Digital Library
- Z. Guo, Y. Nishikawa, R. Y. Omaki, T. Onoye, and I. Shirakawa. A low-complexity FEC assignment scheme for motion JPEG2000 over wireless network. IEEE Trans. on Consum. Electron., 52 (1): 81--86, Feb. 2006.Google Scholar
Digital Library
- D. Holcomb and K. Fu. QBF-based synthesis of optimal word-splitting in approximate multi-level storage cells. In Workshop on Approximate Computing Across the System Stack (WACAS), 2014, March 2014.Google Scholar
- Ielmini, Lacaita, and Mantegazza]Ielmini2007aD. Ielmini, A. L. Lacaita, and D. Mantegazza. Recoverty and drift dynamics of resistance and threshold voltages in phase-change memories. IEEE Transactions on Electron Devices, 54 (2): 308--315, February 2007.Google Scholar
- Ielmini, Lavizzari, Sharma, and Lacaita]Ielmini2007bD. Ielmini, S. Lavizzari, D. Sharma, and A. L. Lacaita. Physical interpretation, modeling and impact on phase change memory (PCM) reliability of resistance drift due to chalcogenide structural relaxation. In Proceedings of the International Electron Devices Meeting, December 2007.Google Scholar
Cross Ref
- A. N. Jacobvitz, R. Calderbank, and D. J. Sorin. Coset coding to extend the lifetime of memory. In Proceedings of the 2013 IEEE 19th International Symposium on High Performance Computer Architecture (HPCA), pages 222--233, 2013.Google Scholar
Digital Library
- H. S. Malvar. Signal Processing with Lapped Transforms. Artech House, 1992. http://research.microsoft.com/apps/pubs/default.aspx?id=77707.Google Scholar
- H. S. Malvar. Fast progressive wavelet coding. In Proceedings of the Data Compression Conference, DCC '99, pages 336--343, Washington, DC, USA, 1999Google Scholar
Cross Ref
- H. S. Malvar. Fast progressive image coding without wavelets. In Proceedings of the Data Compression Conference, pages 243--252, March 2000.Google Scholar
Cross Ref
- H. S. Malvar. Adaptive Run-Length / Golomb-Rice encoding of quantized generalized gaussian sources with unknown statistics. In Proceedings of the Data Compression Conference, DCC '06, pages 23--32, Washington, DC, USA, 2006.Google Scholar
Digital Library
- Micron. Micron TLC NAND. http://www.micron.com/products/nand-flash/tlc-nand.Google Scholar
- N. Mielke, T. Marquart, N. Wu, J. Kessenich, H. Belgal, E. Schares, F. Trivedi, E. Goodness, and L. R. Nevill. Bit error rate in NAND flash memories. In IEEE International Reliability Physics Symposium, 2008. IRPS 2008., pages 9--19, April 2008.Google Scholar
Cross Ref
- T. Nirschl, J. B. Philipp, T. D. Happ, G. W. Burr, B. Rajendran, M.-H. Lee, A. Schrott, M. Yang, M. Breitwisch, C.-F. Chen, E. Joseph, M. C. Lamorey, R. Cheek, S.-H. Chen, S. Zaidi, S. Raoux, Y.-C. Chen, Y. Zhu, R. Bergmann, H. L. Lung, and C. Lam. Write strategies for 2 and 4-bit multi-level phase-change memory. In IEEE International Electron Devices Meeting, 2007. IEDM 2007., pages 461--464, 2007.Google Scholar
Cross Ref
- N. Papandreou, H. Pozidis, A. Pantazi, A. Sebastian, M. Breitwisch, C. Lam, and E. Eleftheriou. Programming algorithms for multilevel phase-change memory. In 2011 IEEE International Symposium on Circuits and Systems (ISCAS), pages 329--332, May 2011.Google Scholar
Cross Ref
- W. B. Pennebaker and J. L. Mitchell. JPEG: Still image data compression standard. Technical report, Springer, 1993.Google Scholar
- M. K. Qureshi. Pay-as-you-go: Low-overhead hard-error correction for phase change memories. In Proceedings of the 44th Annual IEEE/ACM International Symposium on Microarchitecture, pages 318--328, 2011.Google Scholar
Digital Library
- and Karidis]Qureshi2010M. K. Qureshi, M. M. Franceschini, L. A. Lastras-Monta\ no, and J. P. Karidis. Morphable memory system: A robust architecture for exploiting multi-level phase change memories. In Proceedings of the 37th Annual International Symposium on Computer Architecture, ISCA '10, pages 153--162, New York, NY, USA, 2010.Google Scholar
Digital Library
- F. Sala, R. Gabrys, and L. Dolecek. Dynamic threshold schemes for multi-level non-volatile memories. IEEE Transactions on Communications, 61 (7): 2624--2634, July 2013.Google Scholar
Cross Ref
- A. Sampson, J. Nelson, K. Strauss, and L. Ceze. Approximate storage. In Proceedings of the 46th International Conference on Microarchitecture, December 2013.Google Scholar
- Samsung. Samsung SSD Product Story: 3-bit/cell MLC NAND Flash. http://www.samsung.com/global/business/semiconductor/minisite/SSD/global/html/why/MlcNandFlash.html.Google Scholar
- J. W. Schwartz and R. C. Barker. Bit-plane encoding: A technique for source encoding. IEEE Transactions on Aerospace and Electronic Systems, AES-2 (4): 385--392, July 1966.Google Scholar
Cross Ref
- N. H. Seong, S. Yeo, and H.-H. S. Lee. Tri-level-cell phase change memory: Toward an efficient and reliable memory system. In Proceedings of the 40th International Symposium on Computer Architecture, June 2013.Google Scholar
Digital Library
- M. Stanisavljevic, A. Athmanathan, N. Papandreou, H. Pozidis, and E. Eleftheriou. Phase-change memory: Feasibility of reliable multilevel-cell storage and retention at elevated temperatures. In Reliability Physics Symposium (IRPS), 2015 IEEE International, pages 5B.6.1--5B.6.6, April 2015.Google Scholar
Cross Ref
- S. Vembu, S. Verdú, and Y. Steinberg. The source-channel separation theorem revisited. IEEE Transactions on Information Theory, 41: 44--45, January 1995.Google Scholar
Digital Library
- X. Wei and Z. Tong. A time-aware fault tolerance scheme to improve reliability of multilevel phase-change memory in the presence of significant resistance drift. IEEE Transactions on Very Large Scale Integration (VLSI) Systems, 19 (8): 1357--1367, 2011.Google Scholar
Digital Library
- J. Y. Wu, W. S. Khwa, M. H. Lee, H. P. Li, S. C. Lai, T. H. Su, M. L. Wei, T. Y. Wang, M. BrightSky, T. S. Chen, W. C. Chien, S. Kim, R. Cheek, H. Y. Cheng, E. K. Lai, Y. Zhu, H. L. Lung, and C. Lam. Greater than 2-bits/cell mlc storage for ultra high density phase change memory using a novel sensing scheme. In 2015 Symposium on VLSI Technology, 2015.Google Scholar
Cross Ref
- E. Yaakobi, L. Grupp, P. Siegel, S. Swanson, and J. Wolf. Characterization and error-correcting codes for tlc flash memories. In 2012 International Conference on Computing, Networking and Communications (ICNC), pages 486--491, Jan 2012.Google Scholar
Cross Ref
- D. H. Yoon, N. Muralimanohar, J. Chang, P. Ranganathan, N. P. Jouppi, and M. Erez. FREE-p: Protecting non-volatile memory against both hard and soft errors. In Proceedings of the 2011 IEEE 17th International Symposium on High Performance Computer Architecture, pages 466--477, 2011.Google Scholar
Cross Ref
- D. H. Yoon, J. Chang, R. S. Schreiber, and N. P. Jouppi. Practical nonvolatile multilevel-cell phase change memory. In Proceedings of the International Conference on High Performance Computing, Networking, Storage and Analysis (SC'13), pages 21:1--21:12, 2013.Google Scholar
Digital Library
- W. Zhang and T. Li. Helmet: A resistance drift resilient architecture for multi-level cell phase change memory system. In IEEE/IFIP 41st International Conference on Dependable Systems Networks (DSN), pages 197--208, June 2011.Google Scholar
Digital Library
- T. Wiegand, G.J. Sullivan, G. Bjontegaard, and A. Luthra. Overview of the H.264/AVC video coding standard In IEEE Transactions on Circuits and Systems for Video Technology, vol. 13, pp. 560--576, July 2003.Google Scholar
Digital Library
Index Terms
High-Density Image Storage Using Approximate Memory Cells
Recommendations
Approximate Storage of Compressed and Encrypted Videos
ASPLOS '17: Proceedings of the Twenty-Second International Conference on Architectural Support for Programming Languages and Operating SystemsThe popularization of video capture devices has created strong storage demand for encoded videos. Approximate storage can ease this demand by enabling denser storage at the expense of occasional errors. Unfortunately, even minor storage errors, such as ...
High-Density Image Storage Using Approximate Memory Cells
ASPLOS'16This paper proposes tailoring image encoding for an approximate storage substrate. We demonstrate that indiscriminately storing encoded images in approximate memory generates unacceptable and uncontrollable quality degradation. The key finding is that ...
High-Density Image Storage Using Approximate Memory Cells
ASPLOS '16: Proceedings of the Twenty-First International Conference on Architectural Support for Programming Languages and Operating SystemsThis paper proposes tailoring image encoding for an approximate storage substrate. We demonstrate that indiscriminately storing encoded images in approximate memory generates unacceptable and uncontrollable quality degradation. The key finding is that ...







Comments