Elizeu Santos-Neto
ABSTRACT
Today, several data-storage systems allow applications to create and manage custom metadata to improve data search and navigability in large scale storage systems.
Our thesis is that, besides improving search and navigability, custom metadata can also serve as a two way communication mechanism between applications and the storage layer to enable cross-layer optimizations in a uniform, application-independent and incremental fashion.
- MetaFS, http://metafs.sourceforge.net/. 2008.Google Scholar
- Adar, E., D. Karger, and L. Stein. Haystack: Per-User Information Environments. in International conference on Information and knowledge management. 1999. Google ScholarDigital Library
- Ames, S., et al. Richer file system metadata using links and attributes. in the 22nd IEEE / 13th NASA Goddard Conference on Mass Storage Systems and Technologies. 2005. Google ScholarDigital Library
- Ames, S., et al. LiFS: An attribute-rich file system for storage class memories. in 23rd IEEE / 14th NASA Goddard Conference on Mass Storage Systems and Technologies. 2006.Google Scholar
- Casanova, H., et al., Heuristics for Scheduling Parameter Sweep applications in Grid environments, in Heterogeneous Computing Workshop (HCW). 2000. Google ScholarDigital Library
- Fonseca, R., et al., IP Options are not an option, in Technical Report No. UCB/EECS-2005-24. 2005.Google Scholar
- Gifford, D.K., et al. Semantic file systems. in CM SIGOPS Operating Systems. 1991. Google ScholarDigital Library
- Gurtov, A. and S. Floyd, Modeling wireless links for transport protocols. ACM SIGCOMM Computer Communication Review, 2004. 34(2): p. 85 -- 96. Google ScholarDigital Library
- Gurtov, A. and R. Ludwig, Lifetime packet discard for efficient real-time transport over cellular links. ACM SIGMOBILE Mobile Computing and Communications Review, 2003. 7(4): p. 32 -- 45. Google ScholarDigital Library
- Iamnitchi, A., S. Doraimani, and G. Garzoglio. Filecules in High-Energy Physics: Characteristics and Impact on Resource Management. in HPDC 2006. 2006. France.Google Scholar
- Koren, J., et al. Searching and Navigating Petabyte Scale File Systems Based on Facets. in Workshops of International Conference for High Performance Computing, Networking, Storage, and Analysis (SC '07). 2004. Reno, NV. Google ScholarDigital Library
- Maltzahn, C., et al. Graffiti: A Framework for Testing Collaborative Distributed Metadata. in Informatics 21. 2007.Google Scholar
- Mandal, A., et al. Scheduling Strategies for Mapping Application Workflows onto the Grid. in IEEE International Symposium on High Performance Distributed Computing. 2005. Google ScholarDigital Library
- Otoo, A.E., D. Rotem, and A. Romosan. Optimal File-Bundle Caching Algorithms for Data-Grids. in Supercomputing. 2004. Google ScholarDigital Library
- Raicu, I., et al. Falkon: a Fast and Light-weight tasK executiON framework. in SuperComputing. 2007. Google ScholarDigital Library
- Reinsel, D., A Forecast of Worldwide Information Growth Through 2010, in IDC White Paper. 2007.Google Scholar
- Santos-Neto, E., et al. Exploiting replication and data reuse to efficiently schedule data-intensive applications on grids. in Workshop on Job Scheduling Strategies for Parallel Processing. 2004. Google ScholarDigital Library
- Simmhan, Y.L., B. Plale, and D. Gannon. A survey of data provenance in e-science. in ACM SIGMOD Record. 2005. Google ScholarDigital Library
- Singh, G., et al. A Metadata Catalog Service for Data Intensive Applications. in Supercomputing. 2003. Google ScholarDigital Library
- Skraba, P., et al. Cross-layer optimization for high density sensor networks: Distributed passive routing. in Ad-Hoc, Mobile, and Wireless Networks (ADHOC-NOW). 2004. Berlin, Germany.Google Scholar
- Wang, J., M. Venkatachalam, and Y. Fang, System Architecture and Cross-Layer Optimization of Video Broadcast over WiMAX. IEEE Journal on Selected Areas in Communications, 2007. 25(4). Google ScholarDigital Library
- Warrier, A., L. Le, and I. Rhee. Cross-layer Optimization Made Practical. in IEEE International Conference of Broadband Communications, Networks, and Systems (Broadnets). 2007.Google Scholar
Index Terms
enabling cross-layer optimizations in storage systems with custom metadata
Recommendations
Meta-Block: Exploiting Cross-Layer and Direct Storage Access for Decentralized Blockchain Storage Systems
Decentralized storage systems such as blockchain storage applications adopt the distributed storage technology and use distributed storage nodes to store the persistent data. For each off-chain storage node, keyvalue (KV) stores are normally used to ...
The Case for Custom Storage Backends in Distributed Storage Systems
SOSP 2019 Special Section and Regular PapersFor a decade, the Ceph distributed file system followed the conventional wisdom of building its storage backend on top of local file systems. This is a preferred choice for most distributed file systems today, because it allows them to benefit from the ...
Comments