Abstract
In this paper, we propose a novel two-step approach to the management of the storage caches to provide predictable performance in multi-server storage architectures: (1) An adaptive QoS decomposition and optimization step uses max-flow algorithm to determine the best decomposition of application-level QoS to sub-QoSs such that the application performance is optimized, and (2) A storage cache allocation step uses feedback control theory to allocate shared storage cache space such that the specified QoSs are satisfied throughout the execution.
- A. Ching. Evaluating I/O characteristics and methods for storing structured scientific data. In IPDPS, 2006. Google Scholar
Digital Library
- P. Goyal et al. Cachecow: Providing QoS for storage system caches. In SIGMETRICS, 2003. Google Scholar
Digital Library
- A. N. Laboratories. Parallel I/O benchmarking consortium. http://www.mcs.anl.gov/research/projects/pio-benchmark/.Google Scholar
- H. Shan et al. Using IOR to analyze the I/O performance for HPC platforms. In Technical Report, National Energy Research Scientific Computing Center (NERSC), Computational Research Division, Lawrence Berkeley National Laboratory, 2003.Google Scholar
- S. Uttamchandani et al. Polus: Growing storage QoS management beyond a "4-year old kid". In FAST, 2004. Google Scholar
Digital Library
- P.Wong and R. F. V.Wijngaart. NAS parallel benchmarks I/O version 2.4. NASA Technical Report, 2003.Google Scholar
Index Terms
QoS aware storage cache management in multi-server environments
Recommendations
QoS aware storage cache management in multi-server environments
PPoPP '11: Proceedings of the 16th ACM symposium on Principles and practice of parallel programmingIn this paper, we propose a novel two-step approach to the management of the storage caches to provide predictable performance in multi-server storage architectures: (1) An adaptive QoS decomposition and optimization step uses max-flow algorithm to ...
Adaptive QoS Decomposition and Control for Storage Cache Management in Multi-server Environments
CCGRID '11: Proceedings of the 2011 11th IEEE/ACM International Symposium on Cluster, Cloud and Grid ComputingPoor I/O performance can prevent an application from scaling to a large number of nodes even if the computation is parallelized appropriately. Therefore, improving I/O performance of large-scale parallel applications is very important. Caching recently ...
Adaptive multi-level cache allocation in distributed storage architectures
ICS '10: Proceedings of the 24th ACM International Conference on SupercomputingIncreasing complexity of large-scale applications and continuous increases in data set sizes of such applications combined with slow improvements in disk access latencies has resulted in I/O becoming a performance bottleneck. While there are several ...







Comments