Mayur R. Palankar
Simson Garfinkel
ABSTRACT
Amazon.com has introduced the Simple Storage Service (S3), a commodity-priced storage utility. S3 aims to provide storage as a low-cost, highly available service, with a simple 'pay-as-you-go' charging model. This article makes three contributions. First, we evaluate S3's ability to provide storage support to large-scale science projects from a cost, availability, and performance perspective. Second, we identify a set of additional functionalities that storage services targeting data-intensive science applications should support. Third, we propose unbundling the success metrics for storage utility performance as a solution, to reduce storage costs.
References
- The DZero Experiment. http://www-d0.fnal.govGoogle Scholar
- The Large Hadron Collider. http://lcg.web.cern.ch/LCGGoogle Scholar
- The Stanford Linear Collider. http://www2.slac.stanford.edu/vvc/experiments/slc.htmlGoogle Scholar
- The Compact Muon Solenoid at CERN. http://cmsinfo.cern.chGoogle Scholar
- Amazon Web Services. http:/s3.amazonaws.comGoogle Scholar
- PlanetLab Consortium. http://planet-lab.orgGoogle Scholar
- Garfinkel, S. 2007. Commodity Grid Computing with Amazon's S3 and EC2, Login, USENIX, February 2007.Google Scholar
- Kirkpatrick, M. 2006. Amazon releases early info on S3 storage use, http://www.techcrunch.com/tag/s3, July 2006.Google Scholar
- Bezos, J. keynote talk at Web 2.0 Expo, April 2007.Google Scholar
- Krawczyk, H., Bellare, M., and Canetti, R. 1997. HMAC: Keyed-Hashing for Message Authentication, IETF - Network Working Group, 1997. Google ScholarDigital Library
- W3C, Soap Version 1.2, June 2003, http://www.w3.org/TR/soap/Google Scholar
- Fielding, R. T. 2000. Architectural Styles and the Design of Network-Based Software Architectures, PhD Dissertation, University of California, Irvine, 2000. Google ScholarDigital Library
- BitTorrent. http://www.bittorrent.comGoogle Scholar
- Doraimani, S. 2007. Filecules: A New Granularity for Resource Management in Grids, Masters Thesis, University of South Florida, April 2007.Google Scholar
- Iamnitchi, A., Doraimani, S., and Garzoglio, G. 2006. Filecules in High-Energy Physics: Characteristics and Impact on Resource Management, 15th IEEE International Symposium on High Performance Distributed Computing (HPDC), June 2006.Google Scholar
- Oreily. REST vs. SOAP at Amazon. http://www.oreillynet.com/pub/wlg/3005?wlg=yesGoogle Scholar
- Paxson, V. 1996. End-to-end routing behavior in the Internet, Proceedings of the ACM SIGCOMM Conference on Applications, Technologies, Architectures, and Protocols for Computer Communications, vol 26.4, ACM SiGCOMM Computer Communication Review, pages 25--38, ACM Press, New York, August 1996. Google ScholarDigital Library
- Garfinkel, S. 2007. An Evaluation of Amazon's Grid Computing Services: EC2, S3 and SQS, Technical Report TR-08-07, School for Engineering and Applied Sciences, Harvard University, MA. July 2007.Google Scholar
- TeraGrid. http://www.teragrid.orgGoogle Scholar
- Odlyzko, A. M. 2000. The Internet and other networks: Utilization rates and their implications, Information Economics & Policy, vol. 12, 2000.Google Scholar
- Odlyzko, A. M. 1999. The current state and likely evolution of the Internet, in Proceedings of Globecom'99, pp. 1869--1875, IEEE, 1999.Google ScholarCross Ref
- Western Canada Research Grid. http://www.westgrid.caGoogle Scholar
- Ripeanu, M. and Iamnitchi, A. 2007. S4: A Simple Storage Service for Sciences, 16th IEEE International Symposium on High Performance Distributed Computing (HPDC), Monterey Bay, CA, June 2007.Google Scholar
- Palankar, M., Onibokun, A., Iamnitchi, A., and Ripeanu, M. 2007. Amazon S3 for Science Grids: a Viable Solution?, poster, 4th USENIX Symposium on Networked Systems Design & Implementation (NSDI'07), April 2007.Google Scholar
Index Terms
Amazon S3 for science grids: a viable solution?
Comments