Article

Free access

Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs

Authors:

William J. Bolosky,

John R. Douceur,

Marvin TheimerAuthors Info & Claims

SIGMETRICS '00: Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems

Pages 34 - 43

https://doi.org/10.1145/339331.339345

Published: 01 June 2000 Publication History

Abstract

We consider an architecture for a serverless distributed file system that does not assume mutual trust among the client computers. The system provides security, availability, and reliability by distributing multiple encrypted replicas of each file among the client machines. To assess the feasibility of deploying this system on an existing desktop infrastructure, we measure and analyze a large set of client machines in a commercial environment. In particular, we measure and report results on disk usage and content; file activity; and machine uptimes, lifetimes, and loads. We conclude that the measured desktop infrastructure would passably support our proposed system, providing availability on the order of one unfilled file request per user per thousand days.

References

[1]

T. Anderson, M. Dahtin, J. Neefe, D. Patterson, D. Roselli, R. Wang. Serverless Network File Systems. 15th SOSP, p. 109-126, Dec I995.

Digital Library

[2]

T. Anderson, D. Culler, D. Patterson, the NOW team. A Case for NOW (Networks of Workstations). IEEE Micro. p. 54-64. Feb 1995.

Digital Library

[3]

R. Arpaci, A. Dusseau, A. V ahdat, L. Liu, T. Anderson, D. Patterson. The Interaction of Parallel and Sequential Workloads on a Network of Workstations. 1995 SIGMETRICS '95, p. 267-278, May 1995.

Digital Library

[4]

M. Baker, J. Hartmann, M. Kupfer, K. Shirriff, J. Ousterhout. Measurement of a Distributed File System. 13th SOSP, p. 198-212, Oct 1991.

Digital Library

[5]

W.J. Bolosky, S. Corbin, D. Goebel, J. R. Douceur. Single Instance Storage in Windows 2000. To appear in 4th Usenix Windows System Symposium, Aug 2000.

Digital Library

[6]

L. Breslau, P. Cao, L. Fan, G. Phillips, S. Shenker. Web caching and Zipf-like distributions: Evidence and implications. INFOCOM '99, p. 126-134, Mar 1999.

[7]

J.R. Douceur, W. J. Bolosky. A Large-Scale Study of File- System Contents. SIGMETRICS '99 27(1), p. 59-70, May t999.

Digital Library

[8]

J. R. Douceur, W. J. Bolosky. Sanitized Data Set from "'A Large-Scale Study of File-System Contents." CD-ROM. Microsoft Research, 1999.

[9]

F. Douglis, J. Ousterhout. Transparent Process Migration; Design Alternatives and the Sprite Implementation. Software - Practice and Experience 21(8), p. 757-785, Aug 1991.

Digital Library

[10]

J. E. Freund. Mathematical Statistics, Fifth Edition. Prentice Hall, 1992.

Digital Library

[11]

K. F. Gauss. Theoria combinationis observationum erroribus minimis obnoxiae, 1823.

[12]

D. K. Gifford. Weighted voting for replicated data. 7th SOSP, p. 150-162, 1979.

Digital Library

[13]

J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, M. West. Scale and Performance in a Distributed File System. TOCS 6(1), p. 51- 81, Feb 1988.

Digital Library

[14]

J. Kistler, M. Satyanarayanan. Disconnected operation in the Coda File System. TOCS 10(1), p. 3-25, Feb 1992.

Digital Library

[15]

E. Lee, C. Thekkath. Petal: Distributed virtual disks. 7th ASPLOS, p. 84-92, Oct 1996.

Digital Library

[16]

M. McKusick, W. Joy, S. Leffler, R. Fabry. A Fast File System for UNIX. TOCS, 2(3):181m197, Aug 1984.

Digital Library

[17]

L. Mummert, M. Satyanarayanan. Long Term Distributed File Reference Tracing: Implementation and Experience. Software - Practice and Experience 26(6), p. 705-736, Nov 1994.

Digital Library

[18]

M. M. Mutka, M. Livny. The Available Capacity of a Privately Owned Workstation Environment. Performance Evaluation 12(4), p. 269-284, Jut 1991.

Digital Library

[19]

M. Nelson, B. Welch, J. Ousterhout. Caching in the Sprite Network Filesystem. TOCS 6(1), p. 134-154, Feb 1988.

Digital Library

[20]

J. Ousterhout, H. Da Costa, D. Harrison, J. Junze, M. Kupfer, J. Thompson. A Trace-Driven Analysis of the UNIX 4.2 BSD File System. lOth SOSP, p. 15-24, Dec 1985.

Digital Library

[21]

D. Patterson, G. Gibson, R. Katz. A Case for Redundant Arrays of Inexpensive Disks (RAID). Internat. Conf. on Management of Data, p. 109-116, Jun 1988.

Digital Library

[22]

R. Rashid, A. Tevanian, M. Young, D. Golub, R. Baron, D. Black, W. Bolosky, J. Chew. Machine-Independent Virtual Memory Management for Paged Uniprocessor and Multiprocessor Architectures. 2nd ASPLOS, p. 31-41, Oct 1987.

Digital Library

[23]

R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, B. Lyon. Design and Implementation of the Sun Network File System. Summer USENIX Proceedings, 1985.

[24]

M. Satyanarayanan. Scalable, Secure and Highly Available Distributed File Access. IEEE Computer 23(5), May 1990.

Digital Library

[25]

Seagate Technology, Inc. http://seagate.com

[26]

D. Solomon. Inside Windows NT Second Edition. Microsoft Press, 1998.

Digital Library

[27]

C. Thekkath, T. Mann, E. Lee. Frangipani: A Scalable Distributed File System. 16th SOSP, p. 224-237, Dec 1997.

Digital Library

[28]

S. Travaglia. BOFH. http://www.theregister.co.uk/cgibi n/SearchA rticles.pl?search=BOFH

[29]

W. Vogels. File system usage in Windows NT 4.0. 17th SOSP, p. 93-109, Dec 1999.

Digital Library

[30]

B. Walker, G. Popek, R. English, C. Kline, G. Thiel. The LOCUS Distributed Operating System, 9th SOSP, p. 49-70, Oct 1983.

Digital Library

Cited By

Tang BFedak G(2022)WukaStore: Scalable, Configurable and Reliable Data Storage on Hybrid Volunteered Cloud and Desktop SystemsIEEE Transactions on Big Data10.1109/TBDATA.2017.27587918:1(85-98)Online publication date: 1-Feb-2022
https://doi.org/10.1109/TBDATA.2017.2758791
Liu JShen HChi HNarman HYang YCheng LChung W(2021)A Low-Cost Multi-Failure Resilient Replication Scheme for High-Data Availability in Cloud StorageIEEE/ACM Transactions on Networking10.1109/TNET.2020.302781429:4(1436-1451)Online publication date: Aug-2021
https://doi.org/10.1109/TNET.2020.3027814
Du JDeng JQi HDi XJiang Z(2020)A Cross-Domain Secure Deduplication Scheme Based on Threshold Blind SignatureMobile Wireless Middleware, Operating Systems and Applications10.1007/978-3-030-62205-3_7(78-91)Online publication date: 5-Nov-2020
https://doi.org/10.1007/978-3-030-62205-3_7
Show More Cited By

Index Terms

Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs

Recommendations

Feasibility of a serverless distributed file system deployed on an existing set of desktop PCs
Special issue on proceedings of ACM SIGMETRICS 2000

We consider an architecture for a serverless distributed file system that does not assume mutual trust among the client computers. The system provides security, availability, and reliability by distributing multiple encrypted replicas of each file among ...
Serverless network file systems
Special issue on operating system principles

We propose a new paradigm for network file system design: serverless network file systems. While traditional network file systems rely on a central server machine, a serverless system utilizes workstations cooperating as peers to provide all file system ...
Z/Os Distributed File Service Zseries File System Implementation Z/Os V1r10

Comments

Information & Contributors

Information

Published In

cover image ACM Conferences

SIGMETRICS '00: Proceedings of the 2000 ACM SIGMETRICS international conference on Measurement and modeling of computer systems

June 2000

329 pages

ISBN:1581131941

DOI:10.1145/339331

Chairmen:
Alexandre Brandwajn
Univ. of California, Santa Cruz, Santa Cruz
,
Jim Kurose
Univ. of Massachusetts-Amherst, Amherst
,
Phillippe Nain
INRIA, Sophia Antipolis, France

ACM SIGMETRICS Performance Evaluation Review Volume 28, Issue 1
Special issue on proceedings of ACM SIGMETRICS 2000
June 2000
327 pages
ISSN:0163-5999
DOI:10.1145/345063
Chairmen:
Alexandre Brandwajn
Univ. of California, Santa Cruz, Santa Cruz
,
Jim Kurose
Univ. of Massachusetts-Amherst, Amherst
,
Phillippe Nain
INRIA Sophia Antipolis, France
Issue’s Table of Contents

Copyright © 2000 ACM.

Permission to make digital or hard copies of all or part of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for components of this work owned by others than ACM must be honored. Abstracting with credit is permitted. To copy otherwise, or republish, to post on servers or to redistribute to lists, requires prior specific permission and/or a fee. Request permissions from [email protected]

Sponsors

SIGMETRICS: ACM Special Interest Group on Measurement and Evaluation

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 01 June 2000

Permissions

Request permissions for this article.

Request Permissions

Check for updates

Author Tags

Qualifiers

Article

Conference

SIGMETRICS00

Sponsor:

SIGMETRICS

SIGMETRICS00: The International Conference on Measurement and Modeling of Computer Systems

June 18 - 21, 2000

California, Santa Clara, USA

Acceptance Rates

SIGMETRICS '00 Paper Acceptance Rate 28 of 165 submissions, 17%;

Overall Acceptance Rate 459 of 2,691 submissions, 17%

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

384
Total Citations
View Citations
2,436
Total Downloads

Downloads (Last 12 months)157
Downloads (Last 6 weeks)23

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Tang BFedak G(2022)WukaStore: Scalable, Configurable and Reliable Data Storage on Hybrid Volunteered Cloud and Desktop SystemsIEEE Transactions on Big Data10.1109/TBDATA.2017.27587918:1(85-98)Online publication date: 1-Feb-2022
https://doi.org/10.1109/TBDATA.2017.2758791
Liu JShen HChi HNarman HYang YCheng LChung W(2021)A Low-Cost Multi-Failure Resilient Replication Scheme for High-Data Availability in Cloud StorageIEEE/ACM Transactions on Networking10.1109/TNET.2020.302781429:4(1436-1451)Online publication date: Aug-2021
https://doi.org/10.1109/TNET.2020.3027814
Du JDeng JQi HDi XJiang Z(2020)A Cross-Domain Secure Deduplication Scheme Based on Threshold Blind SignatureMobile Wireless Middleware, Operating Systems and Applications10.1007/978-3-030-62205-3_7(78-91)Online publication date: 5-Nov-2020
https://doi.org/10.1007/978-3-030-62205-3_7
Ning ZLi LLiang WZhao YFu QChen H(2019)A Novel Exploration for Blockchain in Distributed File StorageBlockchain and Trustworthy Systems10.1007/978-981-15-2777-7_60(740-746)Online publication date: 23-Dec-2019
https://doi.org/10.1007/978-981-15-2777-7_60
Li SLan TRa MPanta R(2018)Joint Scheduling and Source Selection for Background Traffic in Erasure-Coded StorageIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2018.284584529:12(2826-2837)Online publication date: 1-Dec-2018
https://doi.org/10.1109/TPDS.2018.2845845
Lin S(2018)An Encoding Algorithm of Triply Extended Reed–Solomon Codes With Asymptotically Optimal ComplexitiesIEEE Transactions on Communications10.1109/TCOMM.2017.273744166:8(3235-3244)Online publication date: Aug-2018
https://doi.org/10.1109/TCOMM.2017.2737441
Bejleri AMezini MEugster PDomnori E(2018)Cooperative decoupled processesSoftware Quality Journal10.1007/s11219-017-9366-626:3(1147-1183)Online publication date: 1-Sep-2018
https://dl.acm.org/doi/10.1007/s11219-017-9366-6
Ives Z(2018)Updates and Transactions in Peer-to-Peer SystemsEncyclopedia of Database Systems10.1007/978-1-4614-8265-9_1222(4345-4348)Online publication date: 7-Dec-2018
https://doi.org/10.1007/978-1-4614-8265-9_1222
Hatzieleftheriou AAnastasiadis S(2017)Client-Side Journaling for Durable Shared StorageACM Transactions on Storage10.1145/314937213:4(1-34)Online publication date: 17-Nov-2017
https://dl.acm.org/doi/10.1145/3149372
Chen WHu YYin SXia W(2017)EEC-Dedup: Efficient Erasure-Coded Deduplicated Backup Storage Systems2017 IEEE International Symposium on Parallel and Distributed Processing with Applications and 2017 IEEE International Conference on Ubiquitous Computing and Communications (ISPA/IUCC)10.1109/ISPA/IUCC.2017.00044(251-258)Online publication date: Dec-2017
https://doi.org/10.1109/ISPA/IUCC.2017.00044
Show More Cited By

View Options

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

Media

Figures

Other

Tables

View Table of Contents