article

Farsite: federated, available, and reliable storage for an incompletely trusted environment

Authors:

William J. Bolosky,

Ronnie Chaiken,

John R. Douceur,

Jacob R. Lorch,

Marvin Theimer,

Roger P. WattenhoferAuthors Info & Claims

ACM SIGOPS Operating Systems Review, Volume 36, Issue SI

Pages 1 - 14

https://doi.org/10.1145/844128.844130

Published: 31 December 2002 Publication History

Abstract

Farsite is a secure, scalable file system that logically functions as a centralized file server but is physically distributed among a set of untrusted computers. Farsite provides file availability and reliability through randomized replicated storage; it ensures the secrecy of file contents with cryptographic techniques; it maintains the integrity of file and directory data with a Byzantine-fault-tolerant protocol; it is designed to be scalable by using a distributed hint mechanism and delegation certificates for pathname translations; and it achieves good performance by locally caching file data, lazily propagating file updates, and varying the duration and granularity of content leases. We report on the design of Farsite and the lessons we have learned by implementing much of that design.

References

[1]

T. Anderson, M. Dahlin, J. Neefe, D. Patterson, D. Roselli, R. Wang. Serverless Network File Systems. 15th SOSP, Dec 1995.]]

Digital Library

[2]

R. J. Anderson, "The Eternity Service", PRAGO-CRYPT '96, CTU Publishing, Sep/Oct 1996.]]

[3]

R. E. Blahut, Theory and Practice of Error Control Codes, Addison Wesley, 1983.]]

[4]

M. G. Baker, J. H. Hartman, M. D. Kupfer, K. W. Shirriff, J. K. Ousterhout. "Measurements of a Distributed File System." 13th SOSP, Oct 1991.]]

Digital Library

[5]

M. Blaze, "A Cryptographic File System for Unix", 1st Computer and Comm. Security, ACM, Nov 1993.]]

Digital Library

[6]

W. J. Bolosky, J. R. Douceur, D. Ely, and M. Theimer, "Feasibility of a Serverless Distributed File System Deployed on an Existing Set of Desktop PCs", SiGMETRICS 2000, ACM, Jun 2000.]]

Digital Library

[7]

W. J. Bolosky, S. Corbin, D. Goebel, J. R. Douceur. Single Instance Storage in Windows 2000. 4th Usenix Windows System Symposium, Aug 2000.]]

Digital Library

[8]

M. Castro and B. Liskov, "Practical Byzantine Fault Tolerance", 3rd OSDI, USENIX, Feb 1999.]]

Digital Library

[9]

I. Clarke, O. Sandberg, B. Wiley, and T. Hong, "Freenet: A Distributed Anonymous Information Storage and Retrieval System", ICSI Workshop on Design Issues in Anonymity and Unobervability, Jul 2000.]]

Digital Library

[10]

F. Dabek, M. F. Kaashoek, D. Karger, R. Morris, I. Stoica, "Wide-Area Cooperative Storage with CFS", SOSP, Oct 2001.]]

Digital Library

[11]

J. R. Douceur, "The Sybil Attack", 1st IPTPS, Mar 2002.]]

Digital Library

[12]

J. R. Douceur, A. Adya, W. J. Bolosky, D. Simon, M. Theimer, "Reclaiming Space from duplicate Files in a Serverless Distributed File System", ICDCS, Jul 2002.]]

Digital Library

[13]

J. R. Douceur and W. J. Bolosky, "A Large-Scale Study of File-System Contents", SIGMETRICS, May 1999.]]

Digital Library

[14]

J. R. Douceur and R. P. Wattenhofer, "Optimizing File Availability in a Secure Serverless Distributed File System", 20th SRDS, IEEE, Oct 2001.]]

[15]

J. R. Douceur, A. Adya; J. Benaloh; W. J. Bolosky; G. Yuval, "A Secure Directory Service based on Exclusive Encryption", (to appear) 18th ACSAC, Dec 2002.]]

Digital Library

[16]

J. Gemmell, E. M. Schooler, J. Gray, "Fcast Multicast File Distribution: 'Tune in, Download, and Drop Out'", Internet, Multimedia Systems and Applications, 1999.]]

[17]

Gnutella, http://gnutelladev.wego.com.]]

[18]

A. Goldberg and P. Yianilos, "Towards an Archival Intermemory", International Forum on Research and Technology Advances in Digital Libraries, Apr 1998.]]

Digital Library

[19]

J. Gray. "Why do Computers Stop and What Can Be Done About It?", 5th SRDS, Jan. 1986.]]

[20]

J. Gray and A. Reuter, Transaction Processiong: Concepts and Techniques. Morgan Kaufmann, 1993.]]

Digital Library

[21]

J. Howard, M. Kazar, S. Menees, D. Nichols, M. Satyanarayanan, R. Sidebotham, M. West, "Scale and Performance in a Distributed File System", TOCS 6(1), Feb 1988.]]

Digital Library

[22]

J. Kistler, M. Satyanarayanan. Disconnected operation in the Coda File System. TOCS 10(l), Feb 1992.]]

Digital Library

[23]

J. Kubiatowicz, et al., "OceanStore: An Architecture for Global-Scale Persistent Storage", 9th ASPLOS, ACM, Nov 2000.]]

Digital Library

[24]

E. Lee, C. Thekkath. Petal: Distributed virtual disks. 7th ASPLOS, Oct 1996.]]

Digital Library

[25]

M. Luby, "Benchmark Comparisons of Erasure Codes", http://www.icsi.berkeley.edu/~luby/erasure.html]]

[26]

D. Mazières, M. Kaminsky, M. F. Kaashoek, E. Witchel, "Separating Key Management from File System Security", SOSP, Dec 1999.]]

Digital Library

[27]

D. Mazières and D. Shasha, "Don't Trust Your File Server", 8th HotOS, May 2001.]]

Digital Library

[28]

M. McKusick, W. Joy, S. Leffler, R. Fabry. A Fast File System for UNIX. TOCS, 2(3):181--197, Aug 1984.]]

Digital Library

[29]

A. J. Menezes, P. C. van Oorschot, S. A. Vanstone. Handbook of Applied Cryptography. CRC Press, 1997.]]

Digital Library

[30]

R. Merkle, "Protocols for Public Key Cryptosystems", IEEE Symposium on Security and Privacy, 1980.]]

[31]

Microsoft, "File Name Conventions", MSDN, Apt 2002.]]

[32]

Microsoft, "About Windows Update", http://v4.windowsupdate.microsoft.com/en/about.asp]]

[33]

Napster, http://www.napster.com.]]

[34]

E. Nemeth, G. Snyder, S. Seebass, T. R. Hein, UNIX System Administration Handbook, Prentice Hall, 2000.]]

Digital Library

[35]

J. K. Ousterhout, A, R. Cherenson, F. Douglis, M. N. Nelson, B. B. Welch, "The Sprite Network Operating System", IEEE Computer Group Magazine 21 (2), 1988.]]

Digital Library

[36]

M. Pease, R. Shostak, L. Lamport "Reaching Agreement in the Presence of Faults", JACM 27(2), Apr 1980.]]

Digital Library

[37]

G. J. Popek, R. G. Guy, T. W. Page, J. S. Heidemann, "Replication in Ficus Distributed File Systems", IEEE Workshop on Management of Replicated Data, 1990.]]

[38]

A. Rowstron and P. Druschel. "Storage Management and Caching in PAST, a Large-Scale, Persistent Peer-to-Peer Storage Utility", SOSP, Oct 2001.]]

Digital Library

[39]

R. Sandberg, D. Goldberg, S. Kleiman, D. Walsh, B. Lyon. Design and Implementation of the Sun Network File System. Summer USENIX Proceedings, 1985.]]

[40]

D. S. Santry, M. J. Feeley, N. C. Hutchinson, A. C. Veitch, R. W. Carton, J. Ofir, "Deciding When to Forget in the Elephant File System", 17th SOSP, Dec 1999.]]

Digital Library

[41]

S. T. Shafer, "The Enemy Within", Red Herring, Jan 2002.]]

[42]

D. A. Solomon and M. E. Russinovich, Inside Microsoft Windows 2000 Third Edition, Microsoft Press, 2000.]]

Digital Library

[43]

A. Sweeny, D. Doucette, W. Hu, C. Anderson, M. Nishimoto, G. Peck, "Scalability in the XFS File System", USENIX, 1996.]]

Digital Library

[44]

D. B. Terry, M. M. Theimer, K. Petersen, A. J. Demers, Managing Update Conflicts in Bayou, a Weakly Connected Replicated Storage System, 15th SOSP, 1995.]]

Digital Library

[45]

C. Thekkath, T. Mann, E. Lee. Frangipani: A Scalable Distributed File System. 16th SOSP, Dec 1997.]]

Digital Library

[46]

M. Tompa and H. Woll, "How to Share a Secret with Cheaters", Journal of Cryptology 1(2), 1998.]]

Digital Library

[47]

S, Travaglia, P. Abrams, Bastard Operator from Hell, Plan Nine Publishing, Apr 2001.]]

[48]

W. Vogels. File system usage in Windows NT 4.0. 17th SOSP, Dec 1999.]]

Digital Library

[49]

J. Wylie, M. Bigrigg, J. Strunk, G. Ganger, H. Kilite, P. Khosla, "Survivalbe Information Storage Systems", IEEE Computer 33(8), Aug 2000.]]

Digital Library

[50]

B. Yee and J. D. Tygar, "Secure Coprocessors in Electronic Commerce Applications", USENIX 95, 1995.]]

Digital Library

Cited By

Yang FDing ZJia LSun YZhu Q(2024)Blockchain-Based File Replication for Data Availability of IPFS ConsumersIEEE Transactions on Consumer Electronics10.1109/TCE.2024.336423770:1(1191-1204)Online publication date: 9-Feb-2024
https://dl.acm.org/doi/10.1109/TCE.2024.3364237
Babakian AHuston GBraun RLipman J(2024)Internet Identifiers: A Survey of History, Challenges, and Future PerspectivesIEEE Access10.1109/ACCESS.2024.338211512(51919-51941)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3382115
Liao GAbadi D(2023)FileScaleProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624784(459-474)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624784
Show More Cited By

Index Terms

Farsite: federated, available, and reliable storage for an incompletely trusted environment

Recommendations

The Farsite project: a retrospective
Systems work at Microsoft Research

The Farsite file system is a storage service that runs on the desktop computers of a large organization and provides the semantics of a central NTFS file server. The motivation behind the Farsite project was to harness the unused storage and network ...
Farsite: federated, available, and reliable storage for an incompletely trusted environment
OSDI '02: Proceedings of the 5th symposium on Operating systems design and implementation (Copyright restrictions prevent ACM from being able to make the PDFs for this conference available for downloading)

Farsite is a secure, scalable file system that logically functions as a centralized file server but is physically distributed among a set of untrusted computers. Farsite provides file availability and reliability through randomized replicated storage; ...
Distributed directory service in the farsite file system
OSDI '06: Proceedings of the 7th USENIX Symposium on Operating Systems Design and Implementation - Volume 7

We present the design, implementation, and evaluation of a fully distributed directory service for Farsite, a logically centralized file system that is physically implemented on a loosely coupled network of desktop computers. Prior to this work, the ...

Comments

Information & Contributors

Information

Published In

cover image ACM SIGOPS Operating Systems Review

ACM SIGOPS Operating Systems Review Volume 36, Issue SI

OSDI '02: Proceedings of the 5th Symposium on Operating Systems Design and Implementation

Winter 2002

398 pages

ISSN:0163-5980

DOI:10.1145/844128

Issue’s Table of Contents

Copyright © 2002 Copyright is held by the owner/author(s).

Permission to make digital or hard copies of part or all of this work for personal or classroom use is granted without fee provided that copies are not made or distributed for profit or commercial advantage and that copies bear this notice and the full citation on the first page. Copyrights for third-party components of this work must be honored. For all other uses, contact the Owner/Author.

Publisher

Association for Computing Machinery

New York, NY, United States

Publication History

Published: 31 December 2002

Published in SIGOPS Volume 36, Issue SI

Check for updates

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

97
Total Citations
View Citations
1,950
Total Downloads

Downloads (Last 12 months)50
Downloads (Last 6 weeks)7

Reflects downloads up to 24 Dec 2024

Other Metrics

View Author Metrics

Citations

Cited By

Yang FDing ZJia LSun YZhu Q(2024)Blockchain-Based File Replication for Data Availability of IPFS ConsumersIEEE Transactions on Consumer Electronics10.1109/TCE.2024.336423770:1(1191-1204)Online publication date: 9-Feb-2024
https://dl.acm.org/doi/10.1109/TCE.2024.3364237
Babakian AHuston GBraun RLipman J(2024)Internet Identifiers: A Survey of History, Challenges, and Future PerspectivesIEEE Access10.1109/ACCESS.2024.338211512(51919-51941)Online publication date: 2024
https://doi.org/10.1109/ACCESS.2024.3382115
Liao GAbadi D(2023)FileScaleProceedings of the 2023 ACM Symposium on Cloud Computing10.1145/3620678.3624784(459-474)Online publication date: 30-Oct-2023
https://dl.acm.org/doi/10.1145/3620678.3624784
Bahutair MBouguettaya A(2023)An End-to-end Trust Management Framework for Crowdsourced IoT ServicesACM Transactions on Internet Technology10.1145/360023223:3(1-32)Online publication date: 1-Jun-2023
https://dl.acm.org/doi/10.1145/3600232
Xu YShao JSlaats TDüdder B(2023)MWPoW+: A Strong Consensus Protocol for Intra-Shard Consensus in Blockchain ShardingACM Transactions on Internet Technology10.1145/358402023:2(1-27)Online publication date: 18-May-2023
https://dl.acm.org/doi/10.1145/3584020
Gharib MFazli M(2022)Secure cloud storage with anonymous deduplication using ID-based key managementThe Journal of Supercomputing10.1007/s11227-022-04751-679:2(2356-2382)Online publication date: 14-Aug-2022
https://dl.acm.org/doi/10.1007/s11227-022-04751-6
Confais BRostirolla GParrein BLacan JMarques F(2022)Mutida: A Rights Management Protocol for Distributed Storage Systems Without Fully Trusted NodesTransactions on Large-Scale Data- and Knowledge-Centered Systems LII10.1007/978-3-662-66146-8_1(1-34)Online publication date: 28-Sep-2022
https://doi.org/10.1007/978-3-662-66146-8_1
Sharma DGarg N(2021)An Enhanced Data Storage Technique on Cloud ComputingIndian Journal of Data Communication and Networking10.54105/ijdcn.B5007.0613211:3(1-4)Online publication date: 10-Jun-2021
https://doi.org/10.54105/ijdcn.B5007.061321
Sharma* KGarg N(2021)An Enhanced Data Storage Technique on Cloud ComputingIndian Journal of Data Communication and Networking10.35940/ijdcn.B5007.0613211:3(1-4)Online publication date: 10-Jun-2021
https://doi.org/10.35940/ijdcn.B5007.061321
Bahutair MBouguettaya A(2021)Blockchain-based Trust Information Storage in Crowdsourced IoT Services2021 IEEE International Conference on Web Services (ICWS)10.1109/ICWS53863.2021.00082(608-617)Online publication date: Sep-2021
https://doi.org/10.1109/ICWS53863.2021.00082
Show More Cited By

View Options

Login options

Check if you have access through your login credentials or your institution to get full access on this article.

Full Access

Get this Publication

View options

PDF

View or Download as a PDF file.

eReader

View online with eReader.

Media

Figures

Other

Tables

View Issue’s Table of Contents