Download
SeaweedFS is a distributed storage system for blobs, objects, files, and data lake, to store and serve billions of files fast! Blob store has O(1) disk seek, local tiering, cloud tiering. Filer supports cross-cluster active-active replication, Kubernetes, POSIX, S3 API, encryption, Erasure Coding for warm storage, FUSE mount, Hadoop, WebDAV. SeaweedFS is an independent Apache-licensed open source project with its ongoing development made possible because of the community. SeaweedFS is a simple and highly scalable distributed file system. There are two objectives, to store billions of files, and to serve the files fast! SeaweedFS started as an Object Store to handle small files efficiently. Instead of managing all file metadata in a central master, the central master only manages volumes on volume servers, and these volume servers manage files and their metadata.
Features
- SeaweedFS can transparently integrate with the cloud
- With hot data on local cluster, and warm data on the cloud with O(1) access time, SeaweedFS can achieve both fast local access time and elastic cloud storage capacity
- Faster and Cheaper than direct cloud storage!
- There is only 40 bytes of disk storage overhead for each file's metadata
- On top of the object store, optional Filer can support directories and POSIX attributes
- For any distributed key value stores, the large values can be offloaded to SeaweedFS
Project Samples
