denoland/celld

Public

S3 Storage

SP

Would it be better if this had it's own S3 storage? Cloudflare works so well as the Workers, Durable Objects and S3 storage are all in one location. Here are a few open-source projects that might help:

[OpenBucket](https://github.com/ProjectBay/openbucket) (Typescript) MIT

[SlateDB](https://github.com/slatedb/slatedb) (Rust) Apache-2.0 (has NodeJS support)

[SeaweedFS](https://github.com/seaweedfs/seaweedfs) (Go) Apache-2.0.

All doing S3 stuff. You might get some additional ideas.

  1. MA

    I think you might be missing the point of S3. The point is to offer wide compatibility with whatever storage orgs are already using.

    Plus hosting your own S3 storage is not something a project like this should ever tackle. There are way too many variables to determine what kind of setup is sensible.

    Also SlateDB is not an S3 storage provider. It is like celld: software running on top of S3. SeeweedFS, Garage, Ceph (most mature) and MinIO( though less popular since they pulled the open source plug) are all options you would consider when talking about self-hosting S3.

    Hope this helps. I am not affiliated with the project.

  2. MA

    Thanks @SpartanDavie, and @MatthiasGrandl for the answer — it is the right one.

    Not planned. celld's bet is that the bucket you already have is the coordination substrate: no control plane, no consensus, no storage of our own. Shipping a store would mean owning its durability and its failure modes, which is a different product.

    For self-hosted object storage under celld, SeaweedFS, Garage, Ceph or MinIO are the usual choices. The requirement is in `docs/fencing.md`: the store must enforce conditional writes. The next release adds a `celld diagnose` check that tells you whether yours does.

  3. magurotunaclosed3 months ago on GitHub

  4. SpartanDaviementioned3 months ago on GitHub

  5. SpartanDaviesubscribed3 months ago on GitHub

  6. MatthiasGrandlmentioned3 months ago on GitHub

  7. MatthiasGrandlsubscribed3 months ago on GitHub