s3-accelerator
github.com/danthegoodman1/s3-accelerator- Category
- Developer Tools
- Rank
- No. 2602Tools index
- Type
- TOOL
- GitHub
- 2 stars
- Date
About
s3-accelerator is an S3-compatible NVMe cache that serves hits in under a millisecond and replicates hot objects across the cluster. It uses rendezvous hashing to limit remapping when a node is lost, and asks the previous owner of a key for the object when nodes are added, so the cache stays warm instead of refetching from S3. It caches on the second hit, uses kTLS, splice and sendfile to keep chunk transfers out of userspace, is Parquet-aware, and can use SQS to refresh objects that are overwritten.
Why it made the leaderboard
A sub-millisecond S3 cache that stays warm when the cluster resizes and avoids userspace copies. Useful for read-heavy data and agent workloads against object storage.
Tags
Tech Stack
Comments (0)
No comments yet
Editorially curated, with community endorsements as a secondary signal. Corrections welcome.