seaweedfs / seaweedfs

SeaweedFS is a distributed storage system for object storage (S3), file systems, and Iceberg tables, designed to handle billions of files with O(1) disk access and effortless horizontal scaling.

ceph / ceph

Ceph is a distributed object, block, and file storage platform

juicedata / juicefs

JuiceFS is a distributed POSIX file system built on top of Redis and S3.

piskvorky / smart_open

Utils for streaming large files (S3, HDFS, gzip, bz2...)

TileDB-Inc / TileDB

The Universal Storage Engine

wgzhao / Addax

Actively maintained successor to Alibaba DataX — a fast, versatile, open-source ETL tool for 30+ RDBMS and NoSQL data sources.