spotify / scio
git clone https://github.com/spotify/scio.git
v0.15.10 · 1mo ago
🔥 on GitHub Trending today
A Scala API for Apache Beam and Google Cloud Dataflow, inspired by Spark and Scalding, for batch and streaming data pipelines.
Why you might care
Suits Scala teams building batch or streaming jobs on Beam or Dataflow who want a Spark/Scalding-like API over the Beam model. Includes add-ons for BigQuery, Pub/Sub, Bigtable, Avro, Parquet, JDBC and more, plus a REPL for interactive work.
+0
stars, 24h · #23,346
+~0
stars, 7 days · #35,877
+3
stars, 30 days · #39,134
2.6k
★ total
537
forks · 135 open issues
Star history (as recorded here)
LanguageScala
LicenseApache-2.0
Created2015-03-26 (11y ago)
Last push1d ago
Watchers106
OwnerOrganization
Seen on GitHub Trending
- 2026-10-24 — #8 daily in scala
- 2026-10-24 — #19 monthly in scala · +3 ★
- 2026-10-23 — #22 monthly in scala · +3 ★
- 2026-10-22 — #21 monthly in scala · +3 ★
- 2026-10-21 — #21 daily in scala
- 2026-10-21 — #21 monthly in scala · +4 ★
- 2026-10-21 — #10 weekly in scala · +2 ★
- 2026-10-20 — #21 daily in scala
- 2026-10-20 — #21 monthly in scala · +4 ★
- 2026-10-20 — #10 weekly in scala · +2 ★
GitHub topics
Links
- GitHub: github.com/spotify/scio
- Homepage: https://spotify.github.io/scio
- Releases · Issues · Hacker News mentions
README
Loading README…
Blurb generated by claude-haiku-5-5 today. Star deltas marked ~ are extrapolated from partial history.