📈 GH Trending Explorer 🎲 Surprise me

Search: parquet · AI hidden · clear

rootSunc / CNEquity

中国 A 股数据基础设施。55个日更数据集:股票行情、基本面、期货数据、资金面、公告事件、指数行业、宏观与风险。行级溯源、PIT 语义、复权与历史成分内置,MCP 原生。自托管,零注册、零 API Token

▲ ~77/7d ★ 804 Python 3d ago
questdb / questdb

QuestDB is a high performance, open-source, time-series database

▲ ~21/7d ★ 17k Java today
lance-format / lance

Open Lakehouse Format for Multimodal AI. Convert from Parquet in 2 lines of code for 100x faster random access, vector index, and data versioning. Compatible with Pandas, DuckDB, Polars, Pyarrow, and PyTorch with more integrations coming..

▲ ~21/7d ★ 7.2k Rust today
parseablehq / parseable

Parseable is an open source, unified infrastructure observability platform built in Rust on a data lake architecture. It tracks logs, metrics, traces, and events across apps, agents, and systems, reducing storage costs by up to 90% through columnar telemetry compression.

▲ ~7/7d ★ 2.6k Rust today
julien040 / anyquery

One SQL interface for 60+ tools (e.g., GitHub, Notion, Airtable). Plug into any LLM through MCP.

▲ ~7/7d ★ 1.8k Go 14d ago
datazip-inc / olake

OLake - Fastest Databases, Kafka & S3 Replication to Apache Iceberg with Table optimization (Called OLake Fusion). ⚡ Efficient, quick and scalable data ingestion for real-time analytics. Supported sources : Postgres, MongoDB, MySQL, Oracle, MSSql, DB2, Kafka, S3.

▲ ~7/7d ★ 1.6k Go 1d ago
polarsignals / frostdb

❄️ Coolest database around 🧊 Embeddable column database written in Go.

▲ ~7/7d ★ 1.6k Go 1d ago
mukunku / ParquetViewer

Simple Windows desktop application for viewing & querying Apache Parquet files

▲ ~7/7d ★ 1.2k C# 5d ago
caioricciuti / duck-ui

The fully open-source DuckDB workbench that runs in your browser. SQL editor, notebooks, charts, AI assistant. No install, no signup, no backend — your data never leaves the tab.

▲ ~7/7d ★ 645 TypeScript today
parqdb-io / parqdb

Billion-scale embedded vector database built entirely on Parquet and Arrow.

▲ ~7/7d ★ 104 Python today
apache / arrow

Apache Arrow is the universal columnar format and multi-language toolbox for fast data interchange and in-memory analytics

▲ ~0/7d ★ 17k C++ 1d ago
Eventual-Inc / Daft

High-performance data engine for AI and multimodal workloads. Process images, audio, video, and structured data at any scale

▲ ~0/7d ★ 5.8k Rust today
aws / aws-sdk-pandas

pandas on AWS - Easy integration with Athena, Glue, Redshift, Timestream, Neptune, OpenSearch, QuickSight, Chime, CloudWatchLogs, DynamoDB, EMR, SecretManager, PostgreSQL, MySQL, SQLServer and S3 (Parquet, CSV, JSON and EXCEL).

▲ ~0/7d ★ 4.1k Python 1d ago
opengeos / leafmap

A Python package for interactive mapping and geospatial analysis with minimal coding in a Jupyter environment

▲ ~0/7d ★ 3.8k Python 3d ago
lakehq / sail

Drop-in Apache Spark replacement written in Rust, unifying batch processing, stream processing, and compute-intensive AI workloads.

▲ ~0/7d ★ 3.5k Rust today
shshemi / tabiew

A lightweight TUI application to view and query tabular data files, such as CSV, TSV, and parquet.

▲ ~0/7d ★ 3.1k Rust 4d ago
rilldata / rill

The fastest business intelligence tool for humans and agents.

▲ ~0/7d ★ 3.0k Go today
apache / drill

Apache Drill is a distributed MPP query layer for self describing data

▲ ~0/7d ★ 2.0k Java 1d ago
munich-data-engineering / reflect-cpp

A C++20 library for fast serialization, deserialization and validation using reflection. Supports JSON, Avro, Boost Serialization, BSON, Cap'n Proto, CBOR, Cereal, Command line interfaces, CSV, Environment variables, flexbuffers, msgpack, parquet, TOML, UBJSON, XML, YAML, yas / msgpack.org[C++20]

▲ ~0/7d ★ 2.0k C++ 2d ago
paradigmxyz / cryo

cryo is the easiest way to extract blockchain data to parquet, csv, json, or python dataframes

▲ ~0/7d ★ 1.6k Rust 2d ago
quiltdata / quilt

Quilt is a Scientific Data Management Platform on AWS that helps teams and AI find, trust, and reuse data through deeply versioned, context-rich data packages.

▲ ~0/7d ★ 1.4k TypeScript today
opengeospatial / geoparquet

Specification for storing geospatial vector data (point, line, polygon) in Parquet

▲ ~0/7d ★ 1.1k Python 1d ago
ipea / geobr

Easy access to official spatial data sets of Brazil in R and Python

▲ ~0/7d ★ 965 Python 12d ago
visgl / loaders.gl

Loaders for big data visualization. Website:

▲ ~0/7d ★ 854 TypeScript today
CrunchyData / pg_parquet

Copy to/from Parquet in S3, Azure Blob Storage, Google Cloud Storage, http(s) stores, local files or standard inout stream from within PostgreSQL

▲ ~0/7d ★ 693 Rust 5d ago
Basekick-Labs / arc

Open, SQL-native time-series database for telemetry you need to keep. 38M+ records/sec ingestion, 25M+ rows/sec queries. InfluxDB Line Protocol and Telegraf compatible. Open Parquet on your storage. Single binary. S3/Azure native. Air-gap ready. AGPL-3.0.

▲ ~0/7d ★ 684 Go today
rpbouman / huey

Browser-based data analytics & BI with DuckDB-WASM. Privacy-first: your data stays local; no server required.

▲ ~0/7d ★ 619 JavaScript 3d ago
l1xnan / duckling

A fast viewer for CSV/Parquet files and databases such as DuckDB, SQLite, PostgreSQL, MySQL, Clickhouse, etc., base on Tauri

▲ ~0/7d ★ 582 TypeScript 2d ago
turbot / tailpipe

select * from logs; Tailpipe is an open source SIEM for instant log insights, powered by DuckDB. Analyze millions of events in seconds, right from your terminal.

▲ ~0/7d ★ 581 Go 1d ago
Hebbian-Robotics / hflow

SDK for robotics teams to verify the quality of their data used for AI model training.

▲ ~0/7d ★ 301 Python 3d ago
sosoj92 / arbre-local

Moteur de recherche généalogique sur les 29 millions de décès français. La recherche s'exécute entièrement dans le navigateur : aucun nom saisi n'est envoyé à un serveur. Tutoriel complet — DuckDB, Parquet, WebAssembly.

▲ ~0/7d ★ 59 2mo ago
Koukyosyumei / h5i-db

An agent-native workspace for quantitative research: an in-terminal notebook, a high-performance time-series database, and a high-throughput backtesting engine. Written in Rust.

▲ ~0/7d ★ 35 Rust 6d ago
tobilg / neoserver

Multi-workspace geospatial server in Go: OGC API - Features and Tiles, WMS 1.3, WFS 2.0, WCS 2.0.1/2.1 and WMTS 1.0 for PostGIS, DuckDB, GeoParquet, vector files and GeoTIFF/COG

▲ ~0/7d ★ 31 Go 1d ago
julik / herringbone

A (slightly unhinged) pure-Ruby Parquet file reader/writer

▲ ~0/7d ★ 31 Ruby 5d ago
nisshi-io / nisshi

Apache Kafka® compatible broker with S3, PostgreSQL, SQLite, Apache Iceberg and Delta Lake

▲ ~-7/7d ★ 1.9k Rust 1d ago
Cinchoo / ChoETL

ETL framework for .NET (Parser / Writer for CSV, Flat, Xml, JSON, Key-Value, Parquet, Yaml, Avro formatted files)