huggingface / evaluate

🤗 Evaluate: A library for easily evaluating machine learning models and datasets.

datopian / portaljs

🌀 AI-native framework for building data portals. Scaffold a full portal from a brief and load datasets in minutes with agentic skills — any backend (CKAN, GitHub, Frictionless).

peteromallet / dataclaw

Agent harness to publish your agent chat history as Huggingface datasets.

youngfish42 / Awesome-FL

Comprehensive and timely academic information on federated learning (papers, frameworks, datasets, tutorials, workshops)

wq2012 / awesome-diarization

A curated list of awesome Speaker Diarization papers, libraries, datasets, and other resources.

MobilityData / awesome-transit

Community list of transit APIs, apps, datasets, research, and software :bus::star2::train::star2::steam_locomotive:

JuliaData / DataFrames.jl

In-memory tabular data in Julia

thanglequoc / vietnamese-provinces-database

Comprehensive SQL and GIS datasets for Vietnamese administrative units, including provinces, districts, wards, postal codes, and geospatial boundaries.

awslabs / open-data-registry

A registry of publicly available datasets on AWS

Farama-Foundation / Minari

A standard format for offline reinforcement learning datasets, with popular reference datasets and related utilities

tinyfish-io / bigset-oss

Open-source BigSet — self-hostable live datasets populated by TinyFish web agents

polardb / polardbx-sql

PolarDB-X is a cloud native distributed SQL Database designed for high concurrency, massive storage, complex querying scenarios.

datagouv / datagouv-mcp

Official data.gouv.fr Model Context Protocol (MCP) server that allows AI chatbots to search, explore, and analyze datasets from the French national Open Data platform, directly through conversation.

huhusmang / Awesome-LLMs-for-Vulnerability-Detection

The community's most comprehensive, continuously-updated index of research on Large Language Models for software vulnerability detection — papers across function-level, repository-level, agentic, and smart-contract detection, plus datasets, benchmarks, and surveys.

Netflix / hollow

Hollow is a java library and toolset for disseminating in-memory datasets from a single producer to many consumers for high performance read-only access.

szenergy / awesome-lidar

😎 Awesome LIDAR list. The list includes LIDAR manufacturers, datasets, point cloud-processing algorithms, point cloud frameworks and simulators.

Renumics / spotlight

Interactively explore unstructured datasets from your dataframe.

samapriya / awesome-gee-community-datasets

Community Datasets added by users and made available for use at large

mlmed / torchxrayvision

TorchXRayVision: A library of chest X-ray datasets and models. Classifiers, segmentation, and autoencoders.

satellite-image-deep-learning / datasets

Datasets for deep learning with satellite & aerial imagery

bodaay / HuggingFaceModelDownloader

Simple go utility to download HuggingFace Models and Datasets

leomaurodesenv / game-datasets

:video_game: A curated list of awesome game datasets, and tools to artificial intelligence in games

MOLAorg / mola

A Modular Optimization framework for Localization and mApping (MOLA)

yueliu1999 / Awesome-Deep-Graph-Clustering

[IEEE T-KDE 2026] Awesome Deep Graph Clustering is a collection of SOTA, novel deep graph clustering methods (papers, codes, and datasets).

taishi-i / awesome-japanese-nlp-resources

A curated list of resources for Japanese natural language processing (NLP): Python libraries, LLMs, dictionaries, corpora, and datasets. Includes Claude Code and Codex skills to search resources.

MinishLab / semhash

Fast Multimodal Semantic Deduplication & Filtering

ipea / geobr

Easy access to official spatial data sets of Brazil in R and Python

BinWang28 / audio-ai-hub

The hub for audio AI research: papers, open models, benchmarks & datasets across audio LLMs, speech recognition, TTS, music & audio generation.

xiaoxiunique / x-kit

Pure-Python protocol tools and research notes for X.com, with VibeLoft Twitter account datasets

adalca / medical-datasets

tracking medical datasets, with a focus on medical imaging

mlcommons / croissant

Croissant is a high-level format for machine learning datasets that brings together four rich layers.

huggingface / dataset-viewer

Backend that powers the dataset viewer on Hugging Face dataset pages through a public API.

nolabs-ai / deepfabric

Generate High-Quality Synthetics, Train, Measure, and Evaluate in a Single Pipeline

LAMDA-Tabular / TALENT

A comprehensive toolkit and benchmark for tabular data learning, featuring 35+ deep methods, more than 10 classical methods, and 300 diverse tabular datasets.

splunk / attack_data

A repository of curated datasets from various attacks

ENSTA-U2IS-AI / awesome-uncertainty-deeplearning

This repository contains a collection of surveys, datasets, papers, and codes, for predictive uncertainty estimation in deep learning models.

blaylockbk / Herbie

Download numerical weather prediction datasets (HRRR, RAP, GFS, IFS, etc.) from NOMADS, NODD partners (Amazon, Google, Microsoft), ECMWF open data, and the University of Utah Pando Archive System.

defeat-beta / defeatbeta-api

An open-source alternative to Yahoo Finance's market data APIs with higher reliability.

thiagobodruk / bible

Bible text in JSON and XML — 141 versions across 85 languages, ready for apps, verse search, and NLP/AI datasets

metabase / dataset-generator

AI Dataset Generator – Create realistic datasets for demos, learning, and dashboards

openml / OpenML

Open Machine Learning

facebookincubator / nimble

New and extensible file format for storage of large columnar datasets.

open-edge-platform / datumaro

Dataset Management Framework, a Python library and a CLI tool to build, analyze and manage Computer Vision datasets.

datasets / s-and-p-500-companies

List of companies in the S&P 500 together with associated financials

isaqueseneda / shieldfont

A typeface that protects written content by poisoning unauthorized AI training datasets.

CornellNLP / ConvoKit

ConvoKit is a toolkit for extracting conversational features and analyzing social phenomena in conversations. It includes several large conversational datasets along with scripts exemplifying the use of the toolkit on these datasets.

mlcommons / ck

Collective Knowledge (CK), Collective Mind (CM/CMX) and MLPerf automations: community-driven projects to learn how to run AI, ML, and other emerging workloads more efficiently and cost-effectively across diverse models, datasets, software, and hardware using MLPerf methodology and benchmarks.

milesj / emojibase

🎮 A collection of lightweight, up-to-date, pre-generated, specification compliant, localized emoji JSON datasets, regex patterns, and more.

cfgranda / ps4ds

Probability and Statistics for Data Science: A self-contained introduction to probability and statistics for data science, including a free pdf, 103 Python notebooks using 23 real-world datasets, 118 videos with slides, and solutions to 200 exercises

google / seqio

Task-based datasets, preprocessing, and evaluation for sequence models.

cogeotiff / rio-tiler

User friendly Rasterio plugin to read raster datasets.

remyxai / VQASynth

Compose multimodal datasets 🎹

JuliaMath / Interpolations.jl

Fast, continuous interpolation of discrete datasets in Julia

ncbi / datasets

NCBI Datasets is a new resource that lets you easily gather data from across NCBI databases.

citation-file-format / citation-file-format

The Citation File Format lets you provide citation metadata for software or datasets in plaintext files that are easy to read by both humans and machines.

VSLAM-LAB / VSLAM-LAB

A Comprehensive Framework for Visual SLAM Systems and Datasets

naver / kapture

kapture is a file format as well as a set of tools for manipulating datasets, and in particular Visual Localization and Structure from Motion data.

google-research / arco-era5

Recipes for reproducing Analysis-Ready & Cloud Optimized (ARCO) ERA5 datasets.

MIC-DKFZ / nnInteractive

nnInteractive is a framework for 3D interactive segmentation, supporting intuitive prompts like points, scribbles, bounding boxes, and lasso. Trained on 120+ diverse 3D datasets, it sets a new standard in accuracy, usability, and adaptability for clinical and research applications.

Jiaaqiliu / Awesome-VLA-Robotics

A comprehensive list of excellent research papers, models, datasets, and other resources on Vision-Language-Action (VLA) models in robotics.