vllm-project / vllm

A high-throughput LLM inference and serving engine featuring PagedAttention, continuous batching, and an OpenAI-compatible API server.

rohitg00 / ai-engineering-from-scratch

A free, MIT-licensed course of 542 lessons on AI engineering, implementing model internals, retrieval, and agent runtimes from scratch.

opendatalab / MinerU

Transforms complex documents like PDFs and Office docs into LLM-ready markdown/JSON for your Agentic workflows.

sgl-project / sglang

SGLang is a high-performance serving framework for large language models and multimodal models.

p-e-w / heretic

Fully automatic censorship removal for language models

MakazhanAlpamys / Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

huggingface / transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

FlashML-org / FreeToken

FreeToken brings datacenter-scale model serving to your desktop. Run massive models locally, fast and efficiently.

hiyouga / LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

SYSTRAN / faster-whisper

Faster Whisper transcription with CTranslate2

Jeffallan / claude-skills

67 Specialized Skills for Full-Stack Developers. Transform Claude Code into your expert pair programmer.

MODSetter / SurfSense

Air-gapped, privacy-focused, open-source NotebookLM alternative. AI agent that researches, transforms, and edits your documents. Join our Discord: https://discord.gg/ejRNvftDp9

fishaudio / fish-speech

SOTA Open Source TTS

FareedKhan-dev / train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

data-privacy-stack / presidio

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

vllm-project / vllm-omni

A framework for efficient model inference with omni-modality models

Blaizzy / mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

Robbyant / lingbot-map

[ECCV 2026 Best Paper Award Candidate] LingBot-Map: Geometric Context Transformer for Streaming 3D Reconstruction

amazon-science / chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

WeThinkIn / AIGC-Interview-Book

【三年面试五年模拟】AIGC/LLM/AI Agent算法工程师面试资源平台。涵盖AIGC、LLM大模型、AI Agent、具身智能、传统深度学习、计算机视觉、自然语言处理、自动驾驶、机器学习、强化学习、大数据挖掘、世界模型、元宇宙、AGI等AI行业面试笔试干货经验与核心跨周期知识。

yifanfeng97 / Hyper-Extract

Hypergraph is more powerful. Transform unstructured text into structured knowledge with LLMs. Graphs, hypergraphs, and spatio-temporal extractions — with one command.

j1s4nn / jev-adaptive-granularity-WM

Official code, locked protocols, and audit artifacts for "Jev-Routed Temporal Granularity with Recovery and Hysteresis for Causal Video Generation": per-segment fine/coarse/hold routing for Causal-rCM (Wan2.1-1.3B) via the Jev oracle, with two-GPU (T4/A100) feasibility audits.

huggingface / peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

huggingface / trl

Train transformer language models with reinforcement learning.

Tencent-Hunyuan / HunyuanVideo

HunyuanVideo: A Systematic Framework For Large Video Generation Model

nokia-applied-research / AnyJev

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

BaruqueRodrigues / llm-legislativo

Corpus legislativo brasileiro em larga escala e modelo Transformer causal treinado do zero em PyTorch puro.

fancyboi999 / ai-engineering-from-scratch-zh

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

Rizzo-AI-Academy / rizzo-pii

Local-first privacy guard: anonymize your documents before sharing with LLMs.

huawei-bayerlab / marigold-v2

Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation

speridlabs / iris-3b

Iris-3B: pixel-space generation & general vision learner. A 3B diffusion transformer that generates every pixel directly (no VAE); the same prior, fine-tuned, does monocular depth estimation and 4x image restoration. Paper, weights, training code and demo.

huggingface / pytorch-image-models

The largest collection of PyTorch image encoders / backbones. Including train, eval, inference, export scripts, and pretrained weights -- ResNet, ResNeXT, EfficientNet, NFNet, Vision Transformer (ViT), MobileNetV4, MobileNet-V3 & V2, RegNet, DPN, CSPNet, Swin Transformer, MaxViT, CoAtNet, ConvNeXt, and more

jax-ml / jax

Composable transformations of Python+NumPy programs: differentiate, vectorize, JIT to GPU/TPU, and more

qubvel-org / segmentation_models.pytorch

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

zyddnys / manga-image-translator

Translate manga/image 一键翻译各类图片内文字 https://cotrans.touhou.ai/ (no longer working)

OpenRLHF / OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

Nixtla / neuralforecast

Scalable and user friendly neural :brain: forecasting algorithms.

NVIDIA / TransformerEngine

A library for accelerating Transformer models on NVIDIA GPUs, including using 8-bit and 4-bit floating point (FP8 and FP4) precision on Hopper, Ada and Blackwell GPUs, to provide better performance with lower memory utilization in both training and inference.

vllm-project / vllm-ascend

Community maintained hardware plugin for vLLM on Huawei Ascend

whitecircle / halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

Jit-Roy / WeeLLM

WeeLLM runs large diffusion models with as little as 4 GB of VRAM, without any quantization. It dynamically determines how many layers can fit within the available VRAM and streams the text encoder and transformer layers to the GPU layer by layer, enabling inference on hardware with limited VRAM. It supports both safetensors and GGUF models.

OpenSenseNova / Looped-DiT

PyTorch implementation of Looped Diffusion Transformer

Luciferbobo / KiT

KiT: A Foundation Model for Financial Time-Series Forecasting using Diffusion Transformers

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

stas00 / ml-engineering

Machine Learning Engineering Open Book

NVIDIA / Megatron-LM

Ongoing research training transformer models at scale

pytorch / vision

Datasets, Transforms and Models specific to Computer Vision

speechbrain / speechbrain

A PyTorch-based Speech Toolkit

InternLM / lmdeploy

LMDeploy is a toolkit for compressing, deploying, and serving LLMs.

lucidrains / PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

lyuwenyu / RT-DETR

[CVPR 2024] Official RT-DETR (RTDETR paddle pytorch), Real-Time DEtection TRansformer, DETRs Beat YOLOs on Real-time Object Detection. 🔥 🔥 🔥

SwanHubX / SwanLab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

torchgeo / torchgeo

TorchGeo: datasets, samplers, transforms, and pre-trained models for geospatial data

linto-ai / whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

mflux-community / mflux

Apple MLX native implementations of state-of-the-art generative image & video models

AIStream-Peelout / flow-forecast

Deep learning PyTorch library for time series forecasting, classification, and anomaly detection (originally for flood forecasting).

MinishLab / model2vec

Fast State-of-the-Art Static Embeddings

qusong0627 / QuantMind

QuantMind（量化大脑）开源版是一款面向个人开发者与投研团队的 AI 原生多市场量化交易平台。深度集成微软 Qlib、RD-Agent 因子演化与 QuantBot全能工作台，提供从 300+ 维因子挖掘、13 种机器学习与深度学习模型工场、Qlib 高性能回测、截面批量推理、7x24 实时舆情情绪分析，到通达信深度联动（板块推送/预警雷达/闪电下单）与实盘模拟交易的完整闭环。支持 A股、港股、美股、期货及区块链。可免费商用，系统采用 Docker Compose 一键私有化部署，数据与模型完全本地化，保障策略隐私，功能零门槛无限制。

intel / auto-round

PTQ-Level Efficiency, QAT-Level Accuracy|训练后量化的效率，量化感知训练的精度

NVIDIA / kvpress

LLM KV cache compression made easy