an open-source, from-first-principles reconstruction of the ideas behind TypeSafe AI's Jev, written in pytorch
This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.
Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch
State-of-the-Art Embeddings, Retrieval, and Reranking
Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.
RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.
Hackable and optimized Transformers building blocks, supporting a composable construction.
Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.
Leveraging BERT and c-TF-IDF to create easily interpretable topics.
An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries
SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing
Code for the paper "Exploring the Limits of Transfer Learning with a Unified Text-to-Text Transformer"
A concise but complete full-attention transformer with a set of promising experimental features from various papers
A treasure chest for visual classification and recognition powered by PaddlePaddle
A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines
Robust recipes to align language models with human and AI preferences
MLX-VLM is a package for inference and fine-tuning of Vision Language Models (VLMs) on your Mac using MLX.
The open source research environment for AI researchers to seamlessly train, evaluate, and scale models from local hardware to GPU clusters.
A library for mechanistic interpretability of GPT-style language models
Scenic: A Jax Library for Computer Vision Research and Beyond
Seamlessly integrate LLMs into scikit-learn.
🚀 Accelerate inference and training of 🤗 Transformers, Diffusers, TIMM and Sentence Transformers with easy to use hardware optimization tools
MTEB: State-of-the-art evaluation of embeddings across languages and modalities
PyTorch native quantization for training and inference
xDiT: A Scalable Inference Engine for Diffusion Transformers (DiTs) with Massive Parallelism
streamline the fine-tuning process for multimodal models: PaliGemma 2, Florence-2, and Qwen2.5-VL
A lightweight framework for building LLM-based agents
[ICCV 2025 Highlight] OminiControl: Minimal and Universal Control for Diffusion Transformer
Implementation of "BitNet: Scaling 1-bit Transformers for Large Language Models" in pytorch
All-in-one training for vision models (YOLO, ViTs, RT-DETR, DINOv3): pretraining, fine-tuning, distillation.
A coding-free framework built on PyTorch for reproducible deep learning studies. PyTorch Ecosystem. 🏆26 knowledge distillation methods presented at TPAMI, CVPR, ICLR, ECCV, NeurIPS, ICCV, AAAI, etc are implemented so far. 🎁 Trained models, training logs and configurations are available for ensuring the reproducibiliy and benchmark.
[PAMI'23] TransFuser: Imitation with Transformer-Based Sensor Fusion for Autonomous Driving; [CVPR'21] Multi-Modal Fusion Transformer for End-to-End Autonomous Driving
solo-learn: a library of self-supervised methods for visual representation learning powered by Pytorch Lightning
Free Offline OCR 离线的中文文本检测+识别SDK
Scalable and memory-optimized training of diffusion models
Pruna is a model optimization framework built for developers, enabling you to deliver faster, more efficient models with minimal overhead.
Trained models & code to predict toxic comments on all 3 Jigsaw Toxic Comment Challenges. Built using ⚡ Pytorch Lightning and 🤗 Transformers.
LLM model quantization (compression) toolkit with HW acceleration support for Nvidia, AMD, Intel GPU and Intel/AMD/Apple CPU via HF, vLLM, and SGLang.
[NeurIPS2026] We present StableAvatar, the first end-to-end video diffusion transformer, which synthesizes infinite-length high-quality audio-driven avatar videos without any post-processing, conditioned on a reference image and audio.
Neural Network Compression Framework for enhanced OpenVINO™ inference
Microsoft Text-to-Speech API Samples
A Framework of Small-scale Large Multimodal Models
Official Code Release for [SIGGRAPH 2025] RenderFormer: Transformer-based Neural Rendering of Triangle Meshes with Global Illumination
Single-GPU LLM fine-tuning preflight: memory estimates, runnable LoRA/QLoRA recipes, and local measurements.
Open data and scalable training for long-horizon video world models.
Sparsify transformers with SAEs and transcoders
Training-free Spectrum acceleration for ComfyUI’s native MiniMax H3 audio-video model. Uses Chebyshev ridge feature forecasting to skip selected H3 transformer evaluations, with adaptive scheduling, sampler-aware support for Euler, ER-SDE, RES, SEEDS and SA-Solver, CPU/VRAM history storage, and fail-closed native fallbacks.
Official Codebase for "Neural Thickets: Diverse Task Experts Are Dense Around Pretrained Weights" (ICML 2026 Spotlight)
multilspy is a lsp client library in Python intended to be used to build applications around language servers.
Bilingual (中文+EN) ML / LLM / diffusion / agent interview cheat sheets for AI 秋招 — generated by ARIS /interview-cheatsheet, rendered by /render-html into single-file HTML, reads anywhere — plus a CV→DBLP-fact-checked academic homepage generator and hand-authored long-form blogs 🌱
Build high-performance AI models with modular building blocks
Implementation of π₀, the robotic foundation model architecture proposed by Physical Intelligence
An inference chip design that runs a real LLM (Qwen2.5-0.5B) on FPGA — one transformer decoder layer in RTL, every silicon value bit-exact against a golden model. 0.56 tok/s measured, a 140× climb, full evidence trail.
A flexible, adaptive classification system for dynamic text classification
SLA: Beyond Sparsity in Diffusion Transformers via Fine-Tunable Sparse–Linear Attention
Inference engine for Intel devices. Serve LLMs, VLMs, Whisper, Kokoro-TTS, Embedding and Rerank models over OpenAI endpoints.
本地优先的全栈 AI 创作工作站:AI对话 · AI漫画 · 漫剧创作 · 写作台 · 知识学习五大模块;vLLM / llama.cpp / Transformers 多引擎本地推理,显存智能调度、舱壁隔离自愈、仅供学习使用,欢迎交流指正。(最新进度(除插件系统)受到协议限制,暂时无法提交到仓库)
RESTai is an AIaaS (AI as a Service) open-source platform. Supports many public and local LLM suported by Ollama/vLLM/etc. Precise embeddings usage, tuning, analytics etc. Built-in image/audio generation with dynamic loading generators. Live chat deployment. Built-in block based graphical language. Prompt versioning and much more...
[ECCV 2026] Official implementation of "HRDiT: Training-Free High-Resolution Image Generation with Off-the-Shelf Diffusion Transformer Models"
Official code repository for "PixRestore: Unified Image Restoration via Pixel Diffusion Transformer".