rohitg00 / ai-engineering-from-scratch

A free, MIT-licensed course of 542 lessons on AI engineering, implementing model internals, retrieval, and agent runtimes from scratch.

microsoft / generative-ai-for-beginners

21 Lessons, Get Started Building with Generative AI

rasbt / LLMs-from-scratch

Implement a ChatGPT-like LLM in PyTorch from scratch, step by step

MakazhanAlpamys / Soup

Fine-tune LLMs from one YAML. Layer streaming trains an 8B model on a 4 GB laptop GPU.

huggingface / transformers

🤗 Transformers: the model-definition framework for state-of-the-art machine learning models in text, vision, audio, and multimodal models, for both inference and training.

hiyouga / LlamaFactory

Unified Efficient Fine-Tuning of 100+ LLMs & VLMs (ACL 2024)

FareedKhan-dev / train-llm-from-scratch

A straightforward method for training your LLM, from downloading data to generating text.

data-privacy-stack / presidio

An open-source framework for detecting, redacting, masking, and anonymizing sensitive data (PII) across text, images, and structured data. Supports NLP, pattern matching, and customizable pipelines.

Blaizzy / mlx-audio

A text-to-speech (TTS), speech-to-text (STT) and speech-to-speech (STS) library built on Apple's MLX framework, providing efficient speech analysis on Apple Silicon.

amazon-science / chronos-forecasting

Chronos: Pretrained Models for Time Series Forecasting

j1s4nn / jev-adaptive-granularity-WM

Official code, locked protocols, and audit artifacts for "Jev-Routed Temporal Granularity with Recovery and Hysteresis for Causal Video Generation": per-segment fine/coarse/hold routing for Causal-rCM (Wan2.1-1.3B) via the Jev oracle, with two-GPU (T4/A100) feasibility audits.

huggingface / peft

🤗 PEFT: State-of-the-art Parameter-Efficient Fine-Tuning.

nokia-applied-research / AnyJev

Turn any LLM into a Jev-style decision model: typed decisions, real probabilities, no training. (continue updating, welcome any issue and PR request)

fancyboi999 / ai-engineering-from-scratch-zh

Agent工程师最全学习路径 · 从零精通 AI 工程 · 20 阶段 542 课 · 中文全量翻译 + 配套站点 + 动画讲解视频 · 如何成为 AI Agent 工程师的修成指南

Rizzo-AI-Academy / rizzo-pii

Local-first privacy guard: anonymize your documents before sharing with LLMs.

huawei-bayerlab / marigold-v2

Marigold V2: Revisiting Diffusion Transformers for Monocular Depth Estimation

qubvel-org / segmentation_models.pytorch

Semantic segmentation models with 500+ pretrained convolutional and transformer-based backbones.

huggingface / tokenizers

💥 Fast State-of-the-Art Tokenizers optimized for Research and Production

OpenRLHF / OpenRLHF

An Easy-to-use, Scalable and High-performance Agentic RL Framework based on Ray (PPO & DAPO & REINFORCE++ & VLM & TIS & vLLM & Ray & Async RL)

Exorust / TorchLeet

LeetCode for PyTorch — 65 ML/AI interview problems from real interviews at Google, Meta, Anthropic. Jupyter notebooks, an auto-grader, and an MCP AI tutor.

whitecircle / halo

Halo is an open-source framework built by White Circle for training large language and multimodal models

zhongkaifu / TensorSharp

A native .NET LLM inference engine and agent runtime for GGUF models. TensorSharp provides a console application, a web-based chatbot interface, iPhone App, and Ollama/OpenAI-compatible HTTP APIs for programmatic access. It supports Windows/MacOS/iOS/Linux with full GPU capability

allenv0 / SCM

Multimodal memory agent on macOS

Fazmin / AILearningGuide

Interactive desktop app with 51 labs covering ML fundamentals, transformers, RAG, agents, fine-tuning and quantization and more.

Luciferbobo / KiT

KiT: A Foundation Model for Financial Time-Series Forecasting using Diffusion Transformers

kvcache-ai / ktransformers

A Flexible Framework for Experiencing Heterogeneous LLM Inference/Fine-tune Optimizations

stas00 / ml-engineering

Machine Learning Engineering Open Book

NVIDIA / Megatron-LM

Ongoing research training transformer models at scale

huggingface / transformers.js

State-of-the-art Machine Learning for the web. Run 🤗 Transformers directly in your browser, with no need for a server!

speechbrain / speechbrain

A PyTorch-based Speech Toolkit

openvinotoolkit / openvino

OpenVINO™ is an open source toolkit for optimizing and deploying AI inference

lucidrains / PaLM-rlhf-pytorch

Implementation of RLHF (Reinforcement Learning with Human Feedback) on top of the PaLM architecture. Basically ChatGPT but with PaLM

argmaxinc / argmax-oss-swift

On-device Speech AI for Apple Silicon

SwanHubX / SwanLab

⚡️SwanLab - an open-source, modern-design AI training tracking and visualization tool. Supports Cloud / Self-hosted use. Integrated with PyTorch / Transformers / verl / LLaMA Factory / ms-swift / Ultralytics / MMEngine / Keras etc.

bbruceyuan / Hands-On-Large-Language-Models-CN

中文翻译的 Hands-On-Large-Language-Models (hands-on-llms)，动手学习大模型

linto-ai / whisper-timestamped

Multilingual Automatic Speech Recognition with word-level timestamps and confidence

mflux-community / mflux

Apple MLX native implementations of state-of-the-art generative image & video models

MinishLab / model2vec

Fast State-of-the-Art Static Embeddings

intel / auto-round

PTQ-Level Efficiency, QAT-Level Accuracy|训练后量化的效率，量化感知训练的精度

QwenAudio / Fun-ASR

Fun-ASR speech recognition models, with native Hugging Face Transformers support for Fun-ASR-Nano and separate FunASR, vLLM and llama.cpp deployment paths.

NVIDIA / kvpress

LLM KV cache compression made easy

Tencent / YOLO-Master

[CVPR2026]🚀🚀🚀Official code for the paper "YOLO-Master: MOE-Accelerated with Specialized Transformers for Enhanced Real-time Detection." *(YOLO = You Only Look Once)* 🔥🔥🔥

Avarok-Cybersecurity / atlas

Pure Rust Inference Engine

amitshekhariitbhu / ai-engineering-course

AI Engineering Course - A free and complete AI Engineering Course to learn AI Engineering step by step - from Machine Learning, Neural Networks, and Transformers to LLMs, Fine-Tuning, RAG, AI Agents, LLM Inference, Evaluation, AI Safety, and AI System Design.

qlabs-eng / dust

Pretraining Transformers Without Backpropagation

kyegomez / open-jev

an open-source, from-first-principles reconstruction of the ideas behind TypeSafe AI's Jev, written in pytorch

vdev-ctrl / Adaptive-Learnable-Hierarchical-Routing-

This repo is a alternative solution for standard self-attention. It uses tree routing with learnable functions for cheaper self-attention while not compromising accuracy.

lucidrains / vit-pytorch

Implementation of Vision Transformer, a simple way to achieve SOTA in vision classification with only a single transformer encoder, in Pytorch

huggingface / sentence-transformers

State-of-the-Art Embeddings, Retrieval, and Reranking

arc53 / DocsGPT

Private AI platform for agents, assistants and enterprise search. Built-in Agent Builder, Deep research, Document analysis, Multi-model support, and API connectivity for agents.

BlinkDL / RWKV-LM

RWKV (pronounced RwaKuv) is an RNN with great LLM performance, which can also be directly trained like a GPT transformer (parallelizable). We are at RWKV-7 "Goose". So it's combining the best of RNN and transformer - great performance, linear time, constant space (no kv-cache), fast training, infinite ctx_len, and free sentence embedding.

facebookresearch / xformers

Hackable and optimized Transformers building blocks, supporting a composable construction.

niedev / RTranslator

Open source real-time translation app for Android that runs locally

xorbitsai / inference

Swap GPT for any LLM by changing a single line of code. Xinference lets you run open-source, speech, and multimodal models on cloud, on-prem, or your laptop — all through one unified, production-ready inference API.

MaartenGr / BERTopic

Leveraging BERT and c-TF-IDF to create easily interpretable topics.

EleutherAI / gpt-neox

An implementation of model parallel autoregressive transformers on GPUs, based on the Megatron and DeepSpeed libraries

vladmandic / sdnext

SD.Next: All-in-one WebUI for AI generative image and video creation, captioning and processing

louthy / language-ext

C# pure functional programming framework - come and get declarative!

lucidrains / x-transformers

A concise but complete full-attention transformer with a set of promising experimental features from various papers

OpenBMB / UltraRAG

A Low-Code MCP Framework for Building Complex and Innovative RAG Pipelines