All repos — GH Trending Explorer

lyogavin / airllm

AirLLM 2.8T LLM inference with single 4GB GPU

llm-tooling ml-framework

midudev / runonweb.ai

SDK to use local models on web easy

web-ai ai-media llm-tooling

google-pytorch / torch_tpu

Provides a PyTorch backend that runs PyTorch models and operations on Google's Tensor Processing Units (TPUs).

ml-framework backend cloud

KittenML / KittenTTS

Open-source State-of-the-art TTS model which runs on a CPU 😻

ai-media audio

trymirai / uzu

A high-performance inference engine for AI models

llm-tooling ml-framework

tile-ai / tilelang

Domain-specific language designed to streamline the development of high-performance GPU/CPU/Accelerators kernels

compiler programming-language gpu-kernels-placeholder

deepseek-ai / FlashMLA

FlashMLA: Efficient Multi-head Latent Attention Kernels

ml-framework ai-agents

tensorflow / tensorflow

An Open Source Machine Learning Framework for Everyone

ml-framework data-science

NVIDIA / Model-Optimizer

A unified library of SOTA model optimization techniques like quantization, distillation, pruning, neural architecture search, speculative decoding, etc. It compresses deep learning models for downstream deployment frameworks like TensorRT-LLM, TensorRT, vLLM, etc. to optimize inference speed.

ml-framework llm-tooling

FluidInference / FluidAudio

Frontier CoreML audio models in your apps — text-to-speech, speech-to-text, voice activity detection, and speaker diarization. In Swift, powered by SOTA open source.

ai-media audio ml-framework

microsoft / onnxruntime

ONNX Runtime: cross-platform, high performance ML inferencing and training accelerator

ml-framework backend

Unstructured-IO / unstructured

Convert documents to structured data effortlessly. Unstructured is open-source ETL solution for transforming complex documents into clean, structured formats for language models. Visit our website to learn more about our enterprise grade Platform product for production grade workflows, partitioning, enrichments, chunking and embedding.

data-engineering documentation llm-tooling