lyogavin / airllm

Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.

shiyu-coder / Kronos

Kronos is an open-source decoder-only foundation model pretrained on financial candlestick (K-line) sequences for market forecasting.

anthropics / knowledge-work-plugins

Open-source plugins that specialize Claude for knowledge-work roles like sales, legal, finance, and support, for use in Claude Cowork.

trymirai / uzu

Inference engine for running AI models locally inside apps, with Rust core and Swift, Python, and TypeScript bindings.

AI4Finance-Foundation / FinRL

Open-source Python framework for training and backtesting financial trading agents with deep reinforcement learning.

tile-ai / tilelang

A Python-embedded domain-specific language and TVM-based compiler for writing high-performance GPU, CPU, and NPU kernels.

facebookresearch / segment-anything

Inference code, checkpoints, and notebooks for Meta's Segment Anything Model (SAM), which produces object masks from points, boxes, or automatically for whole images.

facebookresearch / audiocraft

PyTorch library for audio generation research, providing inference and training code for MusicGen, AudioGen, and EnCodec.

NVIDIA / Model-Optimizer

A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.

FluidInference / FluidAudio

Swift SDK running open-source speech models (ASR, TTS, VAD, speaker diarization) locally on Apple devices via CoreML and the Neural Engine.