Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
Open-source AI-oriented quantitative investment platform covering data, strategy research, backtesting, simulated and live trading.
Desktop and CLI tool that trains 3D Gaussian Splatting models from photos or video, then exports splats and textured meshes, using Vulkan compute.
A library of model optimization techniques (quantization, pruning, distillation, NAS, speculative decoding, sparsity) that exports compressed checkpoints for inference frameworks.