Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
A free, MIT-licensed course of 542 lessons on AI engineering, implementing model internals, retrieval, and agent runtimes from scratch.
Open-source SDK for building and running AI agents in Python and TypeScript, with a fully assembled harness and a model-agnostic agent loop.