Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
A 21-lesson Microsoft course teaching how to build generative AI applications, with code examples in Python and TypeScript.
A collection of 42+ runnable Jupyter notebooks, each tutorial covering an advanced technique for Retrieval-Augmented Generation systems.