Python library that runs large language model inference layer by layer, so 70B-class models fit on a single 4GB GPU without quantization.
NVIDIA's curated collection of interactive GPU computing tutorials, syllabi, and guides covering CUDA, Python, and accelerated libraries.
Open-source GPU cluster orchestrator and PyTorch-based framework for training LLMs with billions to trillions of parameters.
Sionna: An Open-Source Library for Research on Communication Systems
H2O is an Open Source, Distributed, Fast & Scalable Machine Learning Platform: Deep Learning, Gradient Boosting (GBM) & XGBoost, Random Forest, Generalized Linear Modeling (GLM with Elastic Net), K-Means, PCA, Generalized Additive Models (GAM), RuleFit, Support Vector Machine (SVM), Stacked Ensembles, Automatic Machine Learning (AutoML), etc.
Covers pre-training data, Tokenizer, Transformer, MoE,distributed training, Scaling Laws, inference & alignment .6 progressive code assignments for full-stack LLM learning | 涵盖预训练数据、分词器、Transformer、MoE、分布式训练、缩放定律、推理与对齐,6 项渐进代码作业,掌握 LLM 全栈知识
The fastai deep learning library