deepspeedai / DeepSpeed

DeepSpeed is a deep learning optimization library that makes distributed training and inference easy, efficient, and effective.

hpcaitech / ColossalAI

Making large AI models cheaper, faster and more accessible

whitecircle / halo

Halo is an open-source framework built by White Circle for training large language and multimodal models