LLM Training Frameworks

LLM Training Frameworks

DeepSpeed is a deep learning optimization library developed by Microsoft to streamline distributed training and inferenc...

LLM Training Frameworks

Litgpt is an open-source framework designed for efficiently pretraining, finetuning, and deploying large language models...

LLM Training Frameworks

Megatron-LM is a large-scale transformer language model training framework developed by NVIDIA, designed to efficiently ...

LLM Training Frameworks

Meta Lingua is an open-source framework designed for efficient research and experimentation with large language models (...

LLM Training Frameworks

nanotron is a minimalistic framework for training large language models with 3D parallelism, designed to simplify distri...

LLM Training Frameworks

torchtitan is a PyTorch-native library designed for efficient large language model (LLM) training, optimized for perform...