Ultra-scale Playbook - Data Parallelism
Notes on training LLMs using data parallelism strategy
Llm-Training
Ultra-scale Playbook - Train on a single GPU
Notes on Ultra-scale Playbook - training LLM on a single GPU
Notes on training LLMs using data parallelism strategy
Notes on Ultra-scale Playbook - training LLM on a single GPU