Blog
Archive
Books
Hiking
Search
Tags
Home
»
Tags
Zero
Ultra-scale Playbook - ZeRO Sharding
Notes on training LLMs using sharding strategies