Ultrascale Playbook - Pipeline Parallelism
Notes on training LLMs using pipeline parallelism
Posts
Python in practice - Abstraction design
Learnings from reading the python code for semlib library
Pydata MCR talk on training LLMs
My talk on training LLMs at Pydata MCR
Pydantic Logfire is awesome 🔥
Observability platform for Python applications
Distributed communication for GPUs (part 2)
Introduction to collective communication operations used for distributed training.