Hi there 👋

Introduction to collective communication operations used for distributed training.

Introduction to distributed communication for GPUs.

How to authenticate EKS workloads with AWS services?

Notes on choosing appropriate batch size and compute for training LLMs

Notes on training LLMs using sharding strategies