Data-Parallelism

Notes on training LLMs using data parallelism strategy