Co-authored ZeRO, the DeepSpeed memory-partitioning technique for training very large models.
“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.
Samyam Rajbhandari, Jeff Rasley, Olatunji Ruwase