Infrastructure builder

Mostofa Patwary

Co-authored Megatron-LM, the tensor/model-parallel framework for training Transformers too large to fit on one GPU.

Works in the archive (1)

“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.

Co-authors in the archive

Mohammad Shoeybi, Raul Puri, et al.