Systems researcher
Mohammad Shoeybi
Built Megatron-LM, the tensor-parallel training system used to train many multi-billion-parameter language models.
Works in the archive (1) · lead author on 1
“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.