Infrastructure builder

Rohan Varma

Co-built PyTorch Fully Sharded Data Parallel (FSDP), sharding parameters and optimizer state to train models beyond single-device memory.

Works in the archive (1)

“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.

Co-authors in the archive

Yanli Zhao, Andrew Gu, et al.