Training-method researcherArchitecture researcher

Naman Goyal

ORCID lookup ↗DBLP lookup ↗Scholar lookup ↗Semantic Scholar ↗arXiv ↗

Co-authored RoBERTa, showing careful data and hyperparameter choices substantially improve BERT pretraining.

Works in the archive (2)

RoBERTa: A Robustly Optimized BERT Pretraining Approach · 2019
BART: Denoising Seq2Seq Pre-training · 2020

“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.

Co-authors in the archive

Yinhan Liu (2), Myle Ott, Jingfei Du, et al., Mike Lewis, Marjan Ghazvininejad, Abdelrahman Mohamed, Omer Levy, Ves Stoyanov, Luke Zettlemoyer

View co-author network (10 people)

Loading graph…