Co-authored DoReMi, optimizing pre-training data mixtures via domain reweighting.
“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.
Sang Michael Xie, Hieu Pham, et al.