Dataset creator

Guilherme Penedo

ORCID lookup ↗DBLP lookup ↗Scholar lookup ↗Semantic Scholar ↗arXiv ↗

Built the RefinedWeb dataset, showing carefully filtered web text alone can train strong open models.

Works in the archive (2) · lead author on 1

LeadThe RefinedWeb Dataset for Falcon LLM · 2023
Open Ecosystem (Gemma/Phi/OLMo/Falcon/Command R/Yi/GLM/InternLM) · 2024

“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.

Co-authors in the archive

Quentin Malartic, Daniel Hesslow, et al., Sébastien Bubeck, Marah Abdin, Dirk Groeneveld, Jie Tang, Gemma Team (Google DeepMind), Shanghai AI Laboratory

View co-author network (9 people)

Loading graph…