Architecture researcher

Pengcheng He

Designed DeBERTa's disentangled attention, which topped language-understanding benchmarks among encoder models.

Works in the archive (1) · lead author on 1

“Lead” marks the first-listed author — a byline fact, not a measure of influence; co-authorship is shown as recorded.

Co-authors in the archive

Xiaodong Liu, Jianfeng Gao, Weizhu Chen