THE LIVING ARCHIVE

From punched cards to autonomous collaborators: the ideas, people, languages and systems that taught machines to follow—and increasingly interpret—human intent.

PAST / PRESENT / NEXT

Collection

Tag: codebert

CodeBERT and the Moment Source Code Became a Pretraining Domain

CodeBERT treated programming languages and natural language as a joint pretraining problem, helping establish source code as a first-class domain for Transformer models before generative coding assistants became mainstream.

↗