01
CodeBERT and the Moment Source Code Became a Pretraining Domain
CodeBERT treated programming languages and natural language as a joint pretraining problem, helping establish source code as a first-class domain for Transformer models before generative coding assistants became mainstream.
↗