01
DeepSeek-Coder and the Open Code-Model Scaling Race
DeepSeek-Coder trained open code models from 1.3B to 33B parameters on a two-trillion-token project-level corpus, combining code-heavy pretraining, long context and infilling during the rapid open-model race of 2023–2024.
↗