Tag: benchmarks

DS-1000 evaluated code generators on one thousand realistic, Stack Overflow-derived data-science problems across seven Python libraries with execution-based and API-aware checks.

RepoBench decomposed repository-level code completion into retrieval, generation, and full-pipeline tasks, making cross-file context selection a measurable part of coding-model quality.