Code Synthesis on Ag-LiveCodeBench-X 5.0 (derived)
7OCaml Pass@1Llama 3.3 70B Ins
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Llama 3.3 70B InsParameters=70B, Variant=Instruct2025.08 | 7 | 3 | |
| DSC v2 Lite Ins 16BParameters=16B, Variant=Instruct2025.08 | 7 | 6 | |
| Qwen3-4B-CF-XParameters=4B, Training Data=Ag-Codeforces-X, Approach=Agnostics2025.08 | 7 | 15 | |
| Qwen3-8B-CF-XParameters=8B, Training Data=Ag-Codeforces-X, Approach=Agnostics2025.08 | 7 | 17 | |
| Sonnet 42025.08 | 6 | 6 | |
| Qwen 3 32BParameters=32B2025.08 | 2 | 1 | |
| Qwen 3 4BParameters=4B2025.08 | 1 | 0 | |
| Qwen 3 8BParameters=8B2025.08 | 0 | 0 |