Coding Accuracy on LiveCodeBench
70AccuracyRSA
Evaluation Results
| Method | Links | |
|---|---|---|
| RSAType=test-time scaling (TTS)2026.05 | 70 | |
| EVOLIB2026.05 | 70 | |
| Best-of-NType=test-time scaling (TTS)2026.05 | 67.5 | |
| DCType=test-time learning (TTL)2026.05 | 65 | |
| BaseType=base sampling2026.05 | 58.8 | |
| MemQModel=Gemma-4-E4B-it2026.05 | 51.43 | |
| ExpRAGType=test-time learning (TTL)2026.05 | 51.3 | |
| RAGModel=Gemma-4-E4B-it2026.05 | 50.48 | |
| Self-RAGModel=Gemma-4-E4B-it2026.05 | 49.52 | |
| MemPModel=Gemma-4-E4B-it2026.05 | 49.52 | |
| Mem0Model=Gemma-4-E4B-it2026.05 | 47.62 | |
| MemRLModel=Gemma-4-E4B-it2026.05 | 45.71 | |
| No Mem.Model=Gemma-4-E4B-it2026.05 | 44.76 | |
| RecursiveMASrecursion round=32026.04 | 42.9 | |
| TextGradrecursion round=32026.04 | 39.8 | |
| Dense Rollout BaselineModel=Qwen3-1.7B Thinking, Generation length cutoff=24K, Training protocol=One epoch on 21K filtered TACO, Sparsity=None2026.06 | 39.7 | |
| Sparsity (0.86)Model=Qwen3-1.7B Thinking, Generation length cutoff=24K, Training protocol=One epoch on 21K filtered TACO, Sparsity Setting=0.862026.06 | 39.33 | |
| Recursive-TextMASrecursion round=32026.04 | 38.7 | |
| Single Agenttraining protocol=Full-SFT2026.04 | 38.6 | |
| Single Agenttraining protocol=LoRA2026.04 | 37.4 | |
| VanillaModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%2025.11 | 36.7 | |
| kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=9-11, Variant=8x, Sampling temperature=0.6, top-p=95%2025.11 | 36.5 | |
| DMSModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=-, Variant=8x, Sampling temperature=0.6, top-p=95%2025.11 | 33.4 | |
| kvtcModel=Qwen 2.5 R1 7B, Compression Ratio (CR)=18-21, Variant=16x, Sampling temperature=0.6, top-p=95%2025.11 | 31.6 | |
| Mixture-of-Agents (MoA)recursion round=32026.04 | 27 | |
| LoopLMrecursion round=32026.04 | 24.9 | |
| General-ReasonerGroup=Qwen3-4B-Base, Category=Base and Expert Models2026.06 | 18.4 | |
| DARE + TIESGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 16.63 | |
| VanillaModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=1, Sampling temperature=0.6, top-p=95%2025.11 | 16.4 | |
| kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=9, Variant=8x, Sampling temperature=0.6, top-p=95%2025.11 | 16.1 | |
| DMSModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=-, Variant=8x, Sampling temperature=0.6, top-p=95%2025.11 | 16.1 | |
| TIESGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 15.66 | |
| RAMGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 14.48 | |
| RESMERGEGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 13.5 | |
| kvtcModel=Qwen 2.5 R1 1.5B, Compression Ratio (CR)=18, Variant=16x, Sampling temperature=0.6, top-p=95%2025.11 | 13.3 | |
| TSV-MergeGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 11.94 | |
| SpiralGroup=Qwen3-4B-Base, Category=Base and Expert Models2026.06 | 9.98 | |
| TAGroup=Qwen3-4B-Base, Category=Merged Models2026.06 | 9.59 | |
| GRPOGroup=Qwen3-4B-Base, Category=Base and Expert Models2026.06 | 5.28 | |
| Qwen3-4BGroup=Qwen3-4B-Base, Category=Base and Expert Models2026.06 | 4.7 |