Code Generation on CodeGym
41.4AccuracyECHO
Evaluation results
| Method | Links | |
|---|---|---|
| ECHOBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 41.4 | |
| ECHO w/ Top-K retrievalBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 40.7 | |
| ECHO w/ Top-K retrieval & w/o turn summaryBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 40.3 | |
| ECHO w/o traceable CABackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 38.1 | |
| SUPOBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 35.4 | |
| ECHO w/o Traceable CA & Turn-level ISBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 34.6 | |
| GRPOBackbone=Qwen3-32B-Instruct, Zero-shot protocol=true2026.06 | 32.8 | |
| ECHOBackbone=Qwen3-30B-A3B-Instruct, Zero-shot protocol=true2026.06 | 29.7 | |
| SUPOBackbone=Qwen3-30B-A3B-Instruct, Zero-shot protocol=true2026.06 | 27.3 | |
| GRPOBackbone=Qwen3-30B-A3B-Instruct, Zero-shot protocol=true2026.06 | 20.3 |