Efficiency Test Generation on CodeContests Java
63.08Acceptance Success Rate (Fast)STAB
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| STABModel=Gemma-42026.05 | 63.08 | 82.17 | 82.98 | |
| STABModel=Gemini-3.12026.05 | 59.82 | 77.65 | 79.91 | |
| STABModel=Qwen-3.52026.05 | 59.46 | 75.11 | 77.41 | |
| STABModel=GPT-5.42026.05 | 58.01 | 75.66 | 77.31 | |
| BaseModel=GPT-5.42026.05 | 57.47 | 74.3 | 73.82 | |
| BaseModel=Gemma-42026.05 | 41.54 | 57.38 | 41.33 | |
| BaseModel=Gemini-3.12026.05 | 35.48 | 58.91 | 59.79 | |
| BaseModel=Qwen-3.52026.05 | 27.6 | 56.65 | 59.43 |