Code Generation on QHack 2024
43Pass@1PennySynth-13k
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PennySynth-13kModel=Claude Sonnet 4.62026.05 | 43 | 52 | |
| PennySynth-13kModel=Qwen3-235B2026.05 | 43 | 53 | |
| PennySynth-13kModel=GPT-5.52026.05 | 29 | 43 | |
| PennySynth-13kModel=DeepSeek-V32026.05 | 19 | 33 | |
| PennySynth-13kModel=GLM-5.12026.05 | 5 | 14 | |
| PennySynth-13kModel=Gemini 2.5 Pro2026.05 | 0 | 0 | |
| PennySynth-13kModel=LLaMA 3.1-8B2026.05 | 0 | 0 |