Code Generation on QHack 2022
64pass@1PennySynth-13k
Evaluation results
| Method | Links | ||
|---|---|---|---|
| PennySynth-13kModel=GPT-5.52026.05 | 64 | 68 | |
| PennySynth-13kModel=Claude Sonnet 4.62026.05 | 56 | 64 | |
| PennySynth-13kModel=Qwen3-235B2026.05 | 52 | 64 | |
| PennySynth-13kModel=DeepSeek-V32026.05 | 32 | 48 | |
| PennySynth-13kModel=GLM-5.12026.05 | 20 | 48 | |
| PennySynth-13kModel=LLaMA 3.1-8B2026.05 | 12 | 20 | |
| PennySynth-13kModel=Gemini 2.5 Pro2026.05 | 8 | 8 |