Question Answering on GPQA Diamond (test)
47AccuracyGitOfThoughts
Evaluation results
| Method | Links | |
|---|---|---|
| GitOfThoughtsBudget=600 s, Per-Q=469.8 s2026.06 | 47 | |
| ReTreVal (5× SC)Budget=180 s, Per-Q=127.9 s2026.06 | 34 | |
| Vanilla (single call)Budget=60 s, Per-Q=0.7 s2026.06 | 33 |