Graduate-level Reasoning on GPQA-D
49.5AccuracyGeoFaith
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GeoFaithBackbone=Qwen3-4B2026.05 | 49.5 | 1,600 | 51.3 | |
| TruthRLBackbone=Qwen3-4B2026.05 | 44.4 | 1,200 | 31.2 | |
| THSBackbone=Qwen3-4B2026.05 | 44.4 | 1,600 | 32.3 | |
| KnowRLBackbone=Qwen3-4B2026.05 | 41.9 | 2,000 | 39 | |
| GeoFaithBackbone=Qwen3-1.7B2026.05 | 38.4 | 900 | 30.3 | |
| GRPOBackbone=Qwen3-4B2026.05 | 38.4 | 2,500 | 37.7 | |
| OriginalBackbone=Qwen3-4B2026.05 | 37.4 | 5,500 | 45.7 | |
| GRPOBackbone=Qwen3-1.7B2026.05 | 31.3 | 1,000 | 29.9 | |
| KnowRLBackbone=Qwen3-1.7B2026.05 | 30.8 | 800 | 18.5 | |
| THSBackbone=Qwen3-1.7B2026.05 | 29.3 | 300 | 16 | |
| TruthRLBackbone=Qwen3-1.7B2026.05 | 25.8 | 600 | 3.6 | |
| OriginalBackbone=Qwen3-1.7B2026.05 | 23.7 | 1,300 | 27 |