Step-wise Verification on Hard2Verify
37.3TNRVerifySteer-Bi
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VerifySteer-BiBackbone=FARE-20B2026.05 | 37.3 | 81 | 51.1 | 9.9 | |
| VerifySteer-UniBackbone=FARE-20B2026.05 | 35.4 | 73.8 | 47.9 | 9.2 | |
| FARE PromptBackbone=FARE-20B2026.05 | 28.5 | 76.2 | 41.5 | 7.7 | |
| FARE Prompt + Cons@8Backbone=FARE-20B, Self-Consistency=82026.05 | 28.3 | 87.3 | 42.7 | 62.1 | |
| FARE Prompt + Cons@4Backbone=FARE-20B, Self-Consistency=42026.05 | 27.4 | 85.7 | 41.5 | 30.9 | |
| VerifySteer-UniBackbone=Qwen3-8B-thinking2026.05 | 21.5 | 75.6 | 33.4 | 77.72 | |
| VerifySteer-BiBackbone=Qwen3-8B-thinking2026.05 | 21.5 | 76.2 | 33.4 | 77.71 | |
| gpt-oss-20B2026.05 | 19 | 90.5 | 31.4 | 5 | |
| Prompt Opt. + Cons@8Backbone=Qwen3-8B-thinking, Self-Consistency=82026.05 | 18.8 | 92.1 | 31.2 | 545.19 | |
| Prompt Opt. + Cons@4Backbone=Qwen3-8B-thinking, Self-Consistency=42026.05 | 18.7 | 88.9 | 30.7 | 274.33 | |
| Qwen3-14B-thinking2026.05 | 18.5 | 85.4 | 30.4 | 110.87 | |
| Prompt Opt.Backbone=Qwen3-8B-thinking2026.05 | 18 | 78.6 | 29.1 | 69.59 | |
| Basic PromptBackbone=Qwen3-8B-thinking2026.05 | 12.8 | 94 | 22.4 | 72.64 | |
| Qwen2.5-72B2026.05 | 10.1 | 69 | 17.7 | 53.03 | |
| Llama-3.3-70B2026.05 | 4.4 | 88.1 | 8.4 | 71.35 |