Logical Reasoning on Rule-chaining
84AccuracyOVM
Evaluation results
| Method | Links | |
|---|---|---|
| OVMBase model=Qwen2.5, Transfer cost=full retrain2026.05 | 84 | |
| Self-ConsistencyBase model=Qwen2.5, Transfer cost=N/A2026.05 | 78 | |
| PT-SFTBase model=Qwen2.5, Transfer cost=full retrain2026.05 | 77 | |
| HyperGuideBase model=Qwen2.5, Transfer cost=small MLP2026.05 | 77 | |
| Self-ConsistencyBase model=Mistral, Transfer cost=N/A2026.05 | 74.5 | |
| HyperGuideBase model=GPT-OSS, Transfer cost=small MLP2026.05 | 74 | |
| SoftCoTBase model=Qwen2.5, Transfer cost=full retrain2026.05 | 73.5 | |
| PT-SFTBase model=GPT-OSS, Transfer cost=full retrain2026.05 | 72 | |
| PT-SFTBase model=Mistral, Transfer cost=full retrain2026.05 | 72 | |
| OVMBase model=Mistral, Transfer cost=full retrain2026.05 | 71.5 | |
| OVMBase model=GPT-OSS, Transfer cost=full retrain2026.05 | 70 | |
| HyperGuideBase model=Mistral, Transfer cost=small MLP2026.05 | 70 | |
| SoftCoTBase model=GPT-OSS, Transfer cost=full retrain2026.05 | 67.5 | |
| SoftCoTBase model=Mistral, Transfer cost=full retrain2026.05 | 63.5 | |
| Few-shotBase model=Mistral, Transfer cost=N/A2026.05 | 54 | |
| Few-shotBase model=Qwen2.5, Transfer cost=N/A2026.05 | 53 | |
| Tree of ThoughtsBase model=Qwen2.5, Transfer cost=N/A2026.05 | 52 | |
| Self-ConsistencyBase model=GPT-OSS, Transfer cost=N/A2026.05 | 52 | |
| Tree of ThoughtsBase model=GPT-OSS, Transfer cost=N/A2026.05 | 50 | |
| Tree of ThoughtsBase model=Mistral, Transfer cost=N/A2026.05 | 50 | |
| Few-shotBase model=GPT-OSS, Transfer cost=N/A2026.05 | 16.1 |