Causal Reasoning on e-CARE n = 200
82.3P0 ScoreVernier
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| VernierBackbone=Qwen2.5-14B2026.06 | 82.3 | 61 | 21.3 | -1 | |
| Base (CLadder adapter)Backbone=Qwen2.5-14B2026.06 | 82 | 60.5 | 21.5 | — | |
| Base (CLadder adapter)Backbone=Qwen2.5-32B, Quantization=QLoRA2026.06 | 82 | 62.5 | 19.5 | — | |
| Base (CLadder adapter)Backbone=Qwen2.5-7B2026.06 | 81.5 | 58.5 | 23 | — | |
| VernierBackbone=Qwen2.5-32B, Quantization=QLoRA2026.06 | 81.5 | 59.5 | 22 | 13 | |
| VernierBackbone=Qwen2.5-7B2026.06 | 81 | 62.2 | 18.8 | -18 | |
| Base (CLadder adapter)Backbone=Phi-3-mini (3.8B)2026.06 | 79.5 | 59 | 20.5 | — | |
| VernierBackbone=Llama-3.1-8B2026.06 | 79.3 | 61.5 | 17.8 | -26 | |
| Base (CLadder adapter)Backbone=Llama-3.1-8B2026.06 | 79 | 55 | 24 | — | |
| Base (CLadder adapter)Backbone=Mistral-7B, Recipe=Default, lr=1e-42026.06 | 79 | 55.5 | 23.5 | — | |
| Base (CLadder adapter)Backbone=Mistral-7B, Recipe=Rescued, lr=5e-6, step=1502026.06 | 79 | 55.5 | 23.5 | — | |
| VernierBackbone=Phi-3-mini (3.8B)2026.06 | 78.5 | 60 | 18.5 | -10 | |
| VernierBackbone=Mistral-7B, Recipe=Default, lr=1e-42026.06 | 77.5 | 58 | 19.5 | -17 | |
| VernierBackbone=Mistral-7B, Recipe=Rescued, lr=5e-6, step=1502026.06 | 77 | 56.5 | 20.5 | -13 |