List your company
ResearchFormerly WizWand

Confidence alignment on LogiQA

0.039ECEConfTuner
0.020640.144570.26850.39243May 12, 2026
Updated 5mo ago

Evaluation results

MethodLinks
ConfTunerFoundation Model=Qwen3 8B2026.050.0390.3971.2270.1510.10169.9
SFTFoundation Model=LLAMA-3 8B2026.050.0450.3994.4150.3260.1749.6
Ours-ORCEFoundation Model=LLAMA-3 8B2026.050.0570.4675.1690.3060.14949.6
SFTFoundation Model=Mistral 7B2026.050.0590.3038.4190.360.20349.6
ConfTunerFoundation Model=LLAMA-3 8B2026.050.0630.3742.7180.3460.1949.6
Ours-ORCEFoundation Model=Mistral 7B2026.050.070.3142.70.3550.19949.6
Ours-ORCEFoundation Model=Qwen3 8B2026.050.0810.4541.2320.1480.09869.9
SFTFoundation Model=Qwen3 8B2026.050.0940.4170.1610.1169.9
CoTFoundation Model=Qwen3 8B2026.050.1260.161.7920.2430.19771
ConfTunerFoundation Model=Mistral 7B2026.050.1260.1771.7580.4390.28349.6
ConsistencyFoundation Model=Mistral 7B2026.050.1630.3044.7670.3860.20546.2
ConsistencyFoundation Model=LLAMA-3 8B2026.050.1880.2931.6430.3840.21447.8
Top-kFoundation Model=Qwen3 8B2026.050.1950.1256.3610.2570.20669.7
ConsistencyFoundation Model=Qwen3 8B2026.050.220.363.390.210.16270.6
VanillaFoundation Model=Qwen3 8B2026.050.250.1547.5190.2510.269.9
VanillaFoundation Model=LLAMA-3 8B2026.050.2910.0170.4980.5030.34649.6
CoTFoundation Model=LLAMA-3 8B2026.050.4070.2061.7670.5380.31240.8
CoTFoundation Model=Mistral 7B2026.050.4160.1053.210.5760.34139.8
Top-kFoundation Model=LLAMA-3 8B2026.050.4480.0884.7080.5010.32647
Top-kFoundation Model=Mistral 7B2026.050.4480.0340.1810.5110.33847.3
VanillaFoundation Model=Mistral 7B2026.050.498-0.0320.2070.4920.33549.6