List your company

Logical Reasoning on ProntoQA (val)

98.01AccuracyCoT2
72.675679.252885.8392.4072May 29, 2025

Evaluation results

MethodLinks
CoT2Backbone=4-layer, 4-head GPT2 (d=32), Budget=Full2025.0598.01
COCONUTBackbone=4-layer, 4-head GPT2 (d=32)2025.0596.94
Discrete CoTBackbone=4-layer, 4-head GPT2 (d=32), Budget=B=12025.0582.47
Discrete no-CoTBackbone=4-layer, 4-head GPT2 (d=32)2025.0573.65