List your company
ResearchFormerly WizWand

Reasoning on FLenQA 500 tokens

74AccuracyLIME+1
19.9233.964862.04Dec 8, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LIME+1Size=1B, Matching criteria=generates and matches only one word2025.1274
LIME+1Size=500M, Matching criteria=generates and matches only one word2025.1273.8
LIME+1Model Size=2B2025.1273.5
LIME+1Size=2B, Matching criteria=generates and matches only one word2025.1273.5
LIME+1Model Size=2B2025.1273.5
LIMEModel Size=2B2025.1265.3
LIMESize=2B, Matching criteria=match the first eight generated words2025.1265.3
LIMEModel Size=2B2025.1265.3
BaseModel Size=2B2025.1249.5
BaselineSize=2B, Matching criteria=match the first eight generated words2025.1249.5
Base (DCLM-BASELINE)Model Size=2B2025.1249.5
LIMESize=500M, Matching criteria=match the first eight generated words2025.1248.8
BaselineSize=1B, Matching criteria=match the first eight generated words2025.1239
LIMESize=1B, Matching criteria=match the first eight generated words2025.1232
BaselineSize=500M, Matching criteria=match the first eight generated words2025.1222