List your company
ResearchFormerly WizWand

Fact Checking on LIAR (Acc@1, Avg. Perf.)

69Accuracy@1DisambiguSLM
47.78453.29258.864.308Apr 25, 2026
Updated 6mo ago

Evaluation results

MethodLinks
DisambiguSLMLLM=GPT, Avg. Cost ($)=0.022026.046968.6
OPROLLM=GPT, Avg. Cost ($)=4.512026.0467.666.6
SPOLLM=GPT, Avg. Cost ($)=0.152026.0467.166.9
DisambiguSLMLLM=DeepSeek, Avg. Cost ($)=0.022026.0466.666.3
APELLM=GPT, Avg. Cost ($)=9.072026.0465.964.8
DisambiguSLMLLM=LLaMA, Avg. Cost ($)=0.022026.0465.966
TextGradLLM=GPT, Avg. Cost ($)=13.142026.0465.763.9
CoTLLM=GPT, Avg. Cost ($)=-2026.0465.463.8
OPROLLM=DeepSeek, Avg. Cost ($)=4.512026.0465.163.9
SPOLLM=DeepSeek, Avg. Cost ($)=0.152026.0464.764.8
OPROLLM=LLaMA, Avg. Cost ($)=4.512026.0464.263.1
Prompt AgentLLM=GPT, Avg. Cost ($)=2.712026.0464.165
SPOLLM=LLaMA, Avg. Cost ($)=0.152026.0463.864
Naïve promptingLLM=GPT, Avg. Cost ($)=-2026.0463.561.6
APELLM=DeepSeek, Avg. Cost ($)=9.072026.0463.462.4
Prompt BreederLLM=GPT, Avg. Cost ($)=4.822026.0463.264.5
TextGradLLM=DeepSeek, Avg. Cost ($)=13.142026.046361.6
Step-backLLM=GPT, Avg. Cost ($)=-2026.0462.865
APELLM=LLaMA, Avg. Cost ($)=9.072026.0462.661.7
CoTLLM=DeepSeek, Avg. Cost ($)=-2026.0462.161.2
TextGradLLM=LLaMA, Avg. Cost ($)=13.142026.046260.9
Prompt AgentLLM=DeepSeek, Avg. Cost ($)=2.712026.0461.962.7
CoTLLM=LLaMA, Avg. Cost ($)=-2026.0461.560.4
Prompt AgentLLM=LLaMA, Avg. Cost ($)=2.712026.0461.262
Prompt BreederLLM=DeepSeek, Avg. Cost ($)=4.822026.0461.162.2
Naïve promptingLLM=DeepSeek, Avg. Cost ($)=-2026.0460.859.2
Step-backLLM=DeepSeek, Avg. Cost ($)=-2026.0460.462.3
Prompt BreederLLM=LLaMA, Avg. Cost ($)=4.822026.0460.361.4
Naïve promptingLLM=LLaMA, Avg. Cost ($)=-2026.0459.958.2
Step-backLLM=LLaMA, Avg. Cost ($)=-2026.0459.761.4
RephraseLLM=GPT, Avg. Cost ($)=-2026.0450.561.1
RephraseLLM=DeepSeek, Avg. Cost ($)=-2026.0449.258.8
RephraseLLM=LLaMA, Avg. Cost ($)=-2026.0448.657.93