Fact Checking on LIAR (Acc@1, Avg. Perf.)
69Accuracy@1DisambiguSLM
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| DisambiguSLMLLM=GPT, Avg. Cost ($)=0.022026.04 | 69 | 68.6 | |
| OPROLLM=GPT, Avg. Cost ($)=4.512026.04 | 67.6 | 66.6 | |
| SPOLLM=GPT, Avg. Cost ($)=0.152026.04 | 67.1 | 66.9 | |
| DisambiguSLMLLM=DeepSeek, Avg. Cost ($)=0.022026.04 | 66.6 | 66.3 | |
| APELLM=GPT, Avg. Cost ($)=9.072026.04 | 65.9 | 64.8 | |
| DisambiguSLMLLM=LLaMA, Avg. Cost ($)=0.022026.04 | 65.9 | 66 | |
| TextGradLLM=GPT, Avg. Cost ($)=13.142026.04 | 65.7 | 63.9 | |
| CoTLLM=GPT, Avg. Cost ($)=-2026.04 | 65.4 | 63.8 | |
| OPROLLM=DeepSeek, Avg. Cost ($)=4.512026.04 | 65.1 | 63.9 | |
| SPOLLM=DeepSeek, Avg. Cost ($)=0.152026.04 | 64.7 | 64.8 | |
| OPROLLM=LLaMA, Avg. Cost ($)=4.512026.04 | 64.2 | 63.1 | |
| Prompt AgentLLM=GPT, Avg. Cost ($)=2.712026.04 | 64.1 | 65 | |
| SPOLLM=LLaMA, Avg. Cost ($)=0.152026.04 | 63.8 | 64 | |
| Naïve promptingLLM=GPT, Avg. Cost ($)=-2026.04 | 63.5 | 61.6 | |
| APELLM=DeepSeek, Avg. Cost ($)=9.072026.04 | 63.4 | 62.4 | |
| Prompt BreederLLM=GPT, Avg. Cost ($)=4.822026.04 | 63.2 | 64.5 | |
| TextGradLLM=DeepSeek, Avg. Cost ($)=13.142026.04 | 63 | 61.6 | |
| Step-backLLM=GPT, Avg. Cost ($)=-2026.04 | 62.8 | 65 | |
| APELLM=LLaMA, Avg. Cost ($)=9.072026.04 | 62.6 | 61.7 | |
| CoTLLM=DeepSeek, Avg. Cost ($)=-2026.04 | 62.1 | 61.2 | |
| TextGradLLM=LLaMA, Avg. Cost ($)=13.142026.04 | 62 | 60.9 | |
| Prompt AgentLLM=DeepSeek, Avg. Cost ($)=2.712026.04 | 61.9 | 62.7 | |
| CoTLLM=LLaMA, Avg. Cost ($)=-2026.04 | 61.5 | 60.4 | |
| Prompt AgentLLM=LLaMA, Avg. Cost ($)=2.712026.04 | 61.2 | 62 | |
| Prompt BreederLLM=DeepSeek, Avg. Cost ($)=4.822026.04 | 61.1 | 62.2 | |
| Naïve promptingLLM=DeepSeek, Avg. Cost ($)=-2026.04 | 60.8 | 59.2 | |
| Step-backLLM=DeepSeek, Avg. Cost ($)=-2026.04 | 60.4 | 62.3 | |
| Prompt BreederLLM=LLaMA, Avg. Cost ($)=4.822026.04 | 60.3 | 61.4 | |
| Naïve promptingLLM=LLaMA, Avg. Cost ($)=-2026.04 | 59.9 | 58.2 | |
| Step-backLLM=LLaMA, Avg. Cost ($)=-2026.04 | 59.7 | 61.4 | |
| RephraseLLM=GPT, Avg. Cost ($)=-2026.04 | 50.5 | 61.1 | |
| RephraseLLM=DeepSeek, Avg. Cost ($)=-2026.04 | 49.2 | 58.8 | |
| RephraseLLM=LLaMA, Avg. Cost ($)=-2026.04 | 48.6 | 57.93 |