Logical Reasoning on BBH Web of Lies
98Accuracyevaluation-instructed prompt optimization
Evaluation Results
| Method | Links | |
|---|---|---|
| evaluation-instructed prompt optimizationBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 98 | |
| LLM onlyBackbone=GPT-4o, Optimization Type=None2025.11 | 96 | |
| Pro-RefineBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 96 | |
| TextGradBackbone=GPT-4o, Optimization Type=Template2025.11 | 96 | |
| APEBackbone=GPT-4o, Optimization Type=Template2025.11 | 95 | |
| Self-RefineBackbone=GPT-4o, Optimization Type=Query-dependent2025.11 | 94 | |
| TextGradBackbone=LLaMA-3, Optimization Type=Template2025.11 | 74 | |
| TextGradBackbone=LLaMA-3.1, Optimization Type=Template2025.11 | 73 | |
| APEBackbone=LLaMA-3, Optimization Type=Template2025.11 | 72 | |
| Pro-RefineBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 71 | |
| APEBackbone=LLaMA-3.1, Optimization Type=Template2025.11 | 71 | |
| Pro-RefineBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 70 | |
| evaluation-instructed prompt optimizationBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 69 | |
| LLM onlyBackbone=LLaMA-3.1, Optimization Type=None2025.11 | 69 | |
| evaluation-instructed prompt optimizationBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 68 | |
| Self-RefineBackbone=LLaMA-3, Optimization Type=Query-dependent2025.11 | 67 | |
| LLM onlyBackbone=LLaMA-3, Optimization Type=None2025.11 | 66 | |
| Self-RefineBackbone=LLaMA-3.1, Optimization Type=Query-dependent2025.11 | 66 |