True/False Reasoning on LogiQA 2.0 (test)
0.614AccuracyRIOT
Evaluation results
| Method | Links | |
|---|---|---|
| RIOToptimization=automatic2025.06 | 0.614 | |
| TextGradoptimization=automatic2025.06 | 0.6 | |
| DSPyoptimization=automatic2025.06 | 0.598 | |
| Four-Shot CoToptimization=manual, shots=42025.06 | 0.597 | |
| Twenty-Shot CoToptimization=manual, shots=202025.06 | 0.594 | |
| Zero-Shot CoToptimization=manual, shots=02025.06 | 0.59 | |
| OPROoptimization=automatic2025.06 | 0.58 | |
| APEoptimization=automatic2025.06 | 0.574 |