Syllogistic Reasoning on Belief-Inconsistent Syllogism
90AccuracyQwen2.5-0.5B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-0.5BPattern Group=Group 3: Variant Pattern2024.08 | 90 | |
| Qwen2.5-1.5BPattern Group=Group 3: Variant Pattern2024.08 | 90 | |
| Llama-3.2-1BPattern Group=Group 2: Compatible Pattern2024.08 | 70 | |
| Pythia-410MPattern Group=Group 2: Compatible Pattern2024.08 | 51 | |
| Pythia-1BPattern Group=Group 2: Compatible Pattern2024.08 | 43 | |
| Pythia-160MPattern Group=Group 1: Erratic Pattern2024.08 | 21 | |
| Pythia-70MPattern Group=Group 1: Erratic Pattern2024.08 | 2 |