Syllogistic Reasoning on Belief-Consistent Syllogism
99AccuracyQwen2.5-1.5B
Evaluation Results
| Method | Links | |
|---|---|---|
| Qwen2.5-1.5BPattern Group=Group 3: Variant Pattern2024.08 | 99 | |
| Qwen2.5-0.5BPattern Group=Group 3: Variant Pattern2024.08 | 96 | |
| Llama-3.2-1BPattern Group=Group 2: Compatible Pattern2024.08 | 81 | |
| Pythia-410MPattern Group=Group 2: Compatible Pattern2024.08 | 40 | |
| Pythia-1BPattern Group=Group 2: Compatible Pattern2024.08 | 31 | |
| Pythia-160MPattern Group=Group 1: Erratic Pattern2024.08 | 12 | |
| Pythia-70MPattern Group=Group 1: Erratic Pattern2024.08 | 2 |