Syllogistic Reasoning on Symbolic Syllogism
100AccuracyLlama-3.2-1B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama-3.2-1BPattern Group=Group 2: Compatible Pattern2024.08 | 100 | |
| Qwen2.5-0.5BPattern Group=Group 3: Variant Pattern2024.08 | 100 | |
| Qwen2.5-1.5BPattern Group=Group 3: Variant Pattern2024.08 | 100 | |
| Pythia-410MPattern Group=Group 2: Compatible Pattern2024.08 | 99 | |
| Pythia-1BPattern Group=Group 2: Compatible Pattern2024.08 | 30 | |
| Pythia-70MPattern Group=Group 1: Erratic Pattern2024.08 | 19 | |
| Pythia-160MPattern Group=Group 1: Erratic Pattern2024.08 | 0 |