Logical Reasoning on LogiQA (Normalized Accuracy)
30.11Normalized AccuracyLlama 3-8B E8T2
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama 3-8B E8T2Shots=0-shot2024.12 | 30.11 | |
| Llama 3-8BShots=0-shot2024.12 | 29.8 |
Loading the SOTA2 catalog…
| Method | Links | |
|---|---|---|
| Llama 3-8B E8T2Shots=0-shot2024.12 | 30.11 | |
| Llama 3-8BShots=0-shot2024.12 | 29.8 |