Natural Language Inference on LogicNLI
41Accuracygemma-2-2b
Evaluation results
| Method | Links | |
|---|---|---|
| gemma-2-2bDecoding Method=NL2LOGIC2026.01 | 41 | |
| qwen-2.5-1.5bDecoding Method=NL2LOGIC2026.01 | 41 | |
| ministral-8bDecoding Method=NL2LOGIC2026.01 | 38 | |
| gemma-2-9bDecoding Method=NL2LOGIC2026.01 | 37 | |
| gemma-2-27bDecoding Method=NL2LOGIC2026.01 | 37 | |
| llama-3.2-3bDecoding Method=NL2LOGIC2026.01 | 37 | |
| llama-3.1-8bDecoding Method=NL2LOGIC2026.01 | 37 | |
| qwen-2.5-0.5bDecoding Method=NL2LOGIC2026.01 | 36 | |
| qwen-2.5-3bDecoding Method=NL2LOGIC2026.01 | 35 | |
| qwen-2.5-14bDecoding Method=NL2LOGIC2026.01 | 35 | |
| mistral-22bDecoding Method=NL2LOGIC2026.01 | 34 | |
| qwen-2.5-7bDecoding Method=NL2LOGIC2026.01 | 34 | |
| llama-3.2-1bDecoding Method=NL2LOGIC2026.01 | 33 | |
| qwen-2.5-14bDecoding Method=GCD2026.01 | 27 | |
| gemma-2-27bDecoding Method=GCD2026.01 | 24 | |
| gemma-2-9bDecoding Method=GCD2026.01 | 23 | |
| gemma-2-2bDecoding Method=GCD2026.01 | 22 | |
| llama-3.1-8bDecoding Method=GCD2026.01 | 17 | |
| llama-3.2-3bDecoding Method=GCD2026.01 | 15 | |
| mistral-22bDecoding Method=GCD2026.01 | 14 | |
| qwen-2.5-0.5bDecoding Method=GCD2026.01 | 12 | |
| llama-3.2-1bDecoding Method=GCD2026.01 | 11 | |
| ministral-8bDecoding Method=GCD2026.01 | 4 | |
| qwen-2.5-1.5bDecoding Method=GCD2026.01 | 3 | |
| qwen-2.5-3bDecoding Method=GCD2026.01 | 1 | |
| qwen-2.5-7bDecoding Method=GCD2026.01 | 1 |