NL-to-FOL Syntax Correctness on LogicNLI (test)
99Syntax Correctness RateNL2LOGIC
Evaluation results
| Method | Links | |
|---|---|---|
| NL2LOGICbackbone=gemma-2-9b2026.01 | 99 | |
| NL2LOGICbackbone=gemma-2-27b2026.01 | 99 | |
| NL2LOGICbackbone=qwen-2.5-1.5b2026.01 | 99 | |
| NL2LOGICbackbone=qwen-2.5-3b2026.01 | 99 | |
| NL2LOGICbackbone=qwen-2.5-7b2026.01 | 99 | |
| NL2LOGICbackbone=qwen-2.5-14b2026.01 | 99 | |
| NL2LOGICbackbone=llama-3.2-3b2026.01 | 98 | |
| NL2LOGICbackbone=llama-3.1-8b2026.01 | 98 | |
| NL2LOGICbackbone=ministral-8b2026.01 | 98 | |
| NL2LOGICbackbone=mistral-22b2026.01 | 98 | |
| NL2LOGICbackbone=llama-3.2-1b2026.01 | 97 | |
| NL2LOGICbackbone=gemma-2-2b2026.01 | 94 | |
| GCDbackbone=gemma-2-27b2026.01 | 93 | |
| GCDbackbone=gemma-2-9b2026.01 | 91 | |
| NL2LOGICbackbone=qwen-2.5-0.5b2026.01 | 80 | |
| GCDbackbone=llama-3.1-8b2026.01 | 68 | |
| GCDbackbone=qwen-2.5-14b2026.01 | 56 | |
| GCDbackbone=mistral-22b2026.01 | 46 | |
| GCDbackbone=llama-3.2-3b2026.01 | 28 | |
| GCDbackbone=gemma-2-2b2026.01 | 25 | |
| GCDbackbone=qwen-2.5-1.5b2026.01 | 9 | |
| GCDbackbone=llama-3.2-1b2026.01 | 8 | |
| GCDbackbone=ministral-8b2026.01 | 7 | |
| GCDbackbone=qwen-2.5-0.5b2026.01 | 5 | |
| GCDbackbone=qwen-2.5-3b2026.01 | 1 | |
| GCDbackbone=qwen-2.5-7b2026.01 | 1 |