NL-to-STL Translation on NL2TL (test)
98AccuracyQwen2.5-0.5B-finetuned w/ CoT (Proposed)
Evaluation results
| Method | Links | |
|---|---|---|
| Qwen2.5-0.5B-finetuned w/ CoT (Proposed)Model size=0.5B2026.03 | 98 | |
| Llama2-finetunedModel size=13B2026.03 | 94.8 | |
| Qwen2.5-0.5B-finetuned w/o CoTModel size=0.5B2026.03 | 93.3 | |
| T5-finetunedModel size=220M2026.03 | 93.1 | |
| Qwen2.5-0.5B (prompt-only)Model size=0.5B2026.03 | 45.2 |