AST evaluation on Seal-Tools
94.2Free Name ScoreLlama-3.1-8B
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Llama-3.1-8BModel=Llama-3.1-8B2026.06 | 94.2 | 84.4 | 47.6 | 58.5 | 61.9 | |
| Qwen2.5-7BModel=Qwen2.5-7B2026.06 | 92.9 | 70.1 | 36.4 | 46.9 | 53.7 | |
| PooledModel=Pooled2026.06 | 92.1 | 57.9 | 34.8 | 43.5 | 48 | |
| Qwen2.5-1.5BModel=Qwen2.5-1.5B2026.06 | 89.1 | 19.4 | 20.4 | 25.2 | 28.2 |