Natural Language Understanding on ltzGLUE (test)
88.88HA ScoreGPT
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| GPTEvaluation Protocol=Prompted, Aggregation=Single run2026.04 | 88.88 | 56.44 | 75.24 | 51.45 | 67.15 | 89.27 | 38.26 | 88.51 | |
| QWENEvaluation Protocol=Prompted, Aggregation=Single run2026.04 | 86.08 | 51.63 | 67.77 | 39.69 | 70.73 | 88.37 | 34.9 | 84.17 | |
| MMBRTEvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 85.59 | 53.37 | 89.97 | 88.83 | 90.41 | 98.92 | 78.26 | 52.81 | |
| GEMMAEvaluation Protocol=Prompted, Aggregation=Single run2026.04 | 80.53 | 55.6 | 58.68 | 43.28 | 48.44 | 48.67 | 7.25 | 73.12 | |
| MBRTEvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 77.91 | 41.25 | 81.26 | 81.2 | 83.06 | 97.8 | 60.65 | 42.57 | |
| LLAMAEvaluation Protocol=Prompted, Aggregation=Single run2026.04 | 77.66 | 45.84 | 41.44 | 11.17 | 50.5 | 12.47 | 35.75 | 72.01 | |
| LTZ-E1-miniEvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 72.69 | 45.39 | 89.31 | 86.62 | 88.95 | 98.5 | 80.13 | 45.35 | |
| XLMREvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 72.09 | 36.4 | 70.25 | 73.4 | 79.58 | 97.24 | 62.75 | 35.24 | |
| LXBRTEvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 66.37 | 58.66 | 89.17 | 87.96 | 87.43 | 98.68 | 91.71 | 46.51 | |
| LTZ-E1-baseEvaluation Protocol=Fine-tuned, Aggregation=Average of 3 runs2026.04 | 62.81 | 46.59 | 83.17 | 78.63 | 88.01 | 98.95 | 73.32 | 39.38 |