Question Answering on Knowledge-based Benchmarks German
30.8ARC ScoreSALT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SALTSource Model=Gemma2025.05 | 30.8 | 42.58 | 24.75 | 32.71 | |
| MultivariateSource Model=Gemma2025.05 | 29.43 | 39.26 | 24.37 | 31.02 | |
| OFASource Model=Gemma2025.05 | 28.74 | 38.74 | 24.62 | 30.7 | |
| FOCUSSource Model=Gemma2025.05 | 26.95 | 38.27 | 24.24 | 29.82 | |
| SALTSource Model=XGLM2025.05 | 25.49 | 31.73 | 27.28 | 28.17 | |
| MultivariateSource Model=XGLM2025.05 | 24.72 | 29.66 | 26.27 | 26.88 | |
| OFASource Model=XGLM2025.05 | 24.12 | 30.47 | 26.9 | 27.16 | |
| FOCUSSource Model=XGLM2025.05 | 23.95 | 29.89 | 26.9 | 26.91 |