Multilingual Understanding on BELEBELE Target Language
52.11CES PerformanceSDRRL
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| SDRRL2024.02 | 52.11 | 55 | 48.33 | 54 | 49.56 | 46.44 | 53.89 | 52.4 | 45.81 | 46.82 | 57.88 | 47.26 | 48.38 | 50.17 | 50.58 | |
| XCOT2024.02 | 51.56 | 54.22 | 47.83 | 52.78 | 47 | 45.67 | 51.33 | 49.16 | 43.02 | 46.15 | 56.42 | 46.48 | 46.82 | 48.49 | 49.07 | |
| CIT2024.02 | 50.11 | 53.44 | 47.22 | 51.44 | 48 | 45.67 | 53.33 | 49.94 | 43.24 | 46.26 | 56.65 | 46.7 | 45.59 | 49.72 | 49.09 | |
| SFT2024.02 | 49.33 | 48.33 | 46.67 | 49.11 | 39.78 | 43.22 | 49.22 | 46.15 | 42.01 | 37.99 | 55.98 | 42.79 | 42.91 | 44.69 | 45.58 | |
| T-SFT2024.02 | 48.22 | 51.67 | 47.11 | 51.22 | 47.11 | 45.67 | 51.33 | 49.72 | 41.56 | 43.69 | 56.2 | 46.03 | 47.6 | 48.72 | 48.28 |