# Southeast Asian language understanding and generation on SEA-HELM Source: [Southeast Asian language understanding and generation on SEA-HELM]() Collection index: [llms.txt]() Data updated: 2026-06-04T12:41:40.128Z Evaluation of model performance across Southeast Asian languages (Indonesian, Vietnamese, Thai, Tamil, Tagalog, Malay, Burmese) focusing on general language understanding and generation capabilities. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Southeast Asian language understanding and generation | | Dataset (including any stated split) | SEA-HELM | | Metric | Indonesian Score | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 8 of 8 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Indonesian Score](): Higher is better; unit: SCALAR. - [Vietnamese Score](): Higher is better; unit: SCALAR. - [Thai Score](): Higher is better; unit: SCALAR. - [Tamil Score](): Higher is better; unit: SCALAR. - [Tagalog Score](): Higher is better; unit: SCALAR. - [Malay Score](): Higher is better; unit: SCALAR. - [Burmese Score](): Higher is better; unit: SCALAR. - [Average Score (SEA)](): Higher is better; unit: SCALAR. ## Recorded results | Method | Indonesian Score | Result date | Report paper | | --- | --- | --- | --- | | Qwen2.5-3B-Instruct (Teacher) | 42 | Not recorded | 6a210700c10484bac23f079e | | SPIN | 12.6 | Not recorded | 6a210700c10484bac23f079e | | GKD | 11.7 | Not recorded | 6a210700c10484bac23f079e | | DuDi | 11.7 | Not recorded | 6a210700c10484bac23f079e | | SFT | 10.6 | Not recorded | 6a210700c10484bac23f079e | | DFT | 9.3 | Not recorded | 6a210700c10484bac23f079e | | SeqKD | 7.1 | Not recorded | 6a210700c10484bac23f079e | | SDFT | 4.2 | Not recorded | 6a210700c10484bac23f079e | ### Qwen2.5-3B-Instruct (Teacher) Indonesian Score: 42. Result ID: 6a217266fbc373592c1ea9a5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model Type":"Teacher"}. This record does not assert independent reproduction. ### SPIN Indonesian Score: 12.6. Result ID: 6a217266fbc373592c1ea9a8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### GKD Indonesian Score: 11.7. Result ID: 6a217266fbc373592c1ea9ab. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### DuDi Indonesian Score: 11.7. Result ID: 6a217266fbc373592c1ea9ac. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### SFT Indonesian Score: 10.6. Result ID: 6a217266fbc373592c1ea9a6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### DFT Indonesian Score: 9.3. Result ID: 6a217266fbc373592c1ea9a7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### SeqKD Indonesian Score: 7.1. Result ID: 6a217266fbc373592c1ea9aa. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. ### SDFT Indonesian Score: 4.2. Result ID: 6a217266fbc373592c1ea9a9. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Teacher Model":"Qwen2.5-3B-Instruct","Student Model":"Qwen2.5-0.5B"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.