Retrieval-Augmented Generation on Hotpot-ENKB5 v1 (Indonesian)
69.36Language ConsistencySFT
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SFTBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 69.36 | 65.71 | 77.79 | 70.95 | |
| Prompt-ControlBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 56.54 | 82.93 | 74.86 | 71.44 | |
| DITBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 56 | 86.57 | 74.67 | 72.41 | |
| TR-RAGBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 55.6 | 79.96 | 85.74 | 73.57 | |
| Qwen3-30B-A3B-Instruct-2507Model Type=Teacher/Reference2026.07 | 55.54 | 83.02 | 79.98 | 72.85 | |
| Qwen3-4B-Instruct-2507Model Type=Base/Reference2026.07 | 55.45 | 79.75 | 76.32 | 70.51 | |
| TranslateBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 55.09 | 78.41 | 75.53 | 69.68 | |
| SDFTBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 54.9 | 80.6 | 77.96 | 71.15 | |
| On-Policy DistillationBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 54.9 | 80.25 | 78.53 | 71.23 | |
| Knowledge distillationBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 54.81 | 80.2 | 77.85 | 70.95 | |
| Naive-RLBackbone=Qwen3-4B-Instruct-2507, Teacher=Qwen3-30B-A3B-Instruct-25072026.07 | 28.27 | 79.7 | 86.41 | 64.79 |