List your company
ResearchFormerly WizWand

Dialect Translation on Jeolla, Gyeongsang, and Jeju dialects averaged (test)

71.31chrF++ICL
23.355635.805348.25560.7047Nov 10, 2025
Updated 7mo ago

Evaluation results

MethodLinks
ICLBackbone=Llama-3.12025.1171.3161.75-0.2615
ICLBackbone=EEVE2025.1170.9961.34-0.2616
ICL + DIA-REFINE(S)Backbone=EEVE2025.1170.4860.68-0.2319
ICL + DIA-REFINE(S)Backbone=Llama-3.12025.1170.4260.57-0.2418
ZSBackbone=Llama-3.12025.1168.9758.53-0.373
ICL + DIA-REFINE(M)Backbone=Llama-3.12025.1166.1554.67-0.136
ICLBackbone=Model Avg2025.1165.9954.25-0.1133
ICL + DIA-REFINE(M)Backbone=EEVE2025.1165.6754.3-0.0542
ICLBackbone=EXAONE-3.52025.1165.4152.88-0.0441
ICL + DIA-REFINE(S)Backbone=Model Avg2025.1163.7251.23-0.0642
ICLBackbone=Gemini-1.52025.1163.0849.10.3185
ZS + DIA-REFINE(S)Backbone=Llama-3.12025.1162.5249.82-0.373
ICL + DIA-REFINE(S)Backbone=Gemini-1.52025.1162.1347.730.3697
ICL + DIA-REFINE(M)Backbone=Gemini-1.52025.1161.6847.220.3999
ZS + DIA-REFINE(S)Backbone=HyperCLOVAX, Prompting=Zero-shot, Refinement=DIA-REFINE (Single)2025.1160.7647.94-0.374
ZSBackbone=HyperCLOVAX, Prompting=Zero-shot2025.1160.3347.64-0.373
ICL + DIA-REFINE(S)Backbone=EXAONE-3.52025.1160.1945.750.0760
ICLBackbone=HyperCLOVAX, Prompting=In-context Learning2025.1159.1746.21-0.39
ICL + DIA-REFINE(M)Backbone=Model Avg2025.1158.8945.410.0962
ICL + DIA-REFINE(S)Backbone=HyperCLOVAX, Prompting=In-context Learning, Refinement=DIA-REFINE (Single)2025.1155.3541.44-0.2415
ICL + DIA-REFINE(M)Backbone=EXAONE-3.52025.1154.9539.140.2794
ZSBackbone=EEVE2025.1154.0341.71-0.382
ZS + DIA-REFINE(M)Backbone=HyperCLOVAX, Prompting=Zero-shot, Refinement=DIA-REFINE (Multi)2025.1152.5238.82-0.328
ZS + DIA-REFINE(S)Backbone=EEVE2025.1152.4139.49-0.373
ZSBackbone=Model Avg2025.1150.3836.48-0.2320
ZS + DIA-REFINE(S)Backbone=Model Avg2025.1148.7334.23-0.2123
ICL + DIA-REFINE(M)Backbone=HyperCLOVAX, Prompting=In-context Learning, Refinement=DIA-REFINE (Multi)2025.114631.7-0.0641
ZS + DIA-REFINE(M)Backbone=Llama-3.12025.1144.2928.98-0.328
ZS + DIA-REFINE(M)Backbone=Model Avg2025.1140.0824.66-0.1234
ZS + DIA-REFINE(M)Backbone=EEVE2025.1139.8225.24-0.2813
ZSBackbone=Gemini-1.52025.1139.523.060.3693
ZS + DIA-REFINE(M)Backbone=Gemini-1.52025.1138.5522.130.499
ZS + DIA-REFINE(S)Backbone=Gemini-1.52025.1138.0321.920.3898
ZS + DIA-REFINE(S)Backbone=EXAONE-3.52025.1129.9411.97-0.328
ZSBackbone=EXAONE-3.52025.1129.0511.44-0.391
ZS + DIA-REFINE(M)Backbone=EXAONE-3.52025.1125.28.13-0.0842