Mathematical Reasoning on SVAMP 10 low-resourced languages FLORES-200
7.33Kazakh (Cyrl) ScoreDIP
Evaluation results
| Method | Links | |||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|
| DIPModel=Llama-3.2, English pivoting (EP)=true, Chain-of-thought (CT)=false, Dictionary Insertion Prompting=true2024.11 | 7.33 | 4 | 8 | 4.33 | 3.67 | 2.67 | 3.33 | 4.33 | 2 | 4.67 | 4.2 | |
| DIPModel=Llama-3.2, English pivoting (EP)=true, Chain-of-thought (CT)=true, Dictionary Insertion Prompting=true2024.11 | 7 | 3.67 | 12 | 3.67 | 5.33 | 4.33 | 7 | 5 | 4.33 | 7 | 5.83 | |
| Standard PromptingModel=Llama-3.22024.11 | 4 | 1 | 3.67 | 3 | 3 | 3.67 | 3 | 2.67 | 3.33 | 3 | 3.03 | |
| English PivotingModel=Llama-3.2, English pivoting (EP)=true2024.11 | 4 | 2.67 | 9 | 3.33 | 4 | 3.33 | 3.33 | 4.67 | 3.67 | 1 | 4.3 | |
| English Pivot ThoughtModel=Llama-3.2, English pivoting (EP)=true, Chain-of-thought (CT)=true2024.11 | 4 | 3.67 | 13 | 2.67 | 2.33 | 3.67 | 6.67 | 4.67 | 3.33 | 3.67 | 4.8 | |
| DIPModel=Llama-3.2, English pivoting (EP)=false, Chain-of-thought (CT)=false, Dictionary Insertion Prompting=true2024.11 | 3.33 | 5 | 4.67 | 3.67 | 2 | 4 | 1.67 | 3.67 | 1.33 | 4 | 2.73 | |
| Non-insertion PromptingModel=Llama-3.22024.11 | 2.67 | 2 | 3 | 3 | 2.67 | 1.33 | 1.67 | 3 | 1 | 1 | 1.87 |