Reasoning on BBH, GSM8K
32.27BBH ScoreMIG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 32.27 | 5.16 | |
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 32.13 | 6.84 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.98 | 7.28 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.77 | 6.82 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 31.53 | 6.52 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 31.52 | 6.22 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 31.25 | 6.22 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 31.24 | 5.31 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.07 | 6.75 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 30.9 | 6.22 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.75 | 5.69 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 30.59 | 6.22 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 30.46 | 6.6 | |
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.39 | 7.28 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.29 | 7.05 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.22 | 6.9 | |
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.21 | 4.7 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.02 | 6.28 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 29.77 | 6.67 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 29.67 | 5.38 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 29.27 | 9.86 | |
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 28.69 | 10.79 | |
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 28.5 | 9.4 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 28.47 | 9.55 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 27.8 | 6.6 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 27.42 | 7.96 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 27.35 | 11.6 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 27.29 | 9.02 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 26.94 | 9.93 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 25.08 | 10.25 |