Knowledge on MMLU and TruthfulQA
36.1MMLUADG
Evaluation results
| Method | Links | ||
|---|---|---|---|
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 36.1 | 40.3 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 35.48 | 37.2 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 35.07 | 41.54 | |
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 34.28 | 43.86 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 34.28 | 38.15 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 34.23 | 42.05 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 34.21 | 36.91 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 34.2 | 39.28 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 33.62 | 42.05 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 33.41 | 37.79 | |
| ADGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 32.78 | 39.53 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 32.29 | 42.19 | |
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 32.08 | 40.78 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 31.91 | 41.08 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.8 | 41.92 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.76 | 38.43 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 31.74 | 42.07 | |
| SelectITBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 31.02 | 39.49 | |
| RandomBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 30.96 | 39.78 | |
| SCARBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.76 | 42.66 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.52 | 39.12 | |
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 30.34 | 41.49 | |
| ZIPBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 30.33 | 38.42 | |
| MIGBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 30.05 | 39.22 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 29.75 | 40.19 | |
| All DataBackbone=LLaMA3.2-1B-Instruct, Selection Pool=Alpaca-GPT4(52K), Selection Budget=10K2026.04 | 29.53 | 44.91 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=CoT(100K), Selection Budget=10K2026.04 | 29.3 | 40.1 | |
| IFDBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 28.98 | 40.31 | |
| RethinkingBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 27.92 | 40.29 | |
| SuperFilteringBackbone=LLaMA3.2-1B-Instruct, Selection Pool=WizardLM(70K), Selection Budget=10K2026.04 | 27.6 | 38.77 |