Language Understanding on GLUE and SuperGLUE
96.1SST-2 AccuracyFlatPO
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FlatPOModel=LLaMA-13B, PEFT=LoRA2026.06 | 96.1 | 69.2 | 74 | 88.5 | |
| SAMModel=LLaMA-13B, PEFT=LoRA2026.06 | 95.8 | 67.3 | 73 | 87.5 | |
| GAMModel=LLaMA-13B, PEFT=LoRA2026.06 | 95.8 | 68.6 | 73.3 | 87.6 | |
| FlatPOModel=LLaMA-13B, PEFT=Prompt Tuning2026.06 | 95.8 | 68.6 | 73 | 82.3 | |
| Adam (Base)Model=LLaMA-13B, PEFT=LoRA2026.06 | 95.5 | 65.5 | 72.5 | 87 | |
| FlatPOModel=LLaMA-13B, PEFT=Prefix Tuning2026.06 | 95.4 | 69.2 | 74.2 | 88.2 | |
| SAMModel=LLaMA-13B, PEFT=Prompt Tuning2026.06 | 95.1 | 67 | 72 | 81.2 | |
| GAMModel=LLaMA-13B, PEFT=Prompt Tuning2026.06 | 95.1 | 68 | 72.3 | 81.7 | |
| GAMModel=LLaMA-13B, PEFT=Prefix Tuning2026.06 | 95 | 68.4 | 73.6 | 87.4 | |
| FlatPOModel=LLaMA-7B, PEFT=Prefix Tuning2026.06 | 94.8 | 66.2 | 72.5 | 85.4 | |
| SAMModel=LLaMA-13B, PEFT=Prefix Tuning2026.06 | 94.8 | 67.3 | 73.3 | 87.2 | |
| FlatPOModel=LLaMA-7B, PEFT=LoRA2026.06 | 94.7 | 66.5 | 72 | 86 | |
| FlatPOModel=LLaMA-7B, PEFT=Prompt Tuning2026.06 | 94.6 | 65.9 | 70.5 | 79.3 | |
| Adam (Base)Model=LLaMA-13B, PEFT=Prefix Tuning2026.06 | 94.5 | 66 | 72.8 | 86.5 | |
| FlatPOModel=OPT-1.3B, PEFT=LoRA2026.06 | 94.4 | 64.4 | 67.2 | 75.9 | |
| Adam (Base)Model=LLaMA-13B, PEFT=Prompt Tuning2026.06 | 94.3 | 65.3 | 71.5 | 80.5 | |
| FlatPOModel=OPT-1.3B, PEFT=Prefix Tuning2026.06 | 94 | 65.3 | 66.2 | 75.2 | |
| FlatPOModel=OPT-1.3B, PEFT=Prompt Tuning2026.06 | 93.9 | 64.5 | 65.3 | 68 | |
| GAMModel=LLaMA-7B, PEFT=LoRA2026.06 | 93.8 | 65.8 | 71 | 85 | |
| GAMModel=LLaMA-7B, PEFT=Prompt Tuning2026.06 | 93.8 | 65.5 | 69.8 | 78.8 | |
| SAMModel=LLaMA-7B, PEFT=LoRA2026.06 | 93.6 | 65.9 | 70.8 | 84.9 | |
| GAMModel=LLaMA-7B, PEFT=Prefix Tuning2026.06 | 93.6 | 65.5 | 71.6 | 84.6 | |
| SAMModel=LLaMA-7B, PEFT=Prompt Tuning2026.06 | 93.6 | 65.2 | 69.5 | 78.6 | |
| Adam (Base)Model=LLaMA-7B, PEFT=LoRA2026.06 | 93.4 | 65.3 | 70.5 | 84.2 | |
| SAMModel=LLaMA-7B, PEFT=Prefix Tuning2026.06 | 93.4 | 65.2 | 71.2 | 84.8 | |
| SAMModel=OPT-1.3B, PEFT=LoRA2026.06 | 93.2 | 63.4 | 65.5 | 75 | |
| GAMModel=OPT-1.3B, PEFT=LoRA2026.06 | 93.2 | 63.6 | 66.2 | 74.9 | |
| GAMModel=OPT-1.3B, PEFT=Prefix Tuning2026.06 | 93.2 | 64.4 | 65.3 | 74.4 | |
| Adam (Base)Model=LLaMA-7B, PEFT=Prompt Tuning2026.06 | 93.2 | 64.5 | 69.2 | 77.3 | |
| GAMModel=OPT-1.3B, PEFT=Prompt Tuning2026.06 | 93.1 | 63.5 | 64.5 | 67.5 | |
| SAMModel=OPT-1.3B, PEFT=Prompt Tuning2026.06 | 93 | 63.4 | 64.4 | 67.5 | |
| Adam (Base)Model=LLaMA-7B, PEFT=Prefix Tuning2026.06 | 92.8 | 64.4 | 70.8 | 83.8 | |
| Adam (Base)Model=OPT-1.3B, PEFT=Prefix Tuning2026.06 | 92.7 | 63.4 | 64.4 | 73.1 | |
| SAMModel=OPT-1.3B, PEFT=Prefix Tuning2026.06 | 92.7 | 64 | 65.2 | 74.1 | |
| Adam (Base)Model=OPT-1.3B, PEFT=LoRA2026.06 | 92.6 | 62.8 | 65 | 73.7 | |
| Adam (Base)Model=OPT-1.3B, PEFT=Prompt Tuning2026.06 | 92.6 | 62.5 | 63.6 | 66.2 |