Natural Language Understanding on GLUE (All 8 Tasks: CoLA, MNLI, MRPC, QNLI, QQP, RTE, SST2, STSB)
0.698CoLA ScorePEML
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| PEMLBackbone=LLaMA2-7B, Framework=multitasking2026.05 | 0.698 | 0.964 | 0.912 | 0.967 | 0.928 | 0.912 | 0.971 | 0.935 | 0.911 | |
| MTL-LoRABackbone=LLaMA2-7B, Framework=multitasking2026.05 | 0.68 | 0.914 | 0.902 | 0.963 | 0.914 | 0.924 | 0.971 | 0.928 | 0.9 | |
| LoRA-MTBackbone=LLaMA2-7B, Framework=multitasking2026.05 | 0.659 | 0.914 | 0.86 | 0.96 | 0.909 | 0.917 | 0.971 | 0.919 | 0.889 | |
| MoELoRABackbone=LLaMA2-7B, Framework=multitasking2026.05 | 0.637 | 0.912 | 0.855 | 0.957 | 0.906 | 0.921 | 0.966 | 0.922 | 0.884 | |
| MultiLoRABackbone=LLaMA2-7B, Framework=multitasking2026.05 | 0.613 | 0.91 | 0.863 | 0.955 | 0.9 | 0.91 | 0.963 | 0.918 | 0.879 |