Natural Language Understanding on MRPC (test)
89.46AccuracyHiddenKey
Evaluation results
| Method | Links | |
|---|---|---|
| HiddenKeyBackbone=LLaMA2-7B, Evaluation Protocol=Finetuned2024.02 | 89.46 | |
| baselineBackbone=LLaMA2-7B, Evaluation Protocol=Finetuned2024.02 | 88.73 | |
| LoRAModel=RoBERTa-Large [42], Adapter rank=162026.06 | 88.46 | |
| LoRAModel=DeBERTa v3 Base [23], Adapter rank=162026.06 | 88.33 | |
| LoRAModel=DeBERTa v2 XXL [24], Adapter rank=162026.06 | 88.28 | |
| cLAModel=RoBERTa-Large [42], Adapter rank=162026.06 | 87.81 | |
| FFTModel=RoBERTa-Large [42]2026.06 | 87.57 | |
| FFTModel=DeBERTa v2 XXL [24]2026.06 | 87.49 | |
| FFTModel=RoBERTa-Base [42]2026.06 | 87.4 | |
| LoRAModel=RoBERTa-Base [42], Adapter rank=162026.06 | 86.34 | |
| cLAModel=DeBERTa v2 XXL [24], Adapter rank=162026.06 | 86.13 | |
| FFTModel=DeBERTa v3 Base [23]2026.06 | 85.8 | |
| cLAModel=RoBERTa-Base [42], Adapter rank=162026.06 | 84.83 | |
| cLAModel=DeBERTa v3 Base [23], Adapter rank=162026.06 | 84.43 |