Semantic Similarity on MRPC (test)
91.3Test AccuracyFFT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| FFTModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 91.3 | 1.019 | |
| RACModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 91.2 | 1.019 | |
| AsymModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 91 | 1.016 | |
| FFTModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.8 | 1.01 | |
| CoLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.8 | 1.014 | |
| c3LAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.5 | 1.01 | |
| D-PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.4 | 1.01 | |
| C-PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.3 | 1.008 | |
| CoLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.1 | 1.003 | |
| AsymModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.1 | 1.002 | |
| cLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90.1 | 1.006 | |
| r-c3LAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 90 | 1.005 | |
| LoRAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.9 | 1 | |
| RACModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.7 | 0.997 | |
| LoRAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.6 | 1 | |
| PaCAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.6 | 1 | |
| r-cLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.5 | 0.996 | |
| r-c3LAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.5 | 0.996 | |
| r-cLAModel=RoBERTa-Large, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.5 | 1 | |
| PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 89.3 | 0.993 | |
| D-PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 88.9 | 0.988 | |
| C-PaCAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 88.8 | 0.987 | |
| cLAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 88.7 | 0.986 | |
| c3LAModel=RoBERTa-Base, Rank (r)=16, Target Modules=Query, Value, Classification Head, Number of seeds=32026.06 | 88.7 | 0.987 |