Word Sense Disambiguation on WiC SuperGLUE (val)
68.55AccuracyMCD
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| MCDBackbone=RoBERTa-base2024.06 | 68.55 | 16.94 | 0.88 | |
| ENSBackbone=RoBERTa-base2024.06 | 65.83 | 28.62 | 1.7 | |
| MAPBackbone=RoBERTa-base2024.06 | 65.46 | 24.26 | 1.14 | |
| MLEBackbone=RoBERTa-base2024.06 | 64.52 | 25.72 | 1.19 | |
| LAPBackbone=RoBERTa-base2024.06 | 64.52 | 11.48 | 0.63 | |
| BLoBBackbone=RoBERTa-base, N=102024.06 | 64.26 | 13.03 | 0.67 | |
| BLoBBackbone=RoBERTa-base, N=52024.06 | 64 | 13.62 | 0.68 | |
| BLoBBackbone=RoBERTa-base, N=02024.06 | 63.17 | 18.93 | 0.76 | |
| BBBBackbone=RoBERTa-base2024.06 | 50.57 | 2.53 | 0.69 |