Word Sense Disambiguation on WiC (Few-Shot Evaluation)
57.1Accuracy (0-shot)OPT-IML 30B
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| OPT-IML 30BScale=30B2022.12 | 57.1 | 52 | |
| OPT 175BScale=175B2022.12 | 56.6 | 54.3 | |
| OPT-IML 175BScale=175B2022.12 | 56.1 | 56.1 | |
| OPT-IML 1.3BScale=1.3B2022.12 | 51.6 | 50.2 | |
| OPT 1.3BScale=1.3B2022.12 | 50.5 | 52.7 | |
| OPT 30BScale=30B2022.12 | 50.2 | 54 |