Classification on SuperGLUE (CB, BoolQ, WSC, WiC, MultiRC)
96.4CB Accuracybv
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| bvLLM=OPT-6.7B, Params=0.02‰2025.09 | 96.4 | 78.8 | 63.5 | 65.2 | 73.9 | |
| PrefixLLM=OPT-6.7B, Params=0.2‰2025.09 | 89.2 | 72.6 | 59.6 | 54.7 | 58.9 | |
| bvLLM=OPT-1.3B, Params=0.04‰2025.09 | 80.3 | 65.8 | 63.5 | 61.6 | 69 | |
| PrefixLLM=OPT-1.3B, Params=0.4‰2025.09 | 80.3 | 64.3 | 61.5 | 57.6 | 60 | |
| LoRALLM=OPT-6.7B, Params=0.6‰2025.09 | 75 | 79.1 | 63.5 | 50.4 | 74.4 | |
| bqLLM=OPT-1.3B, Params=0.04‰2025.09 | 71.4 | 60.4 | 62.5 | 59.2 | 56.3 | |
| LoRALLM=OPT-1.3B, Params=1.2‰2025.09 | 69.6 | 74.3 | 63.5 | 50 | 73.2 | |
| bqLLM=OPT-6.7B, Params=0.02‰2025.09 | 67.8 | 64.7 | 60.5 | 59.4 | 58.6 | |
| ICLLLM=OPT-6.7B, Params=0‰2025.09 | 57.1 | 68.9 | 50.9 | 53.6 | 50.4 | |
| Zero-ShotLLM=OPT-6.7B, Params=0‰2025.09 | 51.7 | 59.5 | 37.5 | 51.2 | 44.5 | |
| bkLLM=OPT-6.7B, Params=0.02‰2025.09 | 50 | 59.5 | 37.5 | 51.2 | 44.5 | |
| ICLLLM=OPT-1.3B, Params=0‰2025.09 | 48.2 | 58.5 | 47.1 | 50.6 | 46.3 | |
| Zero-ShotLLM=OPT-1.3B, Params=0‰2025.09 | 39.3 | 45.5 | 44.2 | 57.3 | 45.3 | |
| bkLLM=OPT-1.3B, Params=0.04‰2025.09 | 37.5 | 45.3 | 44.2 | 57 | 45.3 |