Multiple Choice Question Answering on SuperGLUE
83COPA Scorebv
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| bvLLM=OPT-6.7B, Params=0.02‰2025.09 | 83 | 77.7 | |
| bqLLM=OPT-6.7B, Params=0.02‰2025.09 | 83 | 76.5 | |
| bkLLM=OPT-6.7B, Params=0.02‰2025.09 | 82 | 76 | |
| LoRALLM=OPT-6.7B, Params=0.6‰2025.09 | 82 | 76.3 | |
| ICLLLM=OPT-6.7B, Params=0‰2025.09 | 82 | 76.8 | |
| Zero-ShotLLM=OPT-6.7B, Params=0‰2025.09 | 82 | 76.1 | |
| PrefixLLM=OPT-6.7B, Params=0.2‰2025.09 | 78 | 76.8 | |
| bvLLM=OPT-1.3B, Params=0.04‰2025.09 | 77 | 71.5 | |
| LoRALLM=OPT-1.3B, Params=1.2‰2025.09 | 76 | 71 | |
| bkLLM=OPT-1.3B, Params=0.04‰2025.09 | 75 | 70.5 | |
| Zero-ShotLLM=OPT-1.3B, Params=0‰2025.09 | 75 | 70.5 | |
| bqLLM=OPT-1.3B, Params=0.04‰2025.09 | 74 | 71.2 | |
| PrefixLLM=OPT-1.3B, Params=0.4‰2025.09 | 69 | 70.5 | |
| ICLLLM=OPT-1.3B, Params=0‰2025.09 | 69 | 70.9 |