Word Sense Disambiguation on WiC
74.5Avg AccuracyVERA
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| VERAModel=LLaMA3.2 3B, #Param.=1.09 M, rank=1024, Evaluation Protocol=Zero-shot2025.09 | 74.5 | — | — | — | |
| TASOModel=LLaMA3.2 3B, #Param.=1.67 M, Evaluation Protocol=Zero-shot2025.09 | 74.5 | — | — | — | |
| Fine-tuneModel=LLaMA3.2 3B, #Param.=3266.58 M, Evaluation Protocol=Zero-shot2025.09 | 74.21 | — | — | — | |
| DoRAModel=Qwen2.5 3B, #Param.=65.98 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 74.11 | — | — | — | |
| AdaLoRAModel=LLaMA3.2 3B, #Param.=49.51 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 73.92 | — | — | — | |
| LoRA-XSModel=Qwen2.5 3B, #Param.=4.13 M, rank=128, Evaluation Protocol=Zero-shot2025.09 | 73.52 | — | — | — | |
| TASOModel=Qwen2.5 3B, #Param.=2.06 M, Evaluation Protocol=Zero-shot2025.09 | 73.33 | — | — | — | |
| AdaLoRAModel=Qwen2.5 3B, #Param.=61.32 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 73.31 | — | — | — | |
| LoRAModel=Qwen2.5 3B, #Param.=14.97 M, rank=8, Evaluation Protocol=Zero-shot2025.09 | 73.13 | — | — | — | |
| LoRAModel=Qwen2.5 3B, #Param.=59.87 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 72.94 | — | — | — | |
| LoRA-XSModel=LLaMA3.2 3B, #Param.=3.21 M, rank=128, Evaluation Protocol=Zero-shot2025.09 | 72.94 | — | — | — | |
| IA3Model=Qwen2.5 3B, #Param.=1.35 M, Evaluation Protocol=Zero-shot2025.09 | 72.54 | — | — | — | |
| AdapterModel=LLaMA3.2 3B, #Param.=50.32 M, Evaluation Protocol=Zero-shot2025.09 | 72.54 | — | — | — | |
| Fine-tuneModel=Qwen2.5 3B, #Param.=3151.91 M, Evaluation Protocol=Zero-shot2025.09 | 72.35 | — | — | — | |
| LoRAModel=LLaMA3.2 3B, #Param.=48.63 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 71.96 | — | — | — | |
| LoRAModel=LLaMA3.2 3B, #Param.=12.16 M, rank=8, Evaluation Protocol=Zero-shot2025.09 | 71.76 | — | — | — | |
| Individual2024.05 | 71.7 | — | — | — | |
| AdapterModel=Qwen2.5 3B, #Param.=67.10 M, Evaluation Protocol=Zero-shot2025.09 | 71.56 | — | — | — | |
| VERAModel=Qwen2.5 3B, #Param.=1.42 M, rank=1024, Evaluation Protocol=Zero-shot2025.09 | 71.56 | — | — | — | |
| IA3Model=LLaMA3.2 3B, #Param.=0.91 M, Evaluation Protocol=Zero-shot2025.09 | 70.98 | — | — | — | |
| DoRAModel=LLaMA3.2 3B, #Param.=53.73 M, rank=32, Evaluation Protocol=Zero-shot2025.09 | 70.58 | — | — | — | |
| ColD-Fusion2022.12 | 68.12 | — | — | — | |
| Multitask2022.12 | 68.06 | — | — | — | |
| ESEBackbone=BERT, Dim=5122026.04 | 67.77 | — | — | — | |
| ESEBackbone=BERT, Dim=7682026.04 | 67.42 | — | — | — | |
| MIPICBackbone=BERT, Dim=7682026.04 | 67.28 | — | — | — | |
| MIPICBackbone=BERT, Dim=5122026.04 | 67.12 | — | — | — | |
| MIPICBackbone=BERT, Dim=2562026.04 | 66.98 | — | — | — | |
| ESEBackbone=BERT, Dim=2562026.04 | 66.92 | — | — | — | |
| PaLM 2-Lprompting=1-shot2023.05 | 66.8 | — | — | — | |
| PaLM-2 Lprotocol=1-shot2023.11 | 66.8 | — | — | — | |
| MIPICBackbone=BERT, Dim=1282026.04 | 66.64 | — | — | — | |
| MUPPET2022.12 | 66.61 | — | — | — | |
| MIPICBackbone=Qwen, Dim=5122026.04 | 66.42 | — | — | — | |
| MRLBackbone=BERT, Dim=2562026.04 | 66.42 | — | — | — | |
| MIPICBackbone=Qwen, Dim=642026.04 | 66.28 | — | — | — | |
| MIPICBackbone=Qwen, Dim=2562026.04 | 66.21 | — | — | — | |
| ESEBackbone=BERT, Dim=1282026.04 | 66.14 | — | — | — | |
| Falcon-180Bprotocol=1-shot2023.11 | 66.1 | — | — | — | |
| MIPICBackbone=Qwen, Dim=10242026.04 | 66.07 | — | — | — | |
| MRLBackbone=BERT, Dim=7682026.04 | 65.91 | — | — | — | |
| MRLBackbone=BERT, Dim=5122026.04 | 65.85 | — | — | — | |
| MIPICBackbone=Qwen, Dim=1282026.04 | 65.79 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dim=5122026.04 | 65.78 | — | — | — | |
| Finetune2022.12 | 65.71 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dim=7682026.04 | 65.71 | — | — | — | |
| MIPICBackbone=BGEM3, Dim=10242026.04 | 65.58 | — | — | — | |
| MRLBackbone=BGEM3, Dim=10242026.04 | 65.38 | — | — | — | |
| MRLBackbone=BERT, Dim=1282026.04 | 65.24 | — | — | — | |
| MIPICBackbone=BGEM3, Dim=5122026.04 | 65.04 | — | — | — | |
| MRLBackbone=Qwen, Dim=2562026.04 | 65 | — | — | — | |
| MICBackbone=BERT, Dimension=2562026.05 | 64.92 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dimension=2562026.05 | 64.91 | — | — | — | |
| MRLBackbone=BERT, Dimension=2562026.05 | 64.78 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dimension=7682026.05 | 64.78 | — | — | — | |
| MRLBackbone=BGEM3, Dim=5122026.04 | 64.71 | — | — | — | |
| MIPICBackbone=BGEM3, Dim=2562026.04 | 64.69 | — | — | — | |
| MICBackbone=BERT, Dimension=1282026.05 | 64.65 | — | — | — | |
| MICBackbone=BERT, Dimension=5122026.05 | 64.63 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dimension=5122026.05 | 64.58 | — | — | — | |
| MRLBackbone=Qwen, Dim=642026.04 | 64.57 | — | — | — | |
| MIPICBackbone=BGEM3, Dim=1282026.04 | 64.57 | — | — | — | |
| MRLBackbone=Qwen, Dim=5122026.04 | 64.57 | — | — | — | |
| MIPICBackbone=BERT, Dim=642026.04 | 64.53 | — | — | — | |
| MIPICBackbone=TinyBERT 6L, Dim=2562026.04 | 64.5 | — | — | — | |
| MRLBackbone=Qwen, Dim=1282026.04 | 64.42 | — | — | — | |
| ESEBackbone=Qwen, Dim=5122026.04 | 64.42 | — | — | — | |
| ESEBackbone=BGEM3, Dim=10242026.04 | 64.42 | — | — | — | |
| MIPICBackbone=TinyBERT 6L, Dim=7682026.04 | 64.37 | — | — | — | |
| MIPICBackbone=Qwen, Dim=322026.04 | 64.35 | — | — | — | |
| ESEBackbone=Qwen, Dim=642026.04 | 64.35 | — | — | — | |
| MICBackbone=BERT, Dimension=7682026.05 | 64.35 | — | — | — | |
| ESEBackbone=BGEM3, Dim=1282026.04 | 64.32 | — | — | — | |
| ESEBackbone=BGEM3, Dim=2562026.04 | 64.28 | — | — | — | |
| MRLBackbone=BERT, Dim=642026.04 | 64.28 | — | — | — | |
| MRLBackbone=BGEM3, Dim=2562026.04 | 64.21 | — | — | — | |
| ESEBackbone=BGEM3, Dim=5122026.04 | 64.21 | — | — | — | |
| MRLBackbone=BERT, Dimension=7682026.05 | 64.21 | — | — | — | |
| ESEBackbone=Qwen, Dim=1282026.04 | 64.14 | — | — | — | |
| ESEBackbone=Qwen, Dim=10242026.04 | 64.14 | — | — | — | |
| MRLBackbone=BERT, Dimension=5122026.05 | 64.14 | — | — | — | |
| FO-LoRAModel=OPT-1.3b, Optimizer=Adam2026.04 | 64.1 | — | — | — | |
| ESEBackbone=Qwen, Dim=2562026.04 | 64.07 | — | — | — | |
| MIPICBackbone=TinyBERT 6L, Dim=5122026.04 | 64.01 | — | — | — | |
| MRLBackbone=BERT, Dimension=1282026.05 | 63.93 | — | — | — | |
| MIPICBackbone=BGEM3, Dim=642026.04 | 63.91 | — | — | — | |
| MRLBackbone=BGEM3, Dim=1282026.04 | 63.85 | — | — | — | |
| MRLBackbone=Qwen, Dim=322026.04 | 63.78 | — | — | — | |
| Unsup SimCSEBackbone=BERT, Dimension=1282026.05 | 63.78 | — | — | — | |
| MIPICBackbone=Qwen, Dim=162026.04 | 63.71 | — | — | — | |
| MRLBackbone=TinyBERT 6L, Dim=2562026.04 | 63.71 | — | — | — | |
| MICBackbone=BERT, Dimension=642026.05 | 63.71 | — | — | — | |
| ESEBackbone=Qwen, Dim=322026.04 | 63.64 | — | — | — | |
| ESEBackbone=BERT, Dim=642026.04 | 63.57 | — | — | — | |
| MIPICBackbone=TinyBERT 6L, Dim=1282026.04 | 63.5 | — | — | — | |
| MRLBackbone=Qwen, Dim=10242026.04 | 63.28 | — | — | — | |
| MIPICBackbone=BERT, Dim=322026.04 | 63.28 | — | — | — | |
| Unsup SimCSEBackbone=TinyBERT 6L, Dim=7682026.04 | 63.21 | — | — | — | |
| PaLMprompting=1-shot2023.05 | 63.2 | — | — | — | |
| PaLMprotocol=1-shot2023.11 | 63.2 | — | — | — |