List your company
ResearchFormerly WizWand

Word Sense Disambiguation on WiC

74.5Avg AccuracyVERA
62.74865.79968.8571.901Dec 2, 2022Jul 2, 2023Jan 30, 2024Aug 29, 2024Mar 29, 2025Oct 27, 2025May 28, 2026
Updated 5mo ago

Evaluation results

MethodLinks
VERAModel=LLaMA3.2 3B, #Param.=1.09 M, rank=1024, Evaluation Protocol=Zero-shot2025.0974.5———
TASOModel=LLaMA3.2 3B, #Param.=1.67 M, Evaluation Protocol=Zero-shot2025.0974.5———
Fine-tuneModel=LLaMA3.2 3B, #Param.=3266.58 M, Evaluation Protocol=Zero-shot2025.0974.21———
DoRAModel=Qwen2.5 3B, #Param.=65.98 M, rank=32, Evaluation Protocol=Zero-shot2025.0974.11———
AdaLoRAModel=LLaMA3.2 3B, #Param.=49.51 M, rank=32, Evaluation Protocol=Zero-shot2025.0973.92———
LoRA-XSModel=Qwen2.5 3B, #Param.=4.13 M, rank=128, Evaluation Protocol=Zero-shot2025.0973.52———
TASOModel=Qwen2.5 3B, #Param.=2.06 M, Evaluation Protocol=Zero-shot2025.0973.33———
AdaLoRAModel=Qwen2.5 3B, #Param.=61.32 M, rank=32, Evaluation Protocol=Zero-shot2025.0973.31———
LoRAModel=Qwen2.5 3B, #Param.=14.97 M, rank=8, Evaluation Protocol=Zero-shot2025.0973.13———
LoRAModel=Qwen2.5 3B, #Param.=59.87 M, rank=32, Evaluation Protocol=Zero-shot2025.0972.94———
LoRA-XSModel=LLaMA3.2 3B, #Param.=3.21 M, rank=128, Evaluation Protocol=Zero-shot2025.0972.94———
IA3Model=Qwen2.5 3B, #Param.=1.35 M, Evaluation Protocol=Zero-shot2025.0972.54———
AdapterModel=LLaMA3.2 3B, #Param.=50.32 M, Evaluation Protocol=Zero-shot2025.0972.54———
Fine-tuneModel=Qwen2.5 3B, #Param.=3151.91 M, Evaluation Protocol=Zero-shot2025.0972.35———
LoRAModel=LLaMA3.2 3B, #Param.=48.63 M, rank=32, Evaluation Protocol=Zero-shot2025.0971.96———
LoRAModel=LLaMA3.2 3B, #Param.=12.16 M, rank=8, Evaluation Protocol=Zero-shot2025.0971.76———
Individual2024.0571.7———
AdapterModel=Qwen2.5 3B, #Param.=67.10 M, Evaluation Protocol=Zero-shot2025.0971.56———
VERAModel=Qwen2.5 3B, #Param.=1.42 M, rank=1024, Evaluation Protocol=Zero-shot2025.0971.56———
IA3Model=LLaMA3.2 3B, #Param.=0.91 M, Evaluation Protocol=Zero-shot2025.0970.98———
DoRAModel=LLaMA3.2 3B, #Param.=53.73 M, rank=32, Evaluation Protocol=Zero-shot2025.0970.58———
ColD-Fusion2022.1268.12———
Multitask2022.1268.06———
ESEBackbone=BERT, Dim=5122026.0467.77———
ESEBackbone=BERT, Dim=7682026.0467.42———
MIPICBackbone=BERT, Dim=7682026.0467.28———
MIPICBackbone=BERT, Dim=5122026.0467.12———
MIPICBackbone=BERT, Dim=2562026.0466.98———
ESEBackbone=BERT, Dim=2562026.0466.92———
PaLM 2-Lprompting=1-shot2023.0566.8———
PaLM-2 Lprotocol=1-shot2023.1166.8———
MIPICBackbone=BERT, Dim=1282026.0466.64———
MUPPET2022.1266.61———
MIPICBackbone=Qwen, Dim=5122026.0466.42———
MRLBackbone=BERT, Dim=2562026.0466.42———
MIPICBackbone=Qwen, Dim=642026.0466.28———
MIPICBackbone=Qwen, Dim=2562026.0466.21———
ESEBackbone=BERT, Dim=1282026.0466.14———
Falcon-180Bprotocol=1-shot2023.1166.1———
MIPICBackbone=Qwen, Dim=10242026.0466.07———
MRLBackbone=BERT, Dim=7682026.0465.91———
MRLBackbone=BERT, Dim=5122026.0465.85———
MIPICBackbone=Qwen, Dim=1282026.0465.79———
Unsup SimCSEBackbone=BERT, Dim=5122026.0465.78———
Finetune2022.1265.71———
Unsup SimCSEBackbone=BERT, Dim=7682026.0465.71———
MIPICBackbone=BGEM3, Dim=10242026.0465.58———
MRLBackbone=BGEM3, Dim=10242026.0465.38———
MRLBackbone=BERT, Dim=1282026.0465.24———
MIPICBackbone=BGEM3, Dim=5122026.0465.04———
MRLBackbone=Qwen, Dim=2562026.0465———
MICBackbone=BERT, Dimension=2562026.0564.92———
Unsup SimCSEBackbone=BERT, Dimension=2562026.0564.91———
MRLBackbone=BERT, Dimension=2562026.0564.78———
Unsup SimCSEBackbone=BERT, Dimension=7682026.0564.78———
MRLBackbone=BGEM3, Dim=5122026.0464.71———
MIPICBackbone=BGEM3, Dim=2562026.0464.69———
MICBackbone=BERT, Dimension=1282026.0564.65———
MICBackbone=BERT, Dimension=5122026.0564.63———
Unsup SimCSEBackbone=BERT, Dimension=5122026.0564.58———
MRLBackbone=Qwen, Dim=642026.0464.57———
MIPICBackbone=BGEM3, Dim=1282026.0464.57———
MRLBackbone=Qwen, Dim=5122026.0464.57———
MIPICBackbone=BERT, Dim=642026.0464.53———
MIPICBackbone=TinyBERT 6L, Dim=2562026.0464.5———
MRLBackbone=Qwen, Dim=1282026.0464.42———
ESEBackbone=Qwen, Dim=5122026.0464.42———
ESEBackbone=BGEM3, Dim=10242026.0464.42———
MIPICBackbone=TinyBERT 6L, Dim=7682026.0464.37———
MIPICBackbone=Qwen, Dim=322026.0464.35———
ESEBackbone=Qwen, Dim=642026.0464.35———
MICBackbone=BERT, Dimension=7682026.0564.35———
ESEBackbone=BGEM3, Dim=1282026.0464.32———
ESEBackbone=BGEM3, Dim=2562026.0464.28———
MRLBackbone=BERT, Dim=642026.0464.28———
MRLBackbone=BGEM3, Dim=2562026.0464.21———
ESEBackbone=BGEM3, Dim=5122026.0464.21———
MRLBackbone=BERT, Dimension=7682026.0564.21———
ESEBackbone=Qwen, Dim=1282026.0464.14———
ESEBackbone=Qwen, Dim=10242026.0464.14———
MRLBackbone=BERT, Dimension=5122026.0564.14———
FO-LoRAModel=OPT-1.3b, Optimizer=Adam2026.0464.1———
ESEBackbone=Qwen, Dim=2562026.0464.07———
MIPICBackbone=TinyBERT 6L, Dim=5122026.0464.01———
MRLBackbone=BERT, Dimension=1282026.0563.93———
MIPICBackbone=BGEM3, Dim=642026.0463.91———
MRLBackbone=BGEM3, Dim=1282026.0463.85———
MRLBackbone=Qwen, Dim=322026.0463.78———
Unsup SimCSEBackbone=BERT, Dimension=1282026.0563.78———
MIPICBackbone=Qwen, Dim=162026.0463.71———
MRLBackbone=TinyBERT 6L, Dim=2562026.0463.71———
MICBackbone=BERT, Dimension=642026.0563.71———
ESEBackbone=Qwen, Dim=322026.0463.64———
ESEBackbone=BERT, Dim=642026.0463.57———
MIPICBackbone=TinyBERT 6L, Dim=1282026.0463.5———
MRLBackbone=Qwen, Dim=10242026.0463.28———
MIPICBackbone=BERT, Dim=322026.0463.28———
Unsup SimCSEBackbone=TinyBERT 6L, Dim=7682026.0463.21———
PaLMprompting=1-shot2023.0563.2———
PaLMprotocol=1-shot2023.1163.2———