List your company
ResearchFormerly WizWand

Entity Typing on FabNER

97.02PrecisionSFT_Qwen
32.144848.987465.8382.6726Apr 2, 2026
Updated 7mo ago

Evaluation results

MethodLinks
SFT_QwenNote=Task-specific upper bound2026.0497.0297.02
SFT_LlamaNote=Task-specific upper bound2026.0483.8283.83
HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.0477.5177.5
HeteroFusionTransfer=Qwen to Llama2026.0477.4977.48
HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0475.8375.84
BreadcrumbsTransfer=Qwen to Llama2026.0465.9463.04
BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.0465.9463.04
FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.0465.7465.71
Llama MergeTransfer=Qwen to Llama2026.046463.29
Task ArithmeticTransfer=Qwen to Llama2026.0463.760.34
Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.0463.760.34
FuseLLMTransfer=Qwen to Llama2026.0462.562.22
DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0459.7152.93
DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0459.2552.7
EMR-MergingTransfer=Qwen to Llama2026.0457.6353
EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0457.6353
FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.045756.7
TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0449.3445.33
EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0448.0345.05
Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0443.7442.14
BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0442.7241.42
GACTransfer=Qwen to Llama2026.0441.1236.59
GACSource Models=Qwen, Mistral, Target Model=Llama2026.0441.1236.59
TIES-MergingTransfer=Qwen to Llama2026.0438.0829.36
TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0438.0829.36
DELLATransfer=Qwen to Llama2026.0436.127.81
DELLASource Models=Qwen, Mistral, Target Model=Llama2026.0436.127.81
DARE (TIES+)Transfer=Qwen to Llama2026.0436.0827.96
DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.0436.0827.96
UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0435.0828.22
UniTESource Models=Qwen, Mistral, Target Model=Llama2026.0435.0828.22
UniTETransfer=Qwen to Llama2026.0434.6433.42