List your company
ResearchFormerly WizWand

Entity Typing on FindVehicle

98.9PrecisionSFT_Qwen
45.620859.452973.28587.1171Apr 2, 2026
Updated 7mo ago

Evaluation results

MethodLinks
SFT_QwenNote=Task-specific upper bound2026.0498.998.9
HeteroFusionTransfer=Qwen to Llama2026.0486.7186.71
HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.0485.3985.39
HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0484.4784.47
Llama MergeTransfer=Qwen to Llama2026.0483.0282.81
SFT_LlamaNote=Task-specific upper bound2026.0479.4779.47
FuseLLMTransfer=Qwen to Llama2026.0475.3274.72
FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.0474.2173.47
FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0473.1973.09
DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0470.4265.21
DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0470.4164.41
EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0468.5667.21
UniTETransfer=Qwen to Llama2026.0467.4867.11
Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0467.3966.76
BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0466.8466.26
UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0466.7265.71
UniTESource Models=Qwen, Mistral, Target Model=Llama2026.0466.7265.71
BreadcrumbsTransfer=Qwen to Llama2026.0466.6366.01
BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.0466.6366.01
TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.0465.6463.09
GACTransfer=Qwen to Llama2026.0463.9956.98
GACSource Models=Qwen, Mistral, Target Model=Llama2026.0463.9956.98
Task ArithmeticTransfer=Qwen to Llama2026.0459.2258.14
Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.0459.2258.14
EMR-MergingTransfer=Qwen to Llama2026.0458.5857.1
EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0458.5857.1
TIES-MergingTransfer=Qwen to Llama2026.0455.6648.96
TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.0455.6648.96
DELLATransfer=Qwen to Llama2026.0448.3641.41
DELLASource Models=Qwen, Mistral, Target Model=Llama2026.0448.3641.41
DARE (TIES+)Transfer=Qwen to Llama2026.0447.6740.76
DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.0447.6740.76