Entity Typing on FindVehicle
98.9PrecisionSFT_Qwen
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SFT_QwenNote=Task-specific upper bound2026.04 | 98.9 | 98.9 | |
| HeteroFusionTransfer=Qwen to Llama2026.04 | 86.71 | 86.71 | |
| HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 85.39 | 85.39 | |
| HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 84.47 | 84.47 | |
| Llama MergeTransfer=Qwen to Llama2026.04 | 83.02 | 82.81 | |
| SFT_LlamaNote=Task-specific upper bound2026.04 | 79.47 | 79.47 | |
| FuseLLMTransfer=Qwen to Llama2026.04 | 75.32 | 74.72 | |
| FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 74.21 | 73.47 | |
| FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 73.19 | 73.09 | |
| DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 70.42 | 65.21 | |
| DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 70.41 | 64.41 | |
| EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 68.56 | 67.21 | |
| UniTETransfer=Qwen to Llama2026.04 | 67.48 | 67.11 | |
| Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 67.39 | 66.76 | |
| BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 66.84 | 66.26 | |
| UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 66.72 | 65.71 | |
| UniTESource Models=Qwen, Mistral, Target Model=Llama2026.04 | 66.72 | 65.71 | |
| BreadcrumbsTransfer=Qwen to Llama2026.04 | 66.63 | 66.01 | |
| BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 66.63 | 66.01 | |
| TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 65.64 | 63.09 | |
| GACTransfer=Qwen to Llama2026.04 | 63.99 | 56.98 | |
| GACSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 63.99 | 56.98 | |
| Task ArithmeticTransfer=Qwen to Llama2026.04 | 59.22 | 58.14 | |
| Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 59.22 | 58.14 | |
| EMR-MergingTransfer=Qwen to Llama2026.04 | 58.58 | 57.1 | |
| EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 58.58 | 57.1 | |
| TIES-MergingTransfer=Qwen to Llama2026.04 | 55.66 | 48.96 | |
| TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 55.66 | 48.96 | |
| DELLATransfer=Qwen to Llama2026.04 | 48.36 | 41.41 | |
| DELLASource Models=Qwen, Mistral, Target Model=Llama2026.04 | 48.36 | 41.41 | |
| DARE (TIES+)Transfer=Qwen to Llama2026.04 | 47.67 | 40.76 | |
| DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.04 | 47.67 | 40.76 |