Entity Typing on FabNER
97.02PrecisionSFT_Qwen
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| SFT_QwenNote=Task-specific upper bound2026.04 | 97.02 | 97.02 | |
| SFT_LlamaNote=Task-specific upper bound2026.04 | 83.82 | 83.83 | |
| HeteroFusionSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 77.51 | 77.5 | |
| HeteroFusionTransfer=Qwen to Llama2026.04 | 77.49 | 77.48 | |
| HeteroFusionTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 75.83 | 75.84 | |
| BreadcrumbsTransfer=Qwen to Llama2026.04 | 65.94 | 63.04 | |
| BreadcrumbsSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 65.94 | 63.04 | |
| FuseLLMSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 65.74 | 65.71 | |
| Llama MergeTransfer=Qwen to Llama2026.04 | 64 | 63.29 | |
| Task ArithmeticTransfer=Qwen to Llama2026.04 | 63.7 | 60.34 | |
| Task ArithmeticSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 63.7 | 60.34 | |
| FuseLLMTransfer=Qwen to Llama2026.04 | 62.5 | 62.22 | |
| DELLATarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 59.71 | 52.93 | |
| DARE (TIES+)Target Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 59.25 | 52.7 | |
| EMR-MergingTransfer=Qwen to Llama2026.04 | 57.63 | 53 | |
| EMR-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 57.63 | 53 | |
| FuseLLMTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 57 | 56.7 | |
| TIES-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 49.34 | 45.33 | |
| EMR-MergingTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 48.03 | 45.05 | |
| Task ArithmeticTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 43.74 | 42.14 | |
| BreadcrumbsTarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 42.72 | 41.42 | |
| GACTransfer=Qwen to Llama2026.04 | 41.12 | 36.59 | |
| GACSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 41.12 | 36.59 | |
| TIES-MergingTransfer=Qwen to Llama2026.04 | 38.08 | 29.36 | |
| TIES-MergingSource Models=Qwen, Mistral, Target Model=Llama2026.04 | 38.08 | 29.36 | |
| DELLATransfer=Qwen to Llama2026.04 | 36.1 | 27.81 | |
| DELLASource Models=Qwen, Mistral, Target Model=Llama2026.04 | 36.1 | 27.81 | |
| DARE (TIES+)Transfer=Qwen to Llama2026.04 | 36.08 | 27.96 | |
| DARE (TIES+)Source Models=Qwen, Mistral, Target Model=Llama2026.04 | 36.08 | 27.96 | |
| UniTETarget Model=Qwen2.5-7B-Instruct, Source Model (this task)=Mistral-7b-v0.32026.04 | 35.08 | 28.22 | |
| UniTESource Models=Qwen, Mistral, Target Model=Llama2026.04 | 35.08 | 28.22 | |
| UniTETransfer=Qwen to Llama2026.04 | 34.64 | 33.42 |