Question Answering on TeleData
54.1UtilitySafeMERGE
Evaluation Results
| Method | Links | |
|---|---|---|
| SafeMERGEModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 54.1 | |
| Fine-tunedModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 53.8 | |
| SafeInstructModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 53.5 | |
| SafeLoRAModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 49.8 | |
| Fine-tunedModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 48.8 | |
| SafeMERGEModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 48.8 | |
| SafeInstructModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 48.7 | |
| Fine-tunedModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 47.6 | |
| SafeInstructModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 47.6 | |
| SafeMERGEModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 47.3 | |
| RESTA-InstructModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 46.9 | |
| SafeLoRAModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 46.7 | |
| SafeLoRAModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 46.5 | |
| RESTA-InstructModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 41.9 | |
| RESTAModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 41.2 | |
| OriginalModel=Qwen-2.5-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 39.8 | |
| RESTA-InstructModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 39.5 | |
| Fine-tunedModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 38.7 | |
| SafeInstructModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 38.7 | |
| SafeMERGEModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 38.5 | |
| SafeLoRAModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 37.3 | |
| RESTAModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 36.5 | |
| RESTAModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 34.9 | |
| OriginalModel=Qwen-2-7B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 34.7 | |
| RESTA-InstructModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 32.4 | |
| OriginalModel=Llama-3.1-8B-Instruct, Fine-tuning Dataset=TeleData2025.03 | 31.7 | |
| RESTAModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 30.1 | |
| OriginalModel=Llama-2-7B-Chat, Fine-tuning Dataset=TeleData2025.03 | 29 |