Text Generation on CNN/Daily Mail (test)
83COH ScoreDEL
Evaluation results
| Method | Links | |
|---|---|---|
| DELBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=None2026.02 | 83 | |
| DELBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=None2026.02 | 81.7 | |
| DELBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=Llama2-4bit2026.02 | 80.8 | |
| DELBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=Llama2-4bit2026.02 | 80.4 | |
| DELBackbone=Llama3-8B, ASR=0.20, Local Model Type=None2026.02 | 79.4 | |
| DELBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=None2026.02 | 79 | |
| DELBackbone=Llama3-8B, ASR=0.20, Local Model Type=Llama2-4bit2026.02 | 78.7 | |
| DELBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=Llama2-4bit2026.02 | 78.4 | |
| DELBackbone=Llama3-8B, ASR=0.15, Local Model Type=None2026.02 | 77.1 | |
| DELBackbone=Llama3-8B, ASR=0.15, Local Model Type=Llama2-4bit2026.02 | 76.9 | |
| DELBackbone=Llama3-8B, ASR=0.10, Local Model Type=Llama2-4bit2026.02 | 76 | |
| DELBackbone=Llama3-8B, ASR=0.02, Local Model Type=Llama2-4bit2026.02 | 74.1 | |
| DELBackbone=Llama3-8B, ASR=0.10, Local Model Type=None2026.02 | 74 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=Llama2-4bit2026.02 | 73.4 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=Llama2-4bit2026.02 | 73.1 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=Llama2-4bit2026.02 | 73 | |
| DELBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=Llama2-4bit2026.02 | 72.7 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=Llama2-4bit2026.02 | 71.2 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model Type=Llama2-4bit2026.02 | 70.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model Type=Llama2-4bit2026.02 | 69.8 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model Type=Llama2-4bit2026.02 | 69.3 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model Type=Llama2-4bit2026.02 | 69 | |
| DELBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=OPT-1.3B2026.02 | 67.8 | |
| DELBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=OPT-1.3B2026.02 | 67.3 | |
| DELBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=OPT-1.3B2026.02 | 66.7 | |
| DELBackbone=Llama3-8B, ASR=0.10, Local Model Type=OPT-1.3B2026.02 | 65.9 | |
| DELBackbone=Llama3-8B, ASR=0.15, Local Model Type=OPT-1.3B2026.02 | 65.9 | |
| DELBackbone=Llama3-8B, ASR=0.20, Local Model Type=OPT-1.3B2026.02 | 65.6 | |
| DELBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=None2026.02 | 65.1 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model Type=OPT-1.3B2026.02 | 61.1 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model Type=OPT-1.3B2026.02 | 60.8 | |
| DELBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=OPT-1.3B2026.02 | 60.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model Type=OPT-1.3B2026.02 | 60.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model Type=OPT-1.3B2026.02 | 60.1 | |
| DELBackbone=Llama3-8B, ASR=0.02, Local Model Type=None2026.02 | 60 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=OPT-1.3B2026.02 | 59.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=OPT-1.3B2026.02 | 59.7 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=OPT-1.3B2026.02 | 59 | |
| DELBackbone=Llama3-8B, ASR=0.02, Local Model Type=OPT-1.3B2026.02 | 57.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=OPT-1.3B2026.02 | 57.4 | |
| DELBackbone=Llama3-8B, ASR=0.02, Local Model Type=DialoGPT2026.02 | 52.7 | |
| DELBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=DialoGPT2026.02 | 52.7 | |
| DELBackbone=Llama3-8B, ASR=0.10, Local Model Type=DialoGPT2026.02 | 52.6 | |
| DELBackbone=Llama3-8B, ASR=0.15, Local Model Type=DialoGPT2026.02 | 52.6 | |
| DELBackbone=Llama3-8B, ASR=0.20, Local Model Type=DialoGPT2026.02 | 52.6 | |
| DELBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=DialoGPT2026.02 | 52.6 | |
| DELBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=DialoGPT2026.02 | 52.6 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model Type=DialoGPT2026.02 | 52.5 | |
| DELBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=DialoGPT2026.02 | 52.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model Type=DialoGPT2026.02 | 52.3 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model Type=DialoGPT2026.02 | 52.2 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=DialoGPT2026.02 | 52 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=DialoGPT2026.02 | 51.9 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model Type=DialoGPT2026.02 | 51.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=DialoGPT2026.02 | 51.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=DialoGPT2026.02 | 51.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model Type=None2026.02 | 51.3 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model Type=None2026.02 | 51.1 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model Type=None2026.02 | 50.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model Type=None2026.02 | 50.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model Type=None2026.02 | 50.6 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model Type=None2026.02 | 50.4 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model Type=None2026.02 | 49.7 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model Type=None2026.02 | 49.7 |