Open-ended Text Generation on PTB
67.7COH ScoreDEL
Evaluation Results
| Method | Links | |
|---|---|---|
| DELBackbone=Qwen2.5-7B, ASR=0.202026.02 | 67.7 | |
| DELBackbone=Llama3-8B, ASR=0.202026.02 | 66.1 | |
| DELBackbone=Qwen2.5-7B, ASR=0.152026.02 | 66.1 | |
| DELBackbone=Qwen2.5-7B, ASR=0.102026.02 | 65.5 | |
| DELBackbone=Llama3-8B, ASR=0.152026.02 | 65 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=Llama2-4bit2026.02 | 64.5 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=Llama2-4bit2026.02 | 64.2 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=Llama2-4bit2026.02 | 64 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=Llama2-4bit2026.02 | 63.9 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=Llama2-4bit2026.02 | 63.9 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=Llama2-4bit2026.02 | 63.7 | |
| DELBackbone=Llama3-8B, ASR=0.102026.02 | 63.6 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=Llama2-4bit2026.02 | 63.6 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=Llama2-4bit2026.02 | 63.6 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=OPT-1.3B2026.02 | 63.3 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=OPT-1.3B2026.02 | 63 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=Llama2-4bit2026.02 | 62.9 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=Llama2-4bit2026.02 | 62.9 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=Llama2-4bit2026.02 | 62.8 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=OPT-1.3B2026.02 | 62.8 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=OPT-1.3B2026.02 | 62.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=Llama2-4bit2026.02 | 62.4 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=Llama2-4bit2026.02 | 62.3 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=OPT-1.3B2026.02 | 62 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=OPT-1.3B2026.02 | 61.8 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=Llama2-4bit2026.02 | 61.7 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=Llama2-4bit2026.02 | 61.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=Llama2-4bit2026.02 | 61.5 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=OPT-1.3B2026.02 | 59.8 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=DialoGPT2026.02 | 59.3 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=DialoGPT2026.02 | 59.2 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=DialoGPT2026.02 | 59.2 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=DialoGPT2026.02 | 59.2 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=DialoGPT2026.02 | 59.2 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=DialoGPT2026.02 | 59.1 | |
| DELBackbone=Qwen2.5-7B, ASR=0.022026.02 | 59 | |
| DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=DialoGPT2026.02 | 58.9 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=DialoGPT2026.02 | 58.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=DialoGPT2026.02 | 58.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=DialoGPT2026.02 | 58.4 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=DialoGPT2026.02 | 58.3 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=DialoGPT2026.02 | 58.1 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=DialoGPT2026.02 | 57.5 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=DialoGPT2026.02 | 57.4 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=DialoGPT2026.02 | 57.1 | |
| DELBackbone=Llama3-8B, ASR=0.022026.02 | 57 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=DialoGPT2026.02 | 57 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=OPT-1.3B2026.02 | 56.8 | |
| InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=OPT-1.3B2026.02 | 56.7 | |
| InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=OPT-1.3B2026.02 | 56.6 | |
| InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=OPT-1.3B2026.02 | 56.5 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=OPT-1.3B2026.02 | 56.5 | |
| InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=OPT-1.3B2026.02 | 56.1 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=OPT-1.3B2026.02 | 56.1 | |
| DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=OPT-1.3B2026.02 | 55.8 | |
| InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=OPT-1.3B2026.02 | 55.8 | |
| RANTEXTBackbone=Llama3-8B, ASR=0.202026.02 | 52.6 | |
| RANTEXTBackbone=Qwen2.5-7B, ASR=0.152026.02 | 52.6 | |
| RANTEXTBackbone=Qwen2.5-7B, ASR=0.202026.02 | 52.5 | |
| RANTEXTBackbone=Llama3-8B, ASR=0.152026.02 | 52.2 | |
| RANTEXTBackbone=Qwen2.5-7B, ASR=0.102026.02 | 52.1 | |
| RANTEXTBackbone=Llama3-8B, ASR=0.102026.02 | 52 | |
| RANTEXTBackbone=Llama3-8B, ASR=0.022026.02 | 51.7 | |
| RANTEXTBackbone=Qwen2.5-7B, ASR=0.022026.02 | 51.7 |