List your company
ResearchFormerly WizWand

Open-ended Text Generation on PTB

67.7COH ScoreDEL
51.0655.3859.764.02Feb 12, 2026
Updated 8mo ago

Evaluation results

MethodLinks
DELBackbone=Qwen2.5-7B, ASR=0.202026.0267.7
DELBackbone=Llama3-8B, ASR=0.202026.0266.1
DELBackbone=Qwen2.5-7B, ASR=0.152026.0266.1
DELBackbone=Qwen2.5-7B, ASR=0.102026.0265.5
DELBackbone=Llama3-8B, ASR=0.152026.0265
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=Llama2-4bit2026.0264.5
DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=Llama2-4bit2026.0264.2
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=Llama2-4bit2026.0264
DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=Llama2-4bit2026.0263.9
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=Llama2-4bit2026.0263.9
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=Llama2-4bit2026.0263.7
DELBackbone=Llama3-8B, ASR=0.102026.0263.6
DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=Llama2-4bit2026.0263.6
DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=Llama2-4bit2026.0263.6
DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=OPT-1.3B2026.0263.3
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=OPT-1.3B2026.0263
InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=Llama2-4bit2026.0262.9
InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=Llama2-4bit2026.0262.9
InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=Llama2-4bit2026.0262.8
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=OPT-1.3B2026.0262.8
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=OPT-1.3B2026.0262.5
InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=Llama2-4bit2026.0262.4
InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=Llama2-4bit2026.0262.3
DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=OPT-1.3B2026.0262
DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=OPT-1.3B2026.0261.8
InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=Llama2-4bit2026.0261.7
InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=Llama2-4bit2026.0261.7
InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=Llama2-4bit2026.0261.5
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=OPT-1.3B2026.0259.8
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.20, Local Model=DialoGPT2026.0259.3
DEL + Local ModelBackbone=Llama3-8B, ASR=0.10, Local Model=DialoGPT2026.0259.2
DEL + Local ModelBackbone=Llama3-8B, ASR=0.15, Local Model=DialoGPT2026.0259.2
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.10, Local Model=DialoGPT2026.0259.2
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.15, Local Model=DialoGPT2026.0259.2
DEL + Local ModelBackbone=Llama3-8B, ASR=0.20, Local Model=DialoGPT2026.0259.1
DELBackbone=Qwen2.5-7B, ASR=0.022026.0259
DEL + Local ModelBackbone=Qwen2.5-7B, ASR=0.02, Local Model=DialoGPT2026.0258.9
DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=DialoGPT2026.0258.7
InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=DialoGPT2026.0258.5
InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=DialoGPT2026.0258.4
InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=DialoGPT2026.0258.3
InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=DialoGPT2026.0258.1
InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=DialoGPT2026.0257.5
InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=DialoGPT2026.0257.4
InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=DialoGPT2026.0257.1
DELBackbone=Llama3-8B, ASR=0.022026.0257
InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=DialoGPT2026.0257
InferDPTBackbone=Qwen2.5-7B, ASR=0.10, Local Model=OPT-1.3B2026.0256.8
InferDPTBackbone=Llama3-8B, ASR=0.10, Local Model=OPT-1.3B2026.0256.7
InferDPTBackbone=Llama3-8B, ASR=0.15, Local Model=OPT-1.3B2026.0256.6
InferDPTBackbone=Llama3-8B, ASR=0.02, Local Model=OPT-1.3B2026.0256.5
InferDPTBackbone=Qwen2.5-7B, ASR=0.20, Local Model=OPT-1.3B2026.0256.5
InferDPTBackbone=Llama3-8B, ASR=0.20, Local Model=OPT-1.3B2026.0256.1
InferDPTBackbone=Qwen2.5-7B, ASR=0.15, Local Model=OPT-1.3B2026.0256.1
DEL + Local ModelBackbone=Llama3-8B, ASR=0.02, Local Model=OPT-1.3B2026.0255.8
InferDPTBackbone=Qwen2.5-7B, ASR=0.02, Local Model=OPT-1.3B2026.0255.8
RANTEXTBackbone=Llama3-8B, ASR=0.202026.0252.6
RANTEXTBackbone=Qwen2.5-7B, ASR=0.152026.0252.6
RANTEXTBackbone=Qwen2.5-7B, ASR=0.202026.0252.5
RANTEXTBackbone=Llama3-8B, ASR=0.152026.0252.2
RANTEXTBackbone=Qwen2.5-7B, ASR=0.102026.0252.1
RANTEXTBackbone=Llama3-8B, ASR=0.102026.0252
RANTEXTBackbone=Llama3-8B, ASR=0.022026.0251.7
RANTEXTBackbone=Qwen2.5-7B, ASR=0.022026.0251.7