List your company
ResearchFormerly WizWand

Adversarial Task Switching (ATS) on COMA Evaluation Suite

14DSRIsolated Compression (IC)
-0.563.22710.78Oct 27, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Isolated Compression (IC)Compressor=LLMLingua22025.1014
Isolated Compression (IC)Compressor=LLMLingua2025.1011
Isolated Compression (IC)Compressor=SC2025.109
Isolated Compression (IC)Compressor=Qwen3-4B2025.109
Window-PPL (W-PPL)Compressor=Qwen3-4B2025.106
SecAlignCompressor=SC2025.106
Window-PPL (W-PPL)Compressor=LLMLingua22025.105
SecAlignCompressor=LLMLingua2025.105
Isolated Compression (IC)Compressor=Gemma-3-4B2025.105
PPLCompressor=Qwen3-4B2025.104
SecAlignCompressor=Qwen3-4B2025.104
Window-PPL (W-PPL)Compressor=Gemma-3-4B2025.103
PPLCompressor=Gemma-3-4B2025.102
Window-PPL (W-PPL)Compressor=SC2025.102
Window-PPL (W-PPL)Compressor=Llama-3.2-3B2025.102
StruQCompressor=SC2025.102
StruQCompressor=LLMLingua2025.102
Isolated Compression (IC)Compressor=Llama-3.2-3B2025.102
PPLCompressor=LLMLingua22025.101
SecAlignCompressor=LLMLingua22025.101
SecAlignCompressor=Llama-3.2-3B2025.101
PPLCompressor=SC2025.100
PPLCompressor=LLMLingua2025.100
PPLCompressor=Llama-3.2-3B2025.100
Window-PPL (W-PPL)Compressor=LLMLingua2025.100
StruQCompressor=LLMLingua22025.100
StruQCompressor=Qwen3-4B2025.100
StruQCompressor=Llama-3.2-3B2025.100
StruQCompressor=Gemma-3-4B2025.100
SecAlignCompressor=Gemma-3-4B2025.100