List your company
ResearchFormerly WizWand

Question Answering (Q&A) on COMA Evaluation Suite

10DSRIsolated Compression (IC)
-0.42.357.7Oct 27, 2025
Updated 4mo ago

Evaluation results

MethodLinks
Isolated Compression (IC)Compressor=LLMLingua22025.1010
Isolated Compression (IC)Compressor=LLMLingua2025.108
Window-PPL (W-PPL)Compressor=Qwen3-4B2025.106
Isolated Compression (IC)Compressor=SC2025.106
Window-PPL (W-PPL)Compressor=Gemma-3-4B2025.105
StruQCompressor=SC2025.105
StruQCompressor=LLMLingua2025.105
Isolated Compression (IC)Compressor=Qwen3-4B2025.104
PPLCompressor=LLMLingua22025.103
Window-PPL (W-PPL)Compressor=SC2025.103
Window-PPL (W-PPL)Compressor=Llama-3.2-3B2025.103
SecAlignCompressor=SC2025.103
SecAlignCompressor=Qwen3-4B2025.103
PPLCompressor=SC2025.102
PPLCompressor=LLMLingua2025.102
PPLCompressor=Qwen3-4B2025.102
Window-PPL (W-PPL)Compressor=LLMLingua2025.102
SecAlignCompressor=LLMLingua2025.102
Isolated Compression (IC)Compressor=Llama-3.2-3B2025.102
PPLCompressor=Gemma-3-4B2025.101
StruQCompressor=LLMLingua22025.101
PPLCompressor=Llama-3.2-3B2025.100
Window-PPL (W-PPL)Compressor=LLMLingua22025.100
StruQCompressor=Qwen3-4B2025.100
StruQCompressor=Llama-3.2-3B2025.100
StruQCompressor=Gemma-3-4B2025.100
SecAlignCompressor=LLMLingua22025.100
SecAlignCompressor=Llama-3.2-3B2025.100
SecAlignCompressor=Gemma-3-4B2025.100
Isolated Compression (IC)Compressor=Gemma-3-4B2025.100