Question Answering (Q&A) on COMA Evaluation Suite
10DSRIsolated Compression (IC)
Evaluation Results
| Method | Links | |
|---|---|---|
| Isolated Compression (IC)Compressor=LLMLingua22025.10 | 10 | |
| Isolated Compression (IC)Compressor=LLMLingua2025.10 | 8 | |
| Window-PPL (W-PPL)Compressor=Qwen3-4B2025.10 | 6 | |
| Isolated Compression (IC)Compressor=SC2025.10 | 6 | |
| Window-PPL (W-PPL)Compressor=Gemma-3-4B2025.10 | 5 | |
| StruQCompressor=SC2025.10 | 5 | |
| StruQCompressor=LLMLingua2025.10 | 5 | |
| Isolated Compression (IC)Compressor=Qwen3-4B2025.10 | 4 | |
| PPLCompressor=LLMLingua22025.10 | 3 | |
| Window-PPL (W-PPL)Compressor=SC2025.10 | 3 | |
| Window-PPL (W-PPL)Compressor=Llama-3.2-3B2025.10 | 3 | |
| SecAlignCompressor=SC2025.10 | 3 | |
| SecAlignCompressor=Qwen3-4B2025.10 | 3 | |
| PPLCompressor=SC2025.10 | 2 | |
| PPLCompressor=LLMLingua2025.10 | 2 | |
| PPLCompressor=Qwen3-4B2025.10 | 2 | |
| Window-PPL (W-PPL)Compressor=LLMLingua2025.10 | 2 | |
| SecAlignCompressor=LLMLingua2025.10 | 2 | |
| Isolated Compression (IC)Compressor=Llama-3.2-3B2025.10 | 2 | |
| PPLCompressor=Gemma-3-4B2025.10 | 1 | |
| StruQCompressor=LLMLingua22025.10 | 1 | |
| PPLCompressor=Llama-3.2-3B2025.10 | 0 | |
| Window-PPL (W-PPL)Compressor=LLMLingua22025.10 | 0 | |
| StruQCompressor=Qwen3-4B2025.10 | 0 | |
| StruQCompressor=Llama-3.2-3B2025.10 | 0 | |
| StruQCompressor=Gemma-3-4B2025.10 | 0 | |
| SecAlignCompressor=LLMLingua22025.10 | 0 | |
| SecAlignCompressor=Llama-3.2-3B2025.10 | 0 | |
| SecAlignCompressor=Gemma-3-4B2025.10 | 0 | |
| Isolated Compression (IC)Compressor=Gemma-3-4B2025.10 | 0 |