List your company
ResearchFormerly WizWand

Question Answering on Question Answering (ASR)

80ASR AccuracyCOMA
-3.218.44061.6Oct 27, 2025
Updated 4mo ago

Evaluation results

MethodLinks
COMACompressor=SC, Compressor Category=Extractive2025.1080
COMACompressor=LLMLingua2, Compressor Category=Extractive2025.1072
COMACompressor=Gemma-3-4B, Compressor Category=Abstractive2025.1071
COMACompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.1069
COMACompressor=LLMLingua, Compressor Category=Extractive2025.1062
COMACompressor=Qwen3-4B, Compressor Category=Abstractive2025.1059
JudgeDeceiverCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.1036
JudgeDeceiverCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.1032
JudgeDeceiverCompressor=Qwen3-4B, Compressor Category=Abstractive2025.1032
Escape CharactersCompressor=SC, Compressor Category=Extractive2025.1024
Context IgnoreCompressor=LLMLingua2, Compressor Category=Extractive2025.1024
Direct InjectionCompressor=SC, Compressor Category=Extractive2025.1022
Context IgnoreCompressor=SC, Compressor Category=Extractive2025.1021
Naive AttackCompressor=SC, Compressor Category=Extractive2025.1019
Escape CharactersCompressor=LLMLingua, Compressor Category=Extractive2025.1019
Context IgnoreCompressor=LLMLingua, Compressor Category=Extractive2025.1018
Escape CharactersCompressor=LLMLingua2, Compressor Category=Extractive2025.1018
JudgeDeceiverCompressor=SC, Compressor Category=Extractive2025.1017
Direct InjectionCompressor=LLMLingua, Compressor Category=Extractive2025.1016
Naive AttackCompressor=LLMLingua, Compressor Category=Extractive2025.1015
JudgeDeceiverCompressor=LLMLingua, Compressor Category=Extractive2025.1015
JudgeDeceiverCompressor=LLMLingua2, Compressor Category=Extractive2025.109
Direct InjectionCompressor=LLMLingua2, Compressor Category=Extractive2025.108
Context IgnoreCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.105
Naive AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.104
Context IgnoreCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.104
Context IgnoreCompressor=Qwen3-4B, Compressor Category=Abstractive2025.102
Escape CharactersCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.101
No AttackCompressor=SC, Compressor Category=Extractive2025.100
No AttackCompressor=LLMLingua, Compressor Category=Extractive2025.100
No AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.100
No AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.100
Naive AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.100
Direct InjectionCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.100
Escape CharactersCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.100
No AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.100
Naive AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.100
Direct InjectionCompressor=Qwen3-4B, Compressor Category=Abstractive2025.100
Escape CharactersCompressor=Qwen3-4B, Compressor Category=Abstractive2025.100
No AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.100
Naive AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.100
Direct InjectionCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.100
COMACompressor=None, Compressor Category=None2025.100