Agent Tool Selection on Agent Tool Selection (ATS)
98Success Rate (ASR)COMA
Evaluation results
| Method | Links | |
|---|---|---|
| COMACompressor=SC, Compressor Category=Extractive2025.10 | 98 | |
| COMACompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 98 | |
| COMACompressor=LLMLingua, Compressor Category=Extractive2025.10 | 96 | |
| COMACompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 89 | |
| COMACompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 86 | |
| COMACompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 82 | |
| Escape CharactersCompressor=SC, Compressor Category=Extractive2025.10 | 41 | |
| Direct InjectionCompressor=SC, Compressor Category=Extractive2025.10 | 38 | |
| Context IgnoreCompressor=SC, Compressor Category=Extractive2025.10 | 38 | |
| Naive AttackCompressor=SC, Compressor Category=Extractive2025.10 | 36 | |
| Escape CharactersCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 36 | |
| Direct InjectionCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 34 | |
| Context IgnoreCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 34 | |
| Naive AttackCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 31 | |
| Direct InjectionCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 30 | |
| Context IgnoreCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 29 | |
| JudgeDeceiverCompressor=SC, Compressor Category=Extractive2025.10 | 26 | |
| Naive AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 24 | |
| Escape CharactersCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 23 | |
| JudgeDeceiverCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 22 | |
| JudgeDeceiverCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 20 | |
| JudgeDeceiverCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 18 | |
| Context IgnoreCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 18 | |
| JudgeDeceiverCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 16 | |
| JudgeDeceiverCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 16 | |
| Context IgnoreCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 14 | |
| Escape CharactersCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 10 | |
| Direct InjectionCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 9 | |
| Context IgnoreCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 9 | |
| Escape CharactersCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 8 | |
| Direct InjectionCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 7 | |
| Direct InjectionCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 6 | |
| Escape CharactersCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 5 | |
| No AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 4 | |
| Naive AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 4 | |
| Naive AttackCompressor=Llama-3.2-3B, Compressor Category=Abstractive2025.10 | 2 | |
| Naive AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 2 | |
| No AttackCompressor=Gemma-3-4B, Compressor Category=Abstractive2025.10 | 2 | |
| No AttackCompressor=Qwen3-4B, Compressor Category=Abstractive2025.10 | 1 | |
| COMACompressor=None, Compressor Category=None2025.10 | 1 | |
| No AttackCompressor=SC, Compressor Category=Extractive2025.10 | 0 | |
| No AttackCompressor=LLMLingua, Compressor Category=Extractive2025.10 | 0 | |
| No AttackCompressor=LLMLingua2, Compressor Category=Extractive2025.10 | 0 |