Tool Selection on ScienceQA
99.29P(Use)Vicuna-7B
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Vicuna-7BStatus=Attack (SEEM)2025.04 | 99.29 | 1,812 | |
| Llama-8BStatus=Attack (SEEM)2025.04 | 95.28 | 173 | |
| Llama-3.2-3BStatus=Attack (SEEM)2025.04 | 70.01 | 172 | |
| GPT-3.5Status=Attack (SEEM)2025.04 | 46 | 24 | |
| Qwen-2.5-7BStatus=Attack (SEEM)2025.04 | 42.78 | 65 | |
| Phi-4-14BStatus=Attack (SEEM)2025.04 | 41.16 | 109 | |
| GPT-3.5Status=Origin2025.04 | 37 | — | |
| Llama-8BStatus=Origin2025.04 | 34.91 | — | |
| GPT-4oStatus=Attack (SEEM)2025.04 | 29.88 | 34 | |
| Qwen-2.5-7BStatus=Origin2025.04 | 25.94 | — | |
| Llama-3.2-3BStatus=Origin2025.04 | 25.71 | — | |
| GPT-4oStatus=Origin2025.04 | 22.29 | — | |
| Phi-4-14BStatus=Origin2025.04 | 19.71 | — | |
| Vicuna-7BStatus=Origin2025.04 | 5.19 | — |