Question Answering on SQuAD (Aclean, Aattack, ASR, Time)
54.52Accuracy (Clean)AGLS
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| AGLSModels=gpt-4o-latest2025.05 | 54.52 | 43.49 | 20.23 | 0.63 | |
| AGLSModels=gpt-42025.05 | 51.84 | 32.43 | 37.44 | 0.78 | |
| AGLSModels=llama3.1-70B2025.05 | 47.83 | 27.33 | 42.86 | 1.13 | |
| AGLSModels=gemma2-27B2025.05 | 44.15 | 37.79 | 14.41 | 0.85 | |
| AGLSModels=gemma2-9B2025.05 | 34.11 | 27.42 | 19.61 | 0.45 | |
| AGLSModels=llama3.1-8B2025.05 | 33.78 | 30.43 | 9.92 | 0.56 | |
| AGLSModels=qwen2.5-14B2025.05 | 30.77 | 30.43 | 1.1 | 1.12 | |
| AGLSModels=llama3.2-3B2025.05 | 28.09 | 22.41 | 20.22 | 0.36 | |
| AGLSModels=qwen2.5-7B2025.05 | 20.74 | 19.4 | 6.46 | 0.72 |