Question Answering on ARC-C (acc_norm)
28.92Accuracy (Normalized)AdaGC
Evaluation results
| Method | Links | |
|---|---|---|
| AdaGCBackbone=Llama-2 7B, Zero-Shot=true2025.02 | 28.92 | |
| AGCBackbone=Llama-2 7B, Zero-Shot=true2025.02 | 28.16 | |
| ClippyBackbone=Llama-2 7B, Zero-Shot=true2025.02 | 27.73 | |
| GlobalGCBackbone=Llama-2 7B, Zero-Shot=true2025.02 | 27.56 | |
| ClipByValueBackbone=Llama-2 7B, Zero-Shot=true2025.02 | 26.88 | |
| AdaGCBackbone=Mixtral 8x1B, Zero-Shot=true2025.02 | 26.37 | |
| GlobalGCBackbone=Mixtral 8x1B, Zero-Shot=true2025.02 | 25.94 | |
| GlobalGCBackbone=Llama-2 1.3B, Zero-Shot=true2025.02 | 25.68 | |
| ClipByValueBackbone=Llama-2 1.3B, Zero-Shot=true2025.02 | 25.68 | |
| AdaGCBackbone=Llama-2 1.3B, Zero-Shot=true2025.02 | 25.51 | |
| ClippyBackbone=Llama-2 1.3B, Zero-Shot=true2025.02 | 24.66 |