Question Answering on BBQ (Accuracy and Token Usage)
99.5AccuracyMultiGA (Llama-4 seed)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MultiGA (Llama-4 seed)Eval Model=Qwen32025.11 | 99.5 | 23,596 | |
| MultiGA (Ensemble GA)Eval Model=Qwen32025.11 | 96.6 | 36,574 | |
| Qwen3Shot count=0-shot2025.11 | 96.1 | 168 | |
| MultiGA (GPT-5 seed)Eval Model=Qwen32025.11 | 96.1 | 15,355 | |
| MultiGA (Gemma-2 seed)Eval Model=Qwen32025.11 | 96.1 | 9,523 | |
| GPT-5Shot count=0-shot2025.11 | 95.1 | 128 | |
| MultiGA (Phi-4-Mini seed)Eval Model=Qwen32025.11 | 92.3 | 33,629 | |
| MultiGA (Ensemble GB)Eval Model=GPT-52025.11 | 87.4 | 37,723 |