Question Answering on PubMedQA M=4 participants (test)
82.32AUCRouteLLM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| RouteLLMBase Model=Aloe, Number of participants=4, Context Usage=with context2026.07 | 82.32 | 87.48 | 7.24 | 87.81 | 3.51 | |
| StackedGenBase Model=Aloe, Number of participants=42026.07 | 81.99 | 87.76 | 7.53 | 88.01 | 3.29 | |
| WALLA IBase Model=Aloe, Number of participants=42026.07 | 81.07 | 87 | 9.76 | 86.97 | 5.19 | |
| WALLA IIBase Model=Aloe, Number of participants=42026.07 | 81.07 | 86.68 | 9.83 | 88.46 | 5.49 | |
| PackLLMBase Model=Aloe, Number of participants=42026.07 | 78.23 | 85.22 | 10.23 | 88.64 | 8.01 | |
| SelfCertaintyBase Model=Aloe, Number of participants=42026.07 | 71.78 | 79.23 | 2.67 | 86.76 | 13.62 | |
| UniformAvgBase Model=Aloe, Number of participants=42026.07 | 70.29 | 71.66 | 2.27 | — | 20.8 | |
| NIRTRouterBase Model=Aloe, Number of participants=4, Context Usage=with context2026.07 | 70.19 | 71.71 | 2.15 | 52.26 | 20.8 | |
| RouteLLMBase Model=Aloe, Number of participants=4, Context Usage=without context2026.07 | 69.49 | 72.01 | 2.43 | 52.07 | 20.64 | |
| RouterDCBase Model=Aloe, Number of participants=4, Context Usage=with context2026.07 | 69.36 | 72.12 | 2.58 | 61.24 | 20.82 |