Forecasting aggregation on BayesX M=12 models
0.93KLDRouteLLM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RouteLLMContextual Information Availability=With context, Model Homogeneity=Gemma22026.07 | 0.93 | 5.27 | 100 | -2.02 | |
| StackedGenContextual Information Availability=With context, Model Homogeneity=Gemma22026.07 | 1.82 | 7.93 | 100 | -1.13 | |
| WALLA IContextual Information Availability=Not Used, Model Homogeneity=Gemma22026.07 | 12.59 | 24.01 | 100 | 9.19 | |
| WALLA IIContextual Information Availability=Not Used, Model Homogeneity=Gemma22026.07 | 13.2 | 24.57 | 100 | 9.74 | |
| NIRTRouterContextual Information Availability=With context, Model Homogeneity=Gemma22026.07 | 45.18 | 38.97 | 25.91 | 29.74 | |
| PackLLMContextual Information Availability=Not Used, Model Homogeneity=Gemma22026.07 | 45.32 | 39.93 | 100 | 30.6 | |
| UniformAvgContextual Information Availability=Not Used, Model Homogeneity=Gemma22026.07 | 48.67 | 40.76 | — | 32.02 | |
| RouteLLMContextual Information Availability=Without context, Model Homogeneity=Gemma22026.07 | 48.68 | 40.76 | 25.91 | 32.01 | |
| RouterDCContextual Information Availability=With context, Model Homogeneity=Gemma22026.07 | 48.96 | 40.73 | 26.15 | 32 | |
| SelfCertaintyContextual Information Availability=Not Used, Model Homogeneity=Gemma22026.07 | 70.8 | 44.59 | 8.33 | 38.93 |