RAG-Completeness on ASQA (test)
0.54Kendall's TauJury-on-Demand
Evaluation results
| Method | Links | |
|---|---|---|
| Jury-on-DemandJury Strategy=Dynamic2025.12 | 0.54 | |
| Claude 3.7 SONNETJury Strategy=Single Judge2025.12 | 0.42 | |
| Static (Avg-All)Jury Strategy=Static, Aggregation=Average All2025.12 | 0.38 | |
| Static (Avg-TopK)Jury Strategy=Static, Aggregation=Average TopK2025.12 | 0.38 | |
| Static (W-Reg)Jury Strategy=Static, Aggregation=Weighted-Regression2025.12 | 0.36 | |
| Static (W-Tau)Jury Strategy=Static, Aggregation=Weighted-Tau2025.12 | 0.34 |