Open-ended Question Answering on TREC-DL-NF (S5)
68.61Kendall's Tau (K)MinosEval
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| MinosEvalmanual_classification=true2025.06 | 68.61 | 73.09 | 84.38 | 95.82 | |
| Listwisetype=Naive LLM Evaluation2025.06 | 65.82 | 72.95 | 79.47 | 94.93 | |
| LINKAGEtype=Others2025.06 | 65.58 | 72.29 | 79.36 | 94.89 | |
| MinosEvalmanual_classification=false2025.06 | 65.45 | 69.56 | 82.03 | 95.31 | |
| Pairwisetype=Naive LLM Evaluation2025.06 | 63.21 | 69.93 | 77.5 | 94.4 | |
| Pointwisetype=Naive LLM Evaluation2025.06 | 54.79 | 60.33 | 73.58 | 93.37 | |
| PEDANTStype=LM-based Metrics2025.06 | 48.12 | 53.82 | 74.61 | 93.31 | |
| BEMtype=LM-based Metrics2025.06 | 46.42 | 51.93 | 75.05 | 93.21 | |
| BERTScoretype=LM-based Metrics2025.06 | 44.62 | 50.23 | 71.61 | 93.01 | |
| ROUGE-Ltype=Automatic Metrics2025.06 | 34.56 | 37.61 | 68.3 | 92.07 | |
| BLEUtype=Automatic Metrics2025.06 | 28.11 | 31.4 | 65.42 | 91.39 |