End-to-end generation on ASQA
49.47RecallMMR
Evaluation results
| Method | Links | ||
|---|---|---|---|
| MMRtheta=0.9, k=252026.04 | 49.47 | 22.26 | |
| FWtheta=0.8, k=252026.04 | 48.3 | 21.41 | |
| Top-kk=252026.04 | 48.19 | 20.99 | |
| MMRtheta=0.8, k=252026.04 | 47.95 | 21.73 | |
| MMRtheta=0.8, k=502026.04 | 47.89 | 21.31 | |
| FWtheta=0.9, k=252026.04 | 47.57 | 20.78 | |
| FWtheta=0.8, k=502026.04 | 47.56 | 20.57 | |
| Top-kk=502026.04 | 47.46 | 21.2 | |
| MMRtheta=0.9, k=502026.04 | 47.22 | 21.2 | |
| FWtheta=0.9, k=502026.04 | 47.21 | 20.89 | |
| DPPtheta=0.9, k=252026.04 | 47.07 | 21.52 | |
| DPPtheta=0.9, k=502026.04 | 46.77 | 20.15 | |
| FWtheta=0.7, k=502026.04 | 46.65 | 19.94 | |
| FWtheta=0.7, k=252026.04 | 46.61 | 19.94 | |
| FWtheta=0.6, k=252026.04 | 46.55 | 20.57 | |
| MMRtheta=0.7, k=502026.04 | 45.91 | 18.88 | |
| FWtheta=0.6, k=502026.04 | 45.61 | 20.25 | |
| MMRtheta=0.7, k=252026.04 | 45.07 | 18.67 | |
| DPPtheta=0.8, k=502026.04 | 43.08 | 16.56 | |
| DPPtheta=0.8, k=252026.04 | 42.75 | 17.19 | |
| MMRtheta=0.6, k=502026.04 | 42.39 | 16.14 | |
| MMRtheta=0.6, k=252026.04 | 41.36 | 16.46 | |
| DPPtheta=0.7, k=252026.04 | 38.26 | 14.14 | |
| DPPtheta=0.7, k=502026.04 | 36.92 | 13.19 | |
| DPPtheta=0.6, k=252026.04 | 34.04 | 11.29 | |
| DPPtheta=0.6, k=502026.04 | 33.57 | 10.86 |