Question Answering on NQ-Open (test)
25.61Mean F1 ScoreBayesian Filtering Transformer
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| Bayesian Filtering Transformerdistractor count k=52026.05 | 25.61 | 4.16 | 10.3 | 0.073 | |
| SFTdistractor count k=52026.05 | 23.21 | 4.09 | — | — | |
| Bayesian Filtering Transformerdistractor count k=102026.05 | 16.24 | 2.31 | 7.5 | 0.142 | |
| SFTdistractor count k=102026.05 | 15.11 | 2.64 | — | — | |
| Bayesian Filtering Transformerdistractor count k=Pool (n=80)2026.05 | 14.78 | 7.57 | 7.8 | 0.013 | |
| SFTdistractor count k=Pool (n=80)2026.05 | 13.72 | 6.74 | — | — | |
| Bayesian Filtering Transformerdistractor count k=152026.05 | 9.8 | 2.17 | 4.3 | 0.53 | |
| SFTdistractor count k=152026.05 | 9.39 | 1.47 | — | — | |
| Bayesian Filtering Transformerdistractor count k=202026.05 | 7.48 | 1.65 | 4.5 | 0.478 | |
| SFTdistractor count k=202026.05 | 7.16 | 1.11 | — | — |