Question Retrieval on NQ (Natural Questions) (full)
40.9Retrieval AccuracyBITRANSLATION
Evaluation results
| Method | Links | |
|---|---|---|
| BITRANSLATIONInitialization=Pretrained, Number of Layers=242022.12 | 40.9 | |
| VMSSTInitialization=Pretrained, Number of Layers=242022.12 | 40.8 | |
| VMSST CONTRASTIVEInitialization=Pretrained, Number of Layers=242022.12 | 40.3 | |
| CONTRASTIVEInitialization=Pretrained, Number of Layers=242022.12 | 40.2 | |
| VMSSTInitialization=Random, Number of Layers=242022.12 | 38.3 | |
| BITRANSLATIONInitialization=Random, Number of Layers=242022.12 | 38.2 | |
| BITRANSLATIONInitialization=Random, Number of Layers=62022.12 | 37.4 | |
| VMSSTInitialization=Random, Number of Layers=62022.12 | 37.3 | |
| VMSST CONTRASTIVEInitialization=Random, Number of Layers=242022.12 | 36.9 | |
| CONTRASTIVEInitialization=Random, Number of Layers=62022.12 | 34.1 | |
| VMSST CONTRASTIVEInitialization=Random, Number of Layers=62022.12 | 34.1 | |
| CONTRASTIVEInitialization=Random, Number of Layers=242022.12 | 32.8 |