Question Retrieval on MKQA (full)
29.9Retrieval AccuracyVMSST
Evaluation results
| Method | Links | |
|---|---|---|
| VMSSTInitialization=Pretrained, Number of Layers=242022.12 | 29.9 | |
| BITRANSLATIONInitialization=Pretrained, Number of Layers=242022.12 | 29.6 | |
| VMSST CONTRASTIVEInitialization=Pretrained, Number of Layers=242022.12 | 27.9 | |
| CONTRASTIVEInitialization=Pretrained, Number of Layers=242022.12 | 27.6 | |
| VMSSTInitialization=Random, Number of Layers=242022.12 | 22.3 | |
| BITRANSLATIONInitialization=Random, Number of Layers=242022.12 | 21.6 | |
| VMSSTInitialization=Random, Number of Layers=62022.12 | 20.1 | |
| BITRANSLATIONInitialization=Random, Number of Layers=62022.12 | 19.2 | |
| VMSST CONTRASTIVEInitialization=Random, Number of Layers=242022.12 | 18.9 | |
| VMSST CONTRASTIVEInitialization=Random, Number of Layers=62022.12 | 17.7 | |
| CONTRASTIVEInitialization=Random, Number of Layers=62022.12 | 17.6 | |
| CONTRASTIVEInitialization=Random, Number of Layers=242022.12 | 16 |