Factual Probe on T-REx
85P@1 (Total)DEEPSTRUCT
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DEEPSTRUCTmode=zero-shot2022.05 | 85 | — | |
| DEEPSTRUCTmode=multi-task2022.05 | 71 | — | |
| DEEPEXZero-Shot=true2021.09 | 66 | — | |
| LAMA-OracleOracle=true2021.09 | 62.6 | — | |
| Petroni et al., 20202022.05 | 62.6 | — | |
| LAMA-Original2021.09 | 32.3 | — | |
| DEEPSTRUCTevaluation protocol=zero-shot2022.05 | — | 85 | |
| DEEPSTRUCTevaluation protocol=multi-task2022.05 | — | 71 | |
| LAMA2022.05 | — | 32.3 | |
| LAMA-Oracle2022.05 | — | 66 |