Machine Reading Comprehension on Instruction-following IE Preference (test)
70.95F1 ScoreRainbow Cuckoo
Evaluation results
| Method | Links | |
|---|---|---|
| Rainbow CuckooEvaluation protocol=zero-shot, Transfer setting=In-domain Transfer2025.02 | 70.95 | |
| MRQAEvaluation protocol=zero-shot, Transfer setting=In-domain Transfer2025.02 | 66.83 | |
| CuckooEvaluation protocol=zero-shot, Training configuration=Only Post-train2025.02 | 64.37 | |
| CuckooEvaluation protocol=zero-shot2025.02 | 62.53 | |
| Rainbow CuckooEvaluation protocol=few-shot2025.02 | 60.81 | |
| CuckooEvaluation protocol=zero-shot, Training configuration=Only Pre-train2025.02 | 59.64 | |
| MetaIEEvaluation protocol=zero-shot2025.02 | 56.12 | |
| OPT-C4-TuluV3Evaluation protocol=zero-shot2025.02 | 53.68 | |
| NuNEREvaluation protocol=zero-shot2025.02 | 51.01 | |
| CuckooEvaluation protocol=few-shot2025.02 | 35.56 | |
| MultiNERDEvaluation protocol=zero-shot2025.02 | 30.84 | |
| ROBERTaEvaluation protocol=zero-shot2025.02 | 6.04 |