OR-ShARC
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
OR-ShARC (test)
59.3F1 (BLEU-1)
7
OR-ShARC (test)
0.785Micro Aggregation Score
7
OR-ShARC (dev)
65.5F1 (BLEU-1)
7
OR-ShARC (dev)
83.4Micro Avg
7
OR-ShARC (test)
79.8Top-1 Accuracy
4
OR-ShARC (dev)
66.3Top-1 Accuracy
4
OR-ShARC unseen (test)
34.9F1 BLEU-1
3
OR-ShARC (test seen)
83.4F1-BLEU-1
3