CoIN-Bench
Benchmarks
TaskDatasetSOTA resultTrendResults
CoIN-Bench Seen Synonyms (val)
21.8SPL
13
CoIN-Bench Unseen (val)
17SR
9
CoIN-Bench Seen Synonyms (val)
28.1SR
9
CoIN-Bench Seen (val)
23.7SR
9
CoIN-Bench Unseen (val)
11.3SR
6
CoIN-Bench Seen Synonyms (val)
20.3Success Rate (SR)
6
CoIN-Bench Seen (val)
13.5SR
6
CoIN-Bench Unseen (val)
854SPL
5
CoIN-Bench Seen (val)
10.93SPL
5