CaRB
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CaRB (test)
56.8F1 Score
53
CaRB 1-1 one-to-one mapping variant (test)
46.4F1 Score
12
CaRB standard (test)
54F1 Score
12
CaRB-nary English
52.7F1 Score
10
CaRB Manual Subset (100 sentences) (val)
90Precision
6
CaRB Spanish-Clean lexical match (test)
59.5F1 Score
4
CaRB Portuguese lexical match (test)
65.6F1 Score
4
CaRB Spanish lexical match (test)
64.2F1 Score
4