CAPYBARA
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
CAPYBARA XRep
0.296METEOR
13
CAPYBARA Dec-Strip
18.2METEOR Score
13
CAPYBARA Dec-Anon
29.5METEOR
13
CAPYBARA (Dec-Full)
43.2METEOR
13
CAPYBARA XRep
16.63EM
13
CAPYBARA Dec-Strip
5.62EM Score
13
CAPYBARA Dec-Anon
17.57Exact Match (EM)
13
CAPYBARA Dec-Full
28.01EM
13
CAPYBARA XRep
33.1ROUGE-L
13
CAPYBARA Dec-Strip
19.8ROUGE-L
13
CAPYBARA Dec-Anon
33.1ROUGE-L
13
CAPYBARA Dec-Full
47.7ROUGE-L
13
Capybara
28.34Win Rate
8
CAPYBARA cross-representation
36.97Performance (Full Mode)
7