MAVEN
Benchmarks
TaskDatasetSOTA resultTrendResults
MAVEN (test)
68.8F1 Score
26
MAVEN
43.75Taxonomy Precision
14
MAVEN 45-way (test)
94.86F1 Score
14
MAVEN (test dev)
92.2Micro-F1 (Session 1)
11
MAVEN-Bench
71Accuracy
8
MAVEN-C
40.91F1 Score
8
MAVEN-T
42.68F1 Score
8
MAVEN-S
54.3F1 Score
8
MAVEN (test dev)
67.8Micro-F1 (Session 1)
8
MAVEN
56.82Macro Precision
7
MAVEN (test)
66.7Precision
7
MAVEN
33.36ROUGE-L
6
MAVEN-ERE
93Hit@10
6
MAVEN 5-shot (test)
54.7F1 Score
6
MAVEN
46.99ARI
5
MAVEN X-shot (test)
64.96Overall Score
5
MAVEN
—Primary metric
0