CrossTask
Benchmarks
TaskDatasetSOTA resultTrendResults
CrossTask
40.45Success Rate (SR)
43
CrossTask T=4 88 (test)
37.04SR
40
CrossTask T=3 (test)
59.35SR
33
CrossTask (test)
52.5Recall
32
CrossTask
47.3Average Recall
28
CrossTask T=3 88
47.47Success Rate (SR)
27
CrossTask
38.45Success Rate (SR)
22
CrossTask
34.5P-F1
20
CrossTask (test)
28.9Accuracy
18
CrossTask
64.5Accuracy
17
CrossTask T=5
14.2Success Rate
15
CrossTask T=4 (test)
34.09SR
14
CrossTask (test)
55.89R@0.3
13
CrossTask T=3 88 (test)
51.71Success Rate (SR)
13
CrossTask
60.9Precision
13
CrossTask (test)
0.644Accuracy
13
CrossTask T=6 (test)
12.66Success Rate
13
CrossTask T=5 (test)
21.42SR
13
CrossTask
30.2Accuracy
12
CrossTask
97.1Accuracy
12
CrossTask short horizon T=3
37.96SR
11
CrossTask
54MoF
11
CrossTask short horizon T=4
22.56SR
10
CrossTask long horizons T=6
9.27Success Rate (SR)
10
CrossTask
61.4F1 Score
9