AMEX
Benchmarks
TaskDatasetSOTA resultTrendResults
AMEX
76.2Gmail Accuracy
17
AMEX (test)
77.3Success Rate (Gmail)
12
Amex
67.45Success Rate
8
AMEX
77.57Type Success Rate
7
AMEX (test)
72.61Action Accuracy
4
AMEX (test)
79.19Grounding Score
4
AMEX (test)
79.67OCR Accuracy
4
AMEX (test)
54.53Caption Score
4
AMEX (High)
80.7Action Matching Score (AMS)
3