Amazon ESCI
Benchmarks
TaskDatasetSOTA resultTrendResults
Amazon ESCI Product Description English (test)
92.1Top-k Accuracy
72
Amazon ESCI Product Title English (test)
88.2Top-k Token Accuracy
72
Amazon ESCI
100Sr@10
28
Amazon ESCI
32Precision@1
3
Amazon ESCI (other)
0.074Gap (Constant Approx)
1
Amazon ESCI negations
0.132Gap: Constant Approximation
1
Amazon ESCI parse-pattern
0.064Gap (Constant Approx)
1
Amazon ESCI behavioral
6.7Constant Gap
1
Amazon ESCI nlqec
0.109Gap (Constant Model)
1
Amazon ESCI (all)
0.078Constant Approximation Gap
1