TRACE
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
TRACE
18.5BWT (%)
135
TRACE LLM-CL
43.82Overall Performance (OP)
33
TRACE
59C-STANCE Accuracy
29
TRACE
90.1ROC-AUC
28
TRACE
76.4AP
28
TRACE
90.1Average Precision
28
TRACE
0.901ROC-AUC
28
TRACE (test)
57.8Overall Performance Score
25
TRACE
58.83AP
24
TRACE (test)
97.2Accuracy
18
TRACE (test)
0.346BLEU-1
17
TRACE (overall)
68.1Accuracy
15
TRACE sequence
55.4GP Score
12
TRACE
63.64C-STANCE Score
11
TRACE-5000
63Overall Performance (OP)
10
TRACE (test)
35.9IoU
10
E3-Trace DARPA
41Precision
10
TRACE Llama2-7B-chat
55.2Average Accuracy
9
TRACE online learning (days 57 to 82)
84.86AUC
9
TRACE manually curated (test)
1,492.56PSNR
8
TRACE Overall (test)
82Accuracy
7
TRACE Hard Neg. (test)
70Accuracy
7
TRACE Easy (test)
93Accuracy
7
TRACE
57.6AA
7
Trace (test)
3.86AUC-PRC
6