SHADE-Arena
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SHADE-Arena (test)
75.2Accuracy
8
SHADE-Arena
78log-AUROC
8
SHADE-Arena Total
70.6Accuracy
3
SHADE-Arena Charity Allocation
91.4Accuracy
3
SHADE-Arena Performance Reviews
67.3Accuracy
3
SHADE-Arena Expenditure Accounting
87.9Accuracy
3
SHADE-Arena API Key Calendar
88.5Accuracy
3
SHADE-Arena Jira Tickets
72.5Accuracy
3
SHADE-Arena Election Tampering
44.4Accuracy
3
SHADE-Arena Spam Filter
69.5Accuracy
3
SHADE-Arena American Airlines
83Accuracy
3
SHADE-Arena Bank Transfer
85.7Accuracy
3
SHADE-Arena SSN Task
96.3Accuracy
3