Arcane
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
ARCANE In-Scenario The Underdogs, East Lynne (low-popularity unvalidated)
64.7APF
36
ARCANE validated slice 5 novels (Overall)
62.4Overall Score
36
ARCANE validated slice (5 novels) (Out-of-world)
68APF
36
ARCANE validated slice (5 novels) (In-world)
66.2APF
36
ARCANE validated slice (5 novels) (In-Scenario)
69.5APF
36
ARCANE Overall The Underdogs, East Lynne (low-popularity unvalidated)
65.5Overall Score
13
ARCANE Out-of-world The Underdogs, East Lynne (low-popularity unvalidated)
73.5APF
12
ARCANE In-world The Underdogs, East Lynne (low-popularity unvalidated)
72.5APF
12
Arcane (train)
52Accuracy
6