Character Probing on ARCANE Overall The Underdogs, East Lynne (low-popularity unvalidated)
65.5Overall ScoreARCANE 32B Arc
Evaluation Results
| Method | Links | |
|---|---|---|
| ARCANE 32B ArcFamily=ARCANE, Size=32B, Mode=Arc2026.06 | 65.5 | |
| DeepSeek-V4 Pro ArcFamily=DeepSeek-V4, Size=Pro, Mode=Arc2026.06 | 61 | |
| DeepSeek-V4 Flash ArcFamily=DeepSeek-V4, Size=Flash, Mode=Arc2026.06 | 59.4 | |
| ARCANE 8B ArcFamily=ARCANE, Size=8B, Mode=Arc2026.06 | 56 | |
| DeepSeek-V4 Flash SummaryFamily=DeepSeek-V4, Size=Flash, Mode=Summary2026.06 | 52.4 | |
| DeepSeek-V4 Flash VanillaFamily=DeepSeek-V4, Size=Flash, Mode=Vanilla2026.06 | 51.5 | |
| DeepSeek-V4 Pro VanillaFamily=DeepSeek-V4, Size=Pro, Mode=Vanilla2026.06 | 49.8 | |
| Qwen3 32B ArcFamily=Qwen3, Size=32B, Mode=Arc2026.06 | 49.5 | |
| ARCANE 32B VanillaFamily=ARCANE, Size=32B, Mode=Vanilla2026.06 | 48.4 | |
| Qwen3 8B ArcFamily=Qwen3, Size=8B, Mode=Arc2026.06 | 41 | |
| ARCANE 8B VanillaFamily=ARCANE, Size=8B, Mode=Vanilla2026.06 | 40 | |
| Qwen3 32B VanillaFamily=Qwen3, Size=32B, Mode=Vanilla2026.06 | 36.3 | |
| Qwen3 8B VanillaFamily=Qwen3, Size=8B, Mode=Vanilla2026.06 | 31.6 |