Multi-step Reasoning on MuSR
57.36Murder Mystery Scoren=64 (RL)
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| n=64 (RL)n=642026.05 | 57.36 | 45.98 | 38.57 | |
| n=32 (RL)n=322026.05 | 56.94 | 47.08 | 39.07 | |
| Vanilla RL2026.05 | 53.15 | 46.23 | 23.46 | |
| Base Instruct2026.05 | 50.5 | 45.25 | 25.7 |
Loading the SOTA2 catalog…