Article Generation on MAGMaR oracle (leaderboard snapshot)
3.833Human Preference ScoreITER-QA-BASE
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| ITER-QA-BASErank=12026.05 | 3.833 | 8 | 14 | 34.7 | 31.3 | 26.8 | 25.8 | |
| ITER-QA-BASE2026.05 | 3.83 | 8 | 14 | 34.7 | 31.3 | 26.8 | 25.8 | |
| ITER-QA-GINGERrank=32026.05 | 3.694 | 5 | 8.8 | 34.5 | 29 | 25.7 | 22.6 | |
| ITER-QA-GINGER2026.05 | 3.69 | 5 | 8.8 | 34.5 | 29 | 25.7 | 22.6 | |
| SS-QA-GINGERrank=42026.05 | 3.421 | 10 | 17.5 | 54.4 | 32.4 | 32.6 | 23.8 | |
| SS-QA-GINGER2026.05 | 3.42 | 10 | 17.5 | 54.4 | 32.4 | 32.6 | 23.8 | |
| MARQUIS-RLM2026.05 | 3.3 | 3 | 5.3 | 70.8 | 38.5 | 59.2 | 27.2 | |
| MARQUIS-RLMrank=52026.05 | 3.298 | 3 | 5.3 | 70.8 | 38.5 | 59.2 | 27.2 | |
| GINGERrank=62026.05 | 3.123 | 6 | 10.5 | 77.6 | 40.4 | 64.3 | 22.6 | |
| GINGER2026.05 | 3.12 | 6 | 10.5 | 77.6 | 40.4 | 64.3 | 22.6 | |
| CAGbaseline=true2026.05 | 3.09 | 1 | 1.8 | 76.4 | 41 | 61.7 | 22.8 | |
| SS-QA-BASErank=82026.05 | 3.07 | 6 | 10.5 | 33.1 | 30.6 | 27.7 | 28.1 | |
| SS QA Base2026.05 | 3.07 | 6 | 10.5 | 33.1 | 30.6 | 27.7 | 28.1 | |
| BULLET2026.05 | 2.67 | 0 | 0 | 71.1 | 39.4 | 60.4 | 23.7 | |
| BULLETrank=102026.05 | 2.667 | 0 | 0 | 71.1 | 39.4 | 60.4 | 23.7 |