Summarization on SummaryBench R&J
100Structural ScoreDirect
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DirectLLM Backend=GPT-5.4 mini2026.05 | 100 | 43.3 | |
| APWALLM Backend=GPT-5.4 mini2026.05 | 95.4 | 42.4 | |
| MegaAgentLLM Backend=GPT-4.1 mini2026.05 | 14 | 4.3 | |
| Direct2026.05 | 1 | 0.433 | |
| APWAConfig=5.4×mini2026.05 | 1 | 0.528 | |
| APWAConfig=mini×mini2026.05 | 0.954 | 0.424 | |
| APWAConfig=mini×nano2026.05 | 0.95 | 0.426 | |
| APWAConfig=5.4×nano2026.05 | 0.943 | 0.439 | |
| MegaAgent2026.05 | 0.14 | 0.043 |