Question Answering on ARC Challenge (Mean per-step regret)
0.095Mean Per-Step RegretNo-Rewrite (NoRw)
Evaluation results
| Method | Links | |
|---|---|---|
| No-Rewrite (NoRw)Strategy Category=Base2026.02 | 0.095 | |
| SimplStrategy Category=Static Prompts2026.02 | 0.097 | |
| ParaStrategy Category=Static Prompts2026.02 | 0.098 | |
| LinFTPLStrategy Category=Contextual Linear2026.02 | 0.102 | |
| ϵ-FTRLStrategy Category=Non-Contextual2026.02 | 0.106 | |
| LinEXP3Strategy Category=Contextual Linear2026.02 | 0.107 | |
| TSStrategy Category=Non-Contextual2026.02 | 0.109 | |
| ClarifyStrategy Category=Static Prompts2026.02 | 0.111 | |
| LinUCBStrategy Category=Contextual Linear2026.02 | 0.118 | |
| LinUCB+KLStrategy Category=Contextual Linear2026.02 | 0.121 | |
| TSStrategy Category=Contextual Linear2026.02 | 0.121 | |
| EXP3Strategy Category=Non-Contextual2026.02 | 0.123 | |
| DisambStrategy Category=Static Prompts2026.02 | 0.124 | |
| FTPLStrategy Category=Non-Contextual2026.02 | 0.125 | |
| ExpandStrategy Category=Static Prompts2026.02 | 0.18 |