# Physical Commonsense Reasoning on PIQA (Mean per-step regret)

Source: [Physical Commonsense Reasoning on PIQA (Mean per-step regret)](<https://www.sota2.com/research/sota/physical-commonsense-reasoning-on-piqa-mean-per-step-regret>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T05:52:13.376Z

Evaluation of model performance on the PIQA dataset for physical commonsense reasoning, specifically measured using the Mean per-step regret metric.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Physical Commonsense Reasoning |
| Dataset (including any stated split) | PIQA |
| Metric | Mean Per-Step Regret |
| Unit | SCALAR |
| Direction | Lower is better |
| Results loaded | 15 of 15 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Mean Per-Step Regret](<https://www.sota2.com/research/sota/physical-commonsense-reasoning-on-piqa-mean-per-step-regret.md?metric=Mean%20Per-Step%20Regret>): Lower is better; unit: SCALAR.

## Recorded results

| Method | Mean Per-Step Regret | Result date | Report paper |
| --- | --- | --- | --- |
| LinFTPL | 0.152 | Not recorded | 699e820b6017c4460ffacf00 |
| Simpl | 0.161 | Not recorded | 699e820b6017c4460ffacf00 |
| No-Rewrite (NoRw) | 0.172 | Not recorded | 699e820b6017c4460ffacf00 |
| LinEXP3 | 0.173 | Not recorded | 699e820b6017c4460ffacf00 |
| Para | 0.174 | Not recorded | 699e820b6017c4460ffacf00 |
| TS | 0.174 | Not recorded | 699e820b6017c4460ffacf00 |
| TS | 0.186 | Not recorded | 699e820b6017c4460ffacf00 |
| ϵ-FTRL | 0.192 | Not recorded | 699e820b6017c4460ffacf00 |
| LinUCB+KL | 0.193 | Not recorded | 699e820b6017c4460ffacf00 |
| LinUCB | 0.197 | Not recorded | 699e820b6017c4460ffacf00 |
| EXP3 | 0.213 | Not recorded | 699e820b6017c4460ffacf00 |
| Clarify | 0.236 | Not recorded | 699e820b6017c4460ffacf00 |
| Disamb | 0.252 | Not recorded | 699e820b6017c4460ffacf00 |
| FTPL | 0.259 | Not recorded | 699e820b6017c4460ffacf00 |
| Expand | 0.34 | Not recorded | 699e820b6017c4460ffacf00 |

### LinFTPL

Mean Per-Step Regret: 0.152. Result ID: 699eaa375698665ec476700d.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Contextual Linear"}. This record does not assert independent reproduction.

### Simpl

Mean Per-Step Regret: 0.161. Result ID: 699eaa375698665ec4767002.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Static Prompts"}. This record does not assert independent reproduction.

### No-Rewrite (NoRw)

Mean Per-Step Regret: 0.172. Result ID: 699eaa375698665ec4767000.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Base"}. This record does not assert independent reproduction.

### LinEXP3

Mean Per-Step Regret: 0.173. Result ID: 699eaa375698665ec476700c.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Contextual Linear"}. This record does not assert independent reproduction.

### Para

Mean Per-Step Regret: 0.174. Result ID: 699eaa375698665ec4767001.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa72ed1e209131cea594c2.md>)

Recorded evaluation configuration: {"Strategy Category":"Static Prompts"}. This record does not assert independent reproduction.

### TS

Mean Per-Step Regret: 0.174. Result ID: 699eaa375698665ec4767009.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Non-Contextual"}. This record does not assert independent reproduction.

### TS

Mean Per-Step Regret: 0.186. Result ID: 699eaa375698665ec476700e.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Contextual Linear"}. This record does not assert independent reproduction.

### ϵ-FTRL

Mean Per-Step Regret: 0.192. Result ID: 699eaa375698665ec4767008.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa62281e209131ce9f7b29.md>)

Recorded evaluation configuration: {"Strategy Category":"Non-Contextual"}. This record does not assert independent reproduction.

### LinUCB+KL

Mean Per-Step Regret: 0.193. Result ID: 699eaa375698665ec476700b.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Contextual Linear"}. This record does not assert independent reproduction.

### LinUCB

Mean Per-Step Regret: 0.197. Result ID: 699eaa375698665ec476700a.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Contextual Linear"}. This record does not assert independent reproduction.

### EXP3

Mean Per-Step Regret: 0.213. Result ID: 699eaa375698665ec4767006.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Non-Contextual"}. This record does not assert independent reproduction.

### Clarify

Mean Per-Step Regret: 0.236. Result ID: 699eaa375698665ec4767004.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Static Prompts"}. This record does not assert independent reproduction.

### Disamb

Mean Per-Step Regret: 0.252. Result ID: 699eaa375698665ec4767003.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa70d51e209131cea4d862.md>)

Recorded evaluation configuration: {"Strategy Category":"Static Prompts"}. This record does not assert independent reproduction.

### FTPL

Mean Per-Step Regret: 0.259. Result ID: 699eaa375698665ec4767007.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Non-Contextual"}. This record does not assert independent reproduction.

### Expand

Mean Per-Step Regret: 0.34. Result ID: 699eaa375698665ec4767005.

[Reporting paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

[Method origin paper](<https://www.sota2.com/research/paper/699e820b6017c4460ffacf00.md>)

Recorded evaluation configuration: {"Strategy Category":"Static Prompts"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
