# Order Check on ICLEval classification

Source: [Order Check on ICLEval classification](<https://www.sota2.com/research/sota/order-check-on-icleval-classification>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-05-25T08:01:22.398Z

Evaluation of the Order Check task performance on the ICLEval classification dataset, measured using accuracy.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Order Check |
| Dataset (including any stated split) | ICLEval classification |
| Metric | Accuracy |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 12 of 12 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Accuracy](<https://www.sota2.com/research/sota/order-check-on-icleval-classification.md?metric=Accuracy>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Accuracy | Result date | Report paper |
| --- | --- | --- | --- |
| CC | 100 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DC-PMI | 100 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DEmO | 100 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| Self-Improving In-Context Learning | 100 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| CC | 98 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DC-PMI | 98 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DEmO | 98 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| Self-Improving In-Context Learning | 98 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DEmO | 87 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| CC | 79 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| Self-Improving In-Context Learning | 79 | Not recorded | 6a13d7916f71c5ae7dc9e93c |
| DC-PMI | 70 | Not recorded | 6a13d7916f71c5ae7dc9e93c |

### CC

Accuracy: 100. Result ID: 6a1401bcfbc373592c0afbfd.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### DC-PMI

Accuracy: 100. Result ID: 6a1401bcfbc373592c0afbfe.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e031e209131cea3d6a3.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### DEmO

Accuracy: 100. Result ID: 6a1401bcfbc373592c0afbff.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### Self-Improving In-Context Learning

Accuracy: 100. Result ID: 6a1401bcfbc373592c0afc00.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Qwen3-4B"}. This record does not assert independent reproduction.

### CC

Accuracy: 98. Result ID: 6a1401bcfbc373592c0afbf9.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Llama 3.1-8B"}. This record does not assert independent reproduction.

### DC-PMI

Accuracy: 98. Result ID: 6a1401bcfbc373592c0afbfa.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e031e209131cea3d6a3.md>)

Recorded evaluation configuration: {"Model":"Llama 3.1-8B"}. This record does not assert independent reproduction.

### DEmO

Accuracy: 98. Result ID: 6a1401bcfbc373592c0afbfb.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Llama 3.1-8B"}. This record does not assert independent reproduction.

### Self-Improving In-Context Learning

Accuracy: 98. Result ID: 6a1401bcfbc373592c0afbfc.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Llama 3.1-8B"}. This record does not assert independent reproduction.

### DEmO

Accuracy: 87. Result ID: 6a1401bcfbc373592c0afc03.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Gemma 2-2B"}. This record does not assert independent reproduction.

### CC

Accuracy: 79. Result ID: 6a1401bcfbc373592c0afc01.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6a201e209131cea261f0.md>)

Recorded evaluation configuration: {"Model":"Gemma 2-2B"}. This record does not assert independent reproduction.

### Self-Improving In-Context Learning

Accuracy: 79. Result ID: 6a1401bcfbc373592c0afc04.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

Recorded evaluation configuration: {"Model":"Gemma 2-2B"}. This record does not assert independent reproduction.

### DC-PMI

Accuracy: 70. Result ID: 6a1401bcfbc373592c0afc02.

[Reporting paper](<https://www.sota2.com/research/paper/6a13d7916f71c5ae7dc9e93c.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa6e031e209131cea3d6a3.md>)

Recorded evaluation configuration: {"Model":"Gemma 2-2B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
