# Science Question Answering on ARC-Challenge Chinese

Source: [Science Question Answering on ARC-Challenge Chinese](<https://www.sota2.com/research/sota/science-question-answering-on-arc-challenge-chinese>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-02-26T06:03:52.484Z

Evaluation of model performance on the Chinese subset of the ARC Challenge dataset for Science Question Answering, measured by Score.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Science Question Answering |
| Dataset (including any stated split) | ARC-Challenge Chinese |
| Metric | Score |
| Unit | PERCENT |
| Direction | Higher is better |
| Results loaded | 10 of 10 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [Score](<https://www.sota2.com/research/sota/science-question-answering-on-arc-challenge-chinese.md?metric=Score>): Higher is better; unit: PERCENT.

## Recorded results

| Method | Score | Result date | Report paper |
| --- | --- | --- | --- |
| InfLLM v2 | 35.67 | Not recorded | 695de86653fdd5c361743a1a |
| InfLLM v2 | 35.41 | Not recorded | 695de86653fdd5c361743a1a |
| InfLLM v2 | 35.07 | Not recorded | 695de86653fdd5c361743a1a |
| InfLLM v2 | 34.98 | Not recorded | 695de86653fdd5c361743a1a |
| PHSA | 34.39 | Not recorded | 695de86653fdd5c361743a1a |
| Dense | 34.3 | Not recorded | 695de86653fdd5c361743a1a |
| Dense | 34.22 | Not recorded | 695de86653fdd5c361743a1a |
| PHSA | 34.04 | Not recorded | 695de86653fdd5c361743a1a |
| PHSA | 33.02 | Not recorded | 695de86653fdd5c361743a1a |
| PHSA | 32.68 | Not recorded | 695de86653fdd5c361743a1a |

### InfLLM v2

Score: 35.67. Result ID: 6996a1f15698665ec4eb765c.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb81e209131cea8a238.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":"N/A","Training Top-K":2}. This record does not assert independent reproduction.

### InfLLM v2

Score: 35.41. Result ID: 6996a1f15698665ec4eb765d.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb81e209131cea8a238.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":2,"Training Top-K":2}. This record does not assert independent reproduction.

### InfLLM v2

Score: 35.07. Result ID: 6996a1f15698665ec4eb7661.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb81e209131cea8a238.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":4,"Training Top-K":4}. This record does not assert independent reproduction.

### InfLLM v2

Score: 34.98. Result ID: 6996a1f15698665ec4eb7660.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa7bb81e209131cea8a238.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":"N/A","Training Top-K":4}. This record does not assert independent reproduction.

### PHSA

Score: 34.39. Result ID: 6996a1f15698665ec4eb765e.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":"N/A","Training Top-K":4}. This record does not assert independent reproduction.

### Dense

Score: 34.3. Result ID: 6996a1f15698665ec4eb7658.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":"N/A"}. This record does not assert independent reproduction.

### Dense

Score: 34.22. Result ID: 6996a1f15698665ec4eb7659.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa703d1e209131cea49db1.md>)

[Implementation](<https://github.com/tensorflow/tensor2tensor>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":2}. This record does not assert independent reproduction.

### PHSA

Score: 34.04. Result ID: 6996a1f15698665ec4eb765f.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":4,"Training Top-K":4}. This record does not assert independent reproduction.

### PHSA

Score: 33.02. Result ID: 6996a1f15698665ec4eb765a.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":"N/A","Training Top-K":2}. This record does not assert independent reproduction.

### PHSA

Score: 32.68. Result ID: 6996a1f15698665ec4eb765b.

[Reporting paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

[Method origin paper](<https://www.sota2.com/research/paper/695de86653fdd5c361743a1a.md>)

Recorded evaluation configuration: {"Training Tokens":"100B","Inference Top-K":2,"Training Top-K":2}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.
