# Question Answering on MuSiQue (LM, F1, Acc., Rounds, Time)

Source: [Question Answering on MuSiQue (LM, F1, Acc., Rounds, Time)](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time>)

Collection index: [llms.txt](<https://www.sota2.com/research/llms.txt>)

Data updated: 2026-04-07T09:11:29.374Z

Evaluation of Question Answering performance on the MuSiQue dataset, reporting Language Model (LM) score, F1, Accuracy, interaction Rounds, and processing Time.

A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage.

| Scope | Recorded value |
| --- | --- |
| Task | Question Answering |
| Dataset (including any stated split) | MuSiQue |
| Metric | LM Score |
| Unit | SCALAR |
| Direction | Higher is better |
| Results loaded | 9 of 9 |
| Coverage | All results currently returned for this benchmark |

Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol.

## Metrics

- [LM Score](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time.md?metric=LM%20Score>): Higher is better; unit: SCALAR.

- [F1 Score](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time.md?metric=F1%20Score>): Higher is better; unit: PERCENT.

- [Accuracy](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time.md?metric=Accuracy>): Higher is better; unit: PERCENT.

- [Interaction Rounds](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time.md?metric=Interaction%20Rounds>): Higher is better; unit: SCALAR.

- [Processing Time (s)](<https://www.sota2.com/research/sota/question-answering-on-musique-lm-f1-acc-rounds-time.md?metric=Processing%20Time%20(s)>): Lower is better; unit: TIME.

## Recorded results

| Method | LM Score | Result date | Report paper |
| --- | --- | --- | --- |
| GoldRouter | 29.01 | Not recorded | 68fa76971e209131cea6dfa5 |
| RIRS | 24.5 | Not recorded | 68fa76971e209131cea6dfa5 |
| Chameleon | 24.21 | Not recorded | 68fa76971e209131cea6dfa5 |
| RIRS | 23.81 | Not recorded | 68fa76971e209131cea6dfa5 |
| RouterDC | 23.38 | Not recorded | 68fa76971e209131cea6dfa5 |
| GoldRouter | 23.27 | Not recorded | 68fa76971e209131cea6dfa5 |
| RIRS | 20.16 | Not recorded | 68fa76971e209131cea6dfa5 |
| Chameleon | 15.69 | Not recorded | 68fa76971e209131cea6dfa5 |
| RouterDC | 15.08 | Not recorded | 68fa76971e209131cea6dfa5 |

### GoldRouter

LM Score: 29.01. Result ID: 69d4ca3f47f34ce924bccc9e.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### RIRS

LM Score: 24.5. Result ID: 69d4ca3f47f34ce924bccca6.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

Recorded evaluation configuration: {"Model":"Mixed","Note":"RAG agents use LLaMA-3.1-8B, other modules use Qwen-Plus"}. This record does not assert independent reproduction.

### Chameleon

LM Score: 24.21. Result ID: 69d4ca3f47f34ce924bccca0.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710e1e209131cea4eee8.md>)

[Implementation](<https://chameleon-llm.github.io/>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### RIRS

LM Score: 23.81. Result ID: 69d4ca3f47f34ce924bccca4.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### RouterDC

LM Score: 23.38. Result ID: 69d4ca3f47f34ce924bccca2.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75041e209131cea65450.md>)

[Implementation](<https://github.com/shuhao02/RouterDC>)

Recorded evaluation configuration: {"Model":"Qwen-Plus"}. This record does not assert independent reproduction.

### GoldRouter

LM Score: 23.27. Result ID: 69d4ca3f47f34ce924bccc9f.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### RIRS

LM Score: 20.16. Result ID: 69d4ca3f47f34ce924bccca5.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### Chameleon

LM Score: 15.69. Result ID: 69d4ca3f47f34ce924bccca1.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa710e1e209131cea4eee8.md>)

[Implementation](<https://chameleon-llm.github.io/>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

### RouterDC

LM Score: 15.08. Result ID: 69d4ca3f47f34ce924bccca3.

[Reporting paper](<https://www.sota2.com/research/paper/68fa76971e209131cea6dfa5.md>)

[Method origin paper](<https://www.sota2.com/research/paper/68fa75041e209131cea65450.md>)

[Implementation](<https://github.com/shuhao02/RouterDC>)

Recorded evaluation configuration: {"Model":"LLaMA-3.1-8B"}. This record does not assert independent reproduction.

Page 1 of 1. This is an index page, not the full collection.