# Long-context Question Answering on MuSiQue Fixed Chunk 2048 Source: [Long-context Question Answering on MuSiQue Fixed Chunk 2048]() Collection index: [llms.txt]() Data updated: 2026-03-06T09:56:50.153Z Evaluation of model performance on the specific 'Fixed Chunk 2048' configuration of the MuSiQue dataset for Long-context Question Answering tasks. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Long-context Question Answering | | Dataset (including any stated split) | MuSiQue Fixed Chunk 2048 | | Metric | Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 18 of 18 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Score](): Higher is better; unit: PERCENT. ## Recorded results | Method | Score | Result date | Report paper | | --- | --- | --- | --- | | Baseline | 39.46 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our + Reorder | 37.86 | Not recorded | 69aa5f972d603e6de3e41a04 | | Baseline | 37.18 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our | 36.88 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our | 33.84 | Not recorded | 69aa5f972d603e6de3e41a04 | | Baseline | 32.85 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our | 31.04 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our + Reorder | 30.44 | Not recorded | 69aa5f972d603e6de3e41a04 | | EPIC (15%) | 29.02 | Not recorded | 69aa5f972d603e6de3e41a04 | | Our + Reorder | 28.72 | Not recorded | 69aa5f972d603e6de3e41a04 | | No Recompute | 28.33 | Not recorded | 69aa5f972d603e6de3e41a04 | | CacheBlend | 28.23 | Not recorded | 69aa5f972d603e6de3e41a04 | | EPIC (15%) | 26.38 | Not recorded | 69aa5f972d603e6de3e41a04 | | CacheBlend | 26.24 | Not recorded | 69aa5f972d603e6de3e41a04 | | CacheBlend | 26.11 | Not recorded | 69aa5f972d603e6de3e41a04 | | No Recompute | 25.23 | Not recorded | 69aa5f972d603e6de3e41a04 | | EPIC (15%) | 23.68 | Not recorded | 69aa5f972d603e6de3e41a04 | | No Recompute | 13.42 | Not recorded | 69aa5f972d603e6de3e41a04 | ### Baseline Score: 39.46. Result ID: 69aaa4d76dbb7075b954d37f. [Reporting paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our + Reorder Score: 37.86. Result ID: 69aaa4d76dbb7075b954d382. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Baseline Score: 37.18. Result ID: 69aaa4d76dbb7075b954d373. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our Score: 36.88. Result ID: 69aaa4d76dbb7075b954d381. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our Score: 33.84. Result ID: 69aaa4d76dbb7075b954d375. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Baseline Score: 32.85. Result ID: 69aaa4d76dbb7075b954d379. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our Score: 31.04. Result ID: 69aaa4d76dbb7075b954d37b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our + Reorder Score: 30.44. Result ID: 69aaa4d76dbb7075b954d37c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### EPIC (15%) Score: 29.02. Result ID: 69aaa4d76dbb7075b954d384. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### Our + Reorder Score: 28.72. Result ID: 69aaa4d76dbb7075b954d376. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### No Recompute Score: 28.33. Result ID: 69aaa4d76dbb7075b954d380. [Reporting paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### CacheBlend Score: 28.23. Result ID: 69aaa4d76dbb7075b954d37d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### EPIC (15%) Score: 26.38. Result ID: 69aaa4d76dbb7075b954d37e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### CacheBlend Score: 26.24. Result ID: 69aaa4d76dbb7075b954d383. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"ChatGLM","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### CacheBlend Score: 26.11. Result ID: 69aaa4d76dbb7075b954d377. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### No Recompute Score: 25.23. Result ID: 69aaa4d76dbb7075b954d37a. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### EPIC (15%) Score: 23.68. Result ID: 69aaa4d76dbb7075b954d378. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. ### No Recompute Score: 13.42. Result ID: 69aaa4d76dbb7075b954d374. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen","Setting":"Fixed Chunk (2048)"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.