# Long Context Evaluation on Long Context benchmark Source: [Long Context Evaluation on Long Context benchmark]() Collection index: [llms.txt]() Data updated: 2026-04-28T07:00:08.062Z Evaluation of model performance on the 'Long Context benchmark' dataset, reporting Accuracy and Memory usage. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Long Context | | Dataset (including any stated split) | Long Context benchmark | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [Memory Usage](): Lower is better; unit: SIZE. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | AdaLoRA | 67.59 | Not recorded | 69f03f0855a3c32af89f9f99 | | LoRA | 67.37 | Not recorded | 69f03f0855a3c32af89f9f99 | | LARS | 67.18 | Not recorded | 69f03f0855a3c32af89f9f99 | | LARS-LP | 63.9 | Not recorded | 69f03f0855a3c32af89f9f99 | | IA3 | 62.02 | Not recorded | 69f03f0855a3c32af89f9f99 | | AdaLoRA | 58.03 | Not recorded | 69f03f0855a3c32af89f9f99 | | LoRA | 57.91 | Not recorded | 69f03f0855a3c32af89f9f99 | | LARS | 57.18 | Not recorded | 69f03f0855a3c32af89f9f99 | | LARS-LP | 54.52 | Not recorded | 69f03f0855a3c32af89f9f99 | | IA3 | 54.13 | Not recorded | 69f03f0855a3c32af89f9f99 | | Prefix | 25.95 | Not recorded | 69f03f0855a3c32af89f9f99 | | Prompt | 25.88 | Not recorded | 69f03f0855a3c32af89f9f99 | | Prefix | 24.62 | Not recorded | 69f03f0855a3c32af89f9f99 | | Prompt | 24.39 | Not recorded | 69f03f0855a3c32af89f9f99 | ### AdaLoRA Accuracy: 67.59. Result ID: 69f05a5547f34ce924d5a60a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.45"}. This record does not assert independent reproduction. ### LoRA Accuracy: 67.37. Result ID: 69f05a5547f34ce924d5a609. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.45"}. This record does not assert independent reproduction. ### LARS Accuracy: 67.18. Result ID: 69f05a5547f34ce924d5a60e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.67"}. This record does not assert independent reproduction. ### LARS-LP Accuracy: 63.9. Result ID: 69f05a5547f34ce924d5a60f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.67"}. This record does not assert independent reproduction. ### IA3 Accuracy: 62.02. Result ID: 69f05a5547f34ce924d5a60b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.01"}. This record does not assert independent reproduction. ### AdaLoRA Accuracy: 58.03. Result ID: 69f05a5547f34ce924d5a603. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.45"}. This record does not assert independent reproduction. ### LoRA Accuracy: 57.91. Result ID: 69f05a5547f34ce924d5a602. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.45"}. This record does not assert independent reproduction. ### LARS Accuracy: 57.18. Result ID: 69f05a5547f34ce924d5a607. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.67"}. This record does not assert independent reproduction. ### LARS-LP Accuracy: 54.52. Result ID: 69f05a5547f34ce924d5a608. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.67"}. This record does not assert independent reproduction. ### IA3 Accuracy: 54.13. Result ID: 69f05a5547f34ce924d5a604. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.01"}. This record does not assert independent reproduction. ### Prefix Accuracy: 25.95. Result ID: 69f05a5547f34ce924d5a60c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.03"}. This record does not assert independent reproduction. ### Prompt Accuracy: 25.88. Result ID: 69f05a5547f34ce924d5a60d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5-7B-Instruct","Trainable Parameters (%)":"0.003"}. This record does not assert independent reproduction. ### Prefix Accuracy: 24.62. Result ID: 69f05a5547f34ce924d5a605. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.03"}. This record does not assert independent reproduction. ### Prompt Accuracy: 24.39. Result ID: 69f05a5547f34ce924d5a606. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama-3.2-1B","Trainable Parameters (%)":"0.003"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.