# Efficiency Evaluation of Factual Representation Extraction on Corpus of 11,427 facts Source: [Efficiency Evaluation of Factual Representation Extraction on Corpus of 11,427 facts]() Collection index: [llms.txt]() Data updated: 2026-03-23T11:04:17.743Z Evaluation of the computational efficiency (time, speed, memory usage, and compression) required for extracting factual representations from the 'Corpus of 11,427 facts' dataset. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Efficiency evaluation of factual representation extraction | | Dataset (including any stated split) | Corpus of 11,427 facts | | Metric | Total Processing Time (s) | | Unit | TIME | | Direction | Lower is better | | Results loaded | 14 of 14 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Total Processing Time (s)](): Lower is better; unit: TIME. - [Speed-up Factor](): Higher is better; unit: SCALAR. - [Representation Size (Bytes)](): Lower is better; unit: SIZE. - [Compression Ratio](): Higher is better; unit: SCALAR. - [Peak GPU Memory (GB)](): Lower is better; unit: SIZE. - [Reduction Factor](): Higher is better; unit: SCALAR. ## Recorded results | Method | Total Processing Time (s) | Result date | Report paper | | --- | --- | --- | --- | | CLARE | 0.305 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.305 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.305 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.305 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.306 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.307 | Not recorded | 69c0c9020636e5bf4afc3b5a | | CLARE | 0.307 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.763 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.774 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.796 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.833 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.868 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.915 | Not recorded | 69c0c9020636e5bf4afc3b5a | | GradSim | 0.917 | Not recorded | 69c0c9020636e5bf4afc3b5a | ### CLARE Total Processing Time (s): 0.305. Result ID: 69c11e2547f34ce924a96de1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT2-XL"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.305. Result ID: 69c11e2547f34ce924a96de3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.305. Result ID: 69c11e2547f34ce924a96de7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.305. Result ID: 69c11e2547f34ce924a96deb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-J"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.306. Result ID: 69c11e2547f34ce924a96ded. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.307. Result ID: 69c11e2547f34ce924a96de5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2"}. This record does not assert independent reproduction. ### CLARE Total Processing Time (s): 0.307. Result ID: 69c11e2547f34ce924a96de9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.2"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.763. Result ID: 69c11e2547f34ce924a96dea. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT-J"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.774. Result ID: 69c11e2547f34ce924a96de8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3.2"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.796. Result ID: 69c11e2547f34ce924a96de0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"GPT2-XL"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.833. Result ID: 69c11e2547f34ce924a96dec. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Mistral"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.868. Result ID: 69c11e2547f34ce924a96de4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.915. Result ID: 69c11e2547f34ce924a96de2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Qwen2.5"}. This record does not assert independent reproduction. ### GradSim Total Processing Time (s): 0.917. Result ID: 69c11e2547f34ce924a96de6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Backbone":"Llama3"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.