# Knowledge Elicitation on KAssess Source: [Knowledge Elicitation on KAssess]() Collection index: [llms.txt]() Data updated: 2026-02-26T06:05:02.410Z Evaluation of model performance on the KAssess dataset for Knowledge Elicitation tasks, measured by success rate. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Knowledge Elicitation | | Dataset (including any stated split) | KAssess | | Metric | Success Rate | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 28 of 28 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Success Rate](): Higher is better; unit: SCALAR. ## Recorded results | Method | Success Rate | Result date | Report paper | | --- | --- | --- | --- | | PGDC | 0.6984 | Not recorded | 68fa73681e209131cea5c4b3 | | PGDC | 0.5763 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.5366 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.5115 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.5075 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.5 | Not recorded | 68fa73681e209131cea5c4b3 | | PGDC | 0.4862 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.4023 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.382 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.382 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.3337 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.3203 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.2473 | Not recorded | 68fa73681e209131cea5c4b3 | | PGDC | 0.2471 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.2369 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.2321 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.2047 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.1595 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.1575 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.1366 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.1267 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.1144 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.099 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.0673 | Not recorded | 68fa73681e209131cea5c4b3 | | Zero-shot | 0.0403 | Not recorded | 68fa73681e209131cea5c4b3 | | Few-shots | 0.0364 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.0246 | Not recorded | 68fa73681e209131cea5c4b3 | | Discriminator | 0.0226 | Not recorded | 68fa73681e209131cea5c4b3 | ### PGDC Success Rate: 0.6984. Result ID: 6992c8773a6c314849117a8f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)"}. This record does not assert independent reproduction. ### PGDC Success Rate: 0.5763. Result ID: 6992c8773a6c314849117a96. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.5366. Result ID: 6992c8773a6c314849117a94. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.5115. Result ID: 6992c8773a6c314849117a93. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.5075. Result ID: 6992c8773a6c314849117a8d. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.5. Result ID: 6992c8773a6c314849117a8c. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### PGDC Success Rate: 0.4862. Result ID: 6992c8773a6c314849117a9d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.4023. Result ID: 6992c8773a6c314849117a9a. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.382. Result ID: 6992c8773a6c314849117a95. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.382. Result ID: 6992c8773a6c314849117a9b. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.3337. Result ID: 6992c8773a6c314849117a91. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.3203. Result ID: 6992c8773a6c314849117a8a. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.2473. Result ID: 6992c8773a6c314849117a8e. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### PGDC Success Rate: 0.2471. Result ID: 6992c8773a6c314849117aa4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.2369. Result ID: 6992c8773a6c314849117a89. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.2321. Result ID: 6992c8773a6c314849117a90. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.2047. Result ID: 6992c8773a6c314849117a98. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.1595. Result ID: 6992c8773a6c314849117a97. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.1575. Result ID: 6992c8773a6c314849117aa3. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.1366. Result ID: 6992c8773a6c314849117aa1. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.1267. Result ID: 6992c8773a6c314849117a99. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.1144. Result ID: 6992c8773a6c314849117aa2. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.099. Result ID: 6992c8773a6c314849117a92. [Reporting paper]() Recorded evaluation configuration: {"Model":"Vicuna (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.0673. Result ID: 6992c8773a6c314849117a8b. [Reporting paper]() Recorded evaluation configuration: {"Model":"LLaMA2 (7B)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Zero-shot Success Rate: 0.0403. Result ID: 6992c8773a6c314849117a9e. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Few-shots Success Rate: 0.0364. Result ID: 6992c8773a6c314849117a9f. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.0246. Result ID: 6992c8773a6c314849117aa0. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-2 (774M)","Prompt Variant":"standard"}. This record does not assert independent reproduction. ### Discriminator Success Rate: 0.0226. Result ID: 6992c8773a6c314849117a9c. [Reporting paper]() Recorded evaluation configuration: {"Model":"GPT-J (6B)","Prompt Variant":"paraphrased"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.