# Evidence Span Extraction on PV Miner Source: [Evidence Span Extraction on PV Miner]() Collection index: [llms.txt]() Data updated: 2026-06-16T09:26:35.210Z Evaluation of Evidence Span Extraction performance on the PV Miner dataset, reporting F1 score and standard deviation. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Evidence Span Extraction | | Dataset (including any stated split) | PV Miner | | Metric | F1 Score | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 32 of 32 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [F1 Score](): Higher is better; unit: PERCENT. - [F1 Standard Deviation](): Lower is better; unit: SCALAR. - [Precision](): Higher is better; unit: PERCENT. - [Recall](): Higher is better; unit: PERCENT. - [Delta F1](): Higher is better; unit: SCALAR. ## Recorded results | Method | F1 Score | Result date | Report paper | | --- | --- | --- | --- | | TAB-PO | 88.89 | Not recorded | 69a66bda2d603e6de3e3cc50 | | SFT | 88.59 | Not recorded | 69a66bda2d603e6de3e3cc50 | | PVminerLLM2 | 88.58 | Not recorded | 6a30d8fbd33dfb23e783d0da | | TAB-PO | 87.94 | Not recorded | 69a66bda2d603e6de3e3cc50 | | PVminerLLM2 | 87.75 | Not recorded | 6a30d8fbd33dfb23e783d0da | | Llama-3.3-70B-Instruct | 87.03 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | PVminerLLM | 87.03 | Not recorded | 6a30d8fbd33dfb23e783d0da | | SFT | 86.94 | Not recorded | 69a66bda2d603e6de3e3cc50 | | Llama-3.1-8B-Instruct | 86.83 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | PVminerLLM | 86.83 | Not recorded | 6a30d8fbd33dfb23e783d0da | | TAB-PO | 86.71 | Not recorded | 69a66bda2d603e6de3e3cc50 | | TAB-PO | 86.09 | Not recorded | 69a66bda2d603e6de3e3cc50 | | PVminerLLM2 | 85.99 | Not recorded | 6a30d8fbd33dfb23e783d0da | | PVminerLLM2 | 85.54 | Not recorded | 6a30d8fbd33dfb23e783d0da | | Llama-3.2-3B-Instruct | 84.81 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | PVminerLLM | 84.81 | Not recorded | 6a30d8fbd33dfb23e783d0da | | Qwen2.5-1.5B-Instruct | 84.8 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | PVminerLLM | 84.8 | Not recorded | 6a30d8fbd33dfb23e783d0da | | SFT | 84.29 | Not recorded | 69a66bda2d603e6de3e3cc50 | | SFT | 83.75 | Not recorded | 69a66bda2d603e6de3e3cc50 | | Llama-3.3-70B-Instruct | 68.62 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.1-8B-Instruct | 67.78 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.3-70B-Instruct | 66.41 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.1-8B-Instruct | 62.96 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.2-3B-Instruct | 56.56 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.3-70B-Instruct | 55.04 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.1-8B-Instruct | 54.15 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Qwen2.5-1.5B-Instruct | 54.05 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.2-3B-Instruct | 48.25 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Qwen2.5-1.5B-Instruct | 36.01 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Llama-3.2-3B-Instruct | 35.29 | Not recorded | 69ae53fb2d603e6de3e42ad7 | | Qwen2.5-1.5B-Instruct | 21.16 | Not recorded | 69ae53fb2d603e6de3e42ad7 | ### TAB-PO F1 Score: 88.89. Result ID: 69a7f1d36dbb7075b94ce07c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### SFT F1 Score: 88.59. Result ID: 69a7f1d36dbb7075b94ce07b. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### PVminerLLM2 F1 Score: 88.58. Result ID: 6a3116b8fbc373592c2db98b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.3-70B"}. This record does not assert independent reproduction. ### TAB-PO F1 Score: 87.94. Result ID: 69a7f1d36dbb7075b94ce07a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.3-70B-Instruct"}. This record does not assert independent reproduction. ### PVminerLLM2 F1 Score: 87.75. Result ID: 6a3116b8fbc373592c2db98d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### Llama-3.3-70B-Instruct F1 Score: 87.03. Result ID: 69ae64aa6dbb7075b955ccdc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"SFT"}. This record does not assert independent reproduction. ### PVminerLLM F1 Score: 87.03. Result ID: 6a3116b8fbc373592c2db98a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.3-70B"}. This record does not assert independent reproduction. ### SFT F1 Score: 86.94. Result ID: 69a7f1d36dbb7075b94ce07d. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3.1-8B-Instruct"}. This record does not assert independent reproduction. ### Llama-3.1-8B-Instruct F1 Score: 86.83. Result ID: 69ae64aa6dbb7075b955cce0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"SFT"}. This record does not assert independent reproduction. ### PVminerLLM F1 Score: 86.83. Result ID: 6a3116b8fbc373592c2db98c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.1-8B"}. This record does not assert independent reproduction. ### TAB-PO F1 Score: 86.71. Result ID: 69a7f1d36dbb7075b94ce07e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.2-3B-Instruct"}. This record does not assert independent reproduction. ### TAB-PO F1 Score: 86.09. Result ID: 69a7f1d36dbb7075b94ce080. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5-1.5B-Instruct"}. This record does not assert independent reproduction. ### PVminerLLM2 F1 Score: 85.99. Result ID: 6a3116b8fbc373592c2db98f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.2-3B"}. This record does not assert independent reproduction. ### PVminerLLM2 F1 Score: 85.54. Result ID: 6a3116b8fbc373592c2db991. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5-1.5B"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct F1 Score: 84.81. Result ID: 69ae64aa6dbb7075b955cce4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"SFT"}. This record does not assert independent reproduction. ### PVminerLLM F1 Score: 84.81. Result ID: 6a3116b8fbc373592c2db98e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Llama-3.2-3B"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct F1 Score: 84.8. Result ID: 69ae64aa6dbb7075b955cce8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"SFT"}. This record does not assert independent reproduction. ### PVminerLLM F1 Score: 84.8. Result ID: 6a3116b8fbc373592c2db990. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Model":"Qwen2.5-1.5B"}. This record does not assert independent reproduction. ### SFT F1 Score: 84.29. Result ID: 69a7f1d36dbb7075b94ce081. [Reporting paper]() Recorded evaluation configuration: {"Model":"Qwen2.5-1.5B-Instruct"}. This record does not assert independent reproduction. ### SFT F1 Score: 83.75. Result ID: 69a7f1d36dbb7075b94ce07f. [Reporting paper]() Recorded evaluation configuration: {"Model":"Llama-3.2-3B-Instruct"}. This record does not assert independent reproduction. ### Llama-3.3-70B-Instruct F1 Score: 68.62. Result ID: 69ae64aa6dbb7075b955ccdb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Two-shot"}. This record does not assert independent reproduction. ### Llama-3.1-8B-Instruct F1 Score: 67.78. Result ID: 69ae64aa6dbb7075b955ccdf. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Two-shot"}. This record does not assert independent reproduction. ### Llama-3.3-70B-Instruct F1 Score: 66.41. Result ID: 69ae64aa6dbb7075b955ccda. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### Llama-3.1-8B-Instruct F1 Score: 62.96. Result ID: 69ae64aa6dbb7075b955ccde. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct F1 Score: 56.56. Result ID: 69ae64aa6dbb7075b955cce3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Two-shot"}. This record does not assert independent reproduction. ### Llama-3.3-70B-Instruct F1 Score: 55.04. Result ID: 69ae64aa6dbb7075b955ccd9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### Llama-3.1-8B-Instruct F1 Score: 54.15. Result ID: 69ae64aa6dbb7075b955ccdd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct F1 Score: 54.05. Result ID: 69ae64aa6dbb7075b955cce7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Two-shot"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct F1 Score: 48.25. Result ID: 69ae64aa6dbb7075b955cce2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct F1 Score: 36.01. Result ID: 69ae64aa6dbb7075b955cce6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"One-shot"}. This record does not assert independent reproduction. ### Llama-3.2-3B-Instruct F1 Score: 35.29. Result ID: 69ae64aa6dbb7075b955cce1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. ### Qwen2.5-1.5B-Instruct F1 Score: 21.16. Result ID: 69ae64aa6dbb7075b955cce5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Evaluation Protocol":"Zero-shot"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.