Evidence Span Extraction on PV Miner
88.89F1 ScoreTAB-PO
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| TAB-POModel=Llama-3.1-8B-Instruct2026.02 | 88.89 | 0.9 | — | — | — | |
| SFTModel=Llama-3.3-70B-Instruct2026.02 | 88.59 | 2.32 | — | — | — | |
| PVminerLLM2Model=Llama-3.3-70B2026.06 | 88.58 | 0.37 | 88.94 | 88.22 | 1.55 | |
| TAB-POModel=Llama-3.3-70B-Instruct2026.02 | 87.94 | 3.28 | — | — | — | |
| PVminerLLM2Model=Llama-3.1-8B2026.06 | 87.75 | 0.59 | 86.16 | 89.4 | 0.92 | |
| Llama-3.3-70B-InstructEvaluation Protocol=SFT2026.03 | 87.03 | — | 88.02 | 86.07 | — | |
| PVminerLLMModel=Llama-3.3-70B2026.06 | 87.03 | 1.3 | 88.02 | 86.07 | — | |
| SFTModel=Llama-3.1-8B-Instruct2026.02 | 86.94 | 1.14 | — | — | — | |
| Llama-3.1-8B-InstructEvaluation Protocol=SFT2026.03 | 86.83 | — | 87.29 | 86.37 | — | |
| PVminerLLMModel=Llama-3.1-8B2026.06 | 86.83 | 2.74 | 87.29 | 86.37 | — | |
| TAB-POModel=Llama-3.2-3B-Instruct2026.02 | 86.71 | 2.7 | — | — | — | |
| TAB-POModel=Qwen2.5-1.5B-Instruct2026.02 | 86.09 | 2.68 | — | — | — | |
| PVminerLLM2Model=Llama-3.2-3B2026.06 | 85.99 | 0.45 | 85.73 | 86.25 | 1.18 | |
| PVminerLLM2Model=Qwen2.5-1.5B2026.06 | 85.54 | 0.49 | 84.66 | 86.44 | 0.74 | |
| Llama-3.2-3B-InstructEvaluation Protocol=SFT2026.03 | 84.81 | — | 85.29 | 84.34 | — | |
| PVminerLLMModel=Llama-3.2-3B2026.06 | 84.81 | 0.61 | 85.29 | 84.34 | — | |
| Qwen2.5-1.5B-InstructEvaluation Protocol=SFT2026.03 | 84.8 | — | 83.98 | 85.64 | — | |
| PVminerLLMModel=Qwen2.5-1.5B2026.06 | 84.8 | 0.57 | 83.98 | 85.64 | — | |
| SFTModel=Qwen2.5-1.5B-Instruct2026.02 | 84.29 | 1.08 | — | — | — | |
| SFTModel=Llama-3.2-3B-Instruct2026.02 | 83.75 | 19.25 | — | — | — | |
| Llama-3.3-70B-InstructEvaluation Protocol=Two-shot2026.03 | 68.62 | — | 87.56 | 56.41 | — | |
| Llama-3.1-8B-InstructEvaluation Protocol=Two-shot2026.03 | 67.78 | — | 74.1 | 62.45 | — | |
| Llama-3.3-70B-InstructEvaluation Protocol=One-shot2026.03 | 66.41 | — | 86.69 | 53.82 | — | |
| Llama-3.1-8B-InstructEvaluation Protocol=One-shot2026.03 | 62.96 | — | 78.28 | 52.65 | — | |
| Llama-3.2-3B-InstructEvaluation Protocol=Two-shot2026.03 | 56.56 | — | 62.38 | 51.73 | — | |
| Llama-3.3-70B-InstructEvaluation Protocol=Zero-shot2026.03 | 55.04 | — | 84.74 | 40.75 | — | |
| Llama-3.1-8B-InstructEvaluation Protocol=Zero-shot2026.03 | 54.15 | — | 72.3 | 43.28 | — | |
| Qwen2.5-1.5B-InstructEvaluation Protocol=Two-shot2026.03 | 54.05 | — | 72.31 | 43.16 | — | |
| Llama-3.2-3B-InstructEvaluation Protocol=One-shot2026.03 | 48.25 | — | 58.01 | 41.31 | — | |
| Qwen2.5-1.5B-InstructEvaluation Protocol=One-shot2026.03 | 36.01 | — | 73.95 | 23.8 | — | |
| Llama-3.2-3B-InstructEvaluation Protocol=Zero-shot2026.03 | 35.29 | — | 43.18 | 29.84 | — | |
| Qwen2.5-1.5B-InstructEvaluation Protocol=Zero-shot2026.03 | 21.16 | — | 70.38 | 12.45 | — |