Extraction (Sub-code-level) on PV-Miner
84.13PrecisionPVminerLLM2
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PVminerLLM2Model=Llama-3.3-70B2026.06 | 84.13 | 80.34 | 82.19 | 0.35 | 1.45 | |
| PVminerLLMModel=Llama-3.3-70B2026.06 | 83.74 | 77.95 | 80.74 | 2.4 | — | |
| PVminerLLMModel=Llama-3.1-8B2026.06 | 79.19 | 76.33 | 77.73 | 0.53 | — | |
| PVminerLLM2Model=Llama-3.1-8B2026.06 | 79.16 | 79.14 | 79.15 | 0.38 | 1.42 | |
| PVminerLLMModel=Qwen2.5-1.5B2026.06 | 77.86 | 66.88 | 71.96 | 1.75 | — | |
| PVminerLLM2Model=Llama-3.2-3B2026.06 | 77.54 | 75.03 | 76.27 | 0.3 | 1.52 | |
| PVminerLLM2Model=Qwen2.5-1.5B2026.06 | 76.15 | 74.77 | 75.46 | 0.46 | 3.5 | |
| PVminerLLMModel=Llama-3.2-3B2026.06 | 75.8 | 73.74 | 74.75 | 1.75 | — |