Detection of quotation errors on SCIFACT Full
88.19SUP F1Q7B(FT)
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| Q7B(FT)Strategy=Fine-tuned2026.06 | 88.19 | 83 | 88.79 | 86.54 | |
| DV3Strategy=Zero-shot2026.06 | 87.6 | 83.95 | 75.53 | 82.36 | |
| QMaxStrategy=Zero-shot2026.06 | 87.11 | 81.32 | 73.39 | 80.61 | |
| QMaxStrategy=3-shot2026.06 | 86.56 | 80.31 | 77 | 81.29 | |
| DV3Strategy=3-shot2026.06 | 85.56 | 82.33 | 77.33 | 81.74 | |
| DR1Strategy=Zero-shot2026.06 | 83.91 | 80.1 | 69.04 | 77.68 | |
| QPlusStrategy=3-shot2026.06 | 82.53 | 74.41 | 58.73 | 71.89 | |
| QPlusStrategy=Zero-shot2026.06 | 82.19 | 77.29 | 53.28 | 70.92 | |
| Rag(hybird)Strategy=RAG2026.06 | 81.44 | 75.89 | 47.57 | 68.3 | |
| Rag(hyde)Strategy=RAG (HyDE)2026.06 | 79.07 | 73.22 | 43.81 | 65.37 | |
| D-L8BStrategy=Zero-shot2026.06 | 77.35 | 71.87 | 56.2 | 69.4 | |
| DR1Strategy=3-shot2026.06 | 64.93 | 40.58 | 20.47 | 42 | |
| D-L8(FT)Strategy=Fine-tuned2026.06 | 63.02 | 49.8 | 57.29 | 56.7 | |
| Q7BStrategy=Zero-shot2026.06 | 60.98 | 2.81 | 14.6 | 26.13 |