Document Retrieval on GoldRiM (test)
34.1General PrecisionAchGNN
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AchGNNfine-tuned=true, aspect-aware=true2026.05 | 34.1 | 42.5 | 59.3 | 31.2 | 39.8 | 55.6 | 27.9 | 36.1 | 51.2 | 24.3 | 32.6 | 46.8 | 21.1 | 28.9 | 42.3 | |
| AchGNN_noMathfine-tuned=true, aspect-aware=true, use_math=false2026.05 | 32.4 | 40.3 | 56.6 | 29.6 | 37.9 | 53.3 | 26.6 | 34.5 | 49.1 | 23.2 | 31.1 | 45 | 20.1 | 27.6 | 40.7 | |
| GraphCLfine-tuned=true, aspect-aware=true2026.05 | 27.1 | 35.2 | 47.1 | 23.8 | 31.9 | 43.1 | 20.3 | 28.4 | 39.2 | 17.2 | 25.1 | 35.1 | 14.3 | 21.7 | 30.9 | |
| Qwen3-7B-FTfine-tuned=true, aspect-aware=true2026.05 | 12.2 | 24.5 | 47.5 | 10.2 | 21.2 | 41.5 | 8.2 | 17 | 34.7 | 6.2 | 13.3 | 28.5 | 4.7 | 10.2 | 23.1 | |
| Qwen3-7Bfine-tuned=false, aspect-agnostic=true2026.05 | 10.6 | 21.3 | 41.3 | 8.9 | 18.4 | 36.1 | 7.1 | 14.8 | 30.2 | 5.4 | 11.6 | 24.8 | 4.1 | 8.9 | 20.1 | |
| Memtronfine-tuned=false, aspect-agnostic=true2026.05 | 9.1 | 18.7 | 34.3 | 7.5 | 15.9 | 29.7 | 5.9 | 12.8 | 24.3 | 4.4 | 10.1 | 19.6 | 3.3 | 7.7 | 15.6 | |
| Qwen2-7Bfine-tuned=false, aspect-agnostic=true2026.05 | 7.7 | 15.6 | 39.1 | 6.2 | 13.1 | 33.2 | 4.8 | 10.2 | 27.4 | 3.5 | 7.8 | 22.1 | 2.6 | 5.9 | 17.6 | |
| SciBERT-FTfine-tuned=true, aspect-aware=true2026.05 | 7.5 | 13.3 | 26.1 | 6.1 | 11.2 | 22.8 | 4.7 | 9.1 | 19.3 | 3.5 | 7.2 | 16.1 | 2.6 | 5.4 | 12.9 | |
| Approach0fine-tuned=false, aspect-agnostic=true2026.05 | 5 | 9.8 | 19.1 | 4.3 | 8.5 | 16.3 | 3.5 | 7 | 13.5 | 3 | 6 | 11.8 | 2 | 4.2 | 8.2 | |
| DPRfine-tuned=false, aspect-agnostic=true2026.05 | 3.5 | 7.4 | 12.5 | 3 | 6.5 | 10.8 | 2.4 | 5.2 | 8.9 | 1.8 | 3.9 | 7 | 1.4 | 3.1 | 5.5 | |
| Mabowdorfine-tuned=false, aspect-agnostic=true2026.05 | 3.2 | 6.4 | 10.2 | 2.7 | 5.6 | 8.9 | 2.1 | 4.3 | 7.1 | 1.6 | 3.3 | 5.4 | 1.2 | 2.6 | 4.3 | |
| SPECTERfine-tuned=false, aspect-agnostic=true2026.05 | 2.3 | 5 | 11.1 | 1.7 | 3.8 | 8.3 | 1.2 | 2.9 | 6.1 | 0.8 | 2.1 | 4.4 | 0.6 | 1.6 | 3.1 | |
| SciBERTfine-tuned=false, aspect-agnostic=true2026.05 | 0.7 | 1.6 | 3.5 | 0.5 | 1.2 | 2.6 | 0.4 | 0.9 | 1.9 | 0.3 | 0.7 | 1.4 | 0.2 | 0.5 | 1 |