Document Retrieval on SilverRiM (test)
8.6General PrecisionAchGNN
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| AchGNNfine-tuned=true, aspect-aware=true2026.05 | 8.6 | 63.4 | 41 | 8.4 | 64 | 44.7 | 8.2 | 61.4 | 38.1 | 8.1 | 63.6 | 38.8 | 8.3 | 61.3 | 37.4 | |
| GraphCLfine-tuned=true, aspect-aware=true2026.05 | 8.3 | 61.5 | 39.6 | 7.9 | 62 | 41 | 7.6 | 59.8 | 37.2 | 7.9 | 62 | 38.8 | 8.1 | 59.6 | 37.2 | |
| AchGNN_noMathfine-tuned=true, aspect-aware=true, use_math=false2026.05 | 8.3 | 61.9 | 39.8 | 8.1 | 62.4 | 43.1 | 7.9 | 60 | 37 | 7.8 | 62 | 37.6 | 8 | 59.8 | 36.6 | |
| Qwen3-7B-FTfine-tuned=true, aspect-aware=true2026.05 | 7.5 | 58.3 | 40.9 | 8.2 | 59.3 | 42.5 | 7 | 55.8 | 37.7 | 7.4 | 58.6 | 38.7 | 7.1 | 56.3 | 37.3 | |
| Qwen3-7Bfine-tuned=false, aspect-agnostic=true2026.05 | 7.2 | 56.6 | 39.9 | 7.4 | 57.6 | 41.3 | 6.8 | 54.2 | 36.6 | 7.2 | 56.9 | 38.5 | 6.9 | 54.7 | 37.1 | |
| Memtronfine-tuned=false, aspect-agnostic=true2026.05 | 6.4 | 50.2 | 36.2 | 6.6 | 51.6 | 37.9 | 6 | 47.4 | 33.5 | 6.2 | 48.8 | 34.2 | 6.1 | 47.9 | 33.3 | |
| Approach0fine-tuned=false, aspect-agnostic=true2026.05 | 6.2 | 46 | 32.5 | 6.4 | 47.5 | 34 | 5.8 | 43 | 30 | 6 | 44.5 | 31.5 | 5.5 | 42 | 29.5 | |
| DPRfine-tuned=false, aspect-agnostic=true2026.05 | 6 | 48 | 34 | 6.2 | 49.5 | 35.5 | 5.6 | 45.5 | 31.5 | 5.8 | 47 | 32.5 | 5.7 | 46 | 32 | |
| Qwen2-7Bfine-tuned=false, aspect-agnostic=true2026.05 | 5.7 | 44.2 | 31 | 5.9 | 45.7 | 32.7 | 5.2 | 41.5 | 27.5 | 5.3 | 42 | 28.7 | 5.3 | 41.9 | 28.7 | |
| SciBERT-FTfine-tuned=true, aspect-aware=true2026.05 | 5.5 | 35 | 26.2 | 5.6 | 36.2 | 27.4 | 5.1 | 33.1 | 24.3 | 5 | 32.7 | 24.1 | 5 | 32.9 | 24.2 | |
| Mabowdorfine-tuned=false, aspect-agnostic=true2026.05 | 4.8 | 37 | 25.5 | 5 | 38.5 | 27 | 4.3 | 34 | 23 | 4.2 | 33 | 22.5 | 4.3 | 33.5 | 23.5 | |
| SPECTERfine-tuned=false, aspect-agnostic=true2026.05 | 4.3 | 34.5 | 25.2 | 4.6 | 36.3 | 27 | 3.9 | 31.7 | 22.1 | 3.9 | 31.3 | 21.9 | 3.9 | 31.7 | 22.8 | |
| SciBERTfine-tuned=false, aspect-agnostic=true2026.05 | 0.5 | 4.4 | 3.6 | 0.7 | 5.4 | 4.5 | 0.4 | 3 | 2.4 | 0.2 | 1.8 | 1.5 | 0.4 | 3.3 | 2.6 |