Ideology prediction on Swiss parliamentary dataset DemocraSci KG (test)
0.3MAEPM
Evaluation Results
| Method | Links | ||||
|---|---|---|---|---|---|
| PMType=Naive baseline2026.05 | 0.3 | 0.2 | 0.44 | 97 | |
| PBMType=Naive baseline2026.05 | 0.33 | 0.23 | 0.48 | 97 | |
| PG-RAGEvaluation Setting=few-shot, Subgraph Variant=MP-S2026.05 | 0.58 | 0.58 | 0.76 | 94 | |
| GPT-5Evaluation Setting=few-shot2026.05 | 0.61 | 0.61 | 0.78 | 94 | |
| PG-RAGEvaluation Setting=few-shot, Subgraph Variant=MP-R2026.05 | 0.61 | 0.6 | 0.78 | 94 | |
| PG-RAGEvaluation Setting=zero-shot, Subgraph Variant=MP-S2026.05 | 0.72 | 0.77 | 0.88 | 94 | |
| PG-RAGEvaluation Setting=zero-shot, Subgraph Variant=MP-R2026.05 | 0.73 | 0.74 | 0.86 | 94 | |
| GPT-5Evaluation Setting=zero-shot2026.05 | 0.75 | 1.06 | 1.03 | 94 | |
| Qwen3-32BEvaluation Setting=few-shot2026.05 | 0.87 | 1.45 | 1.21 | 90 | |
| Qwen3-8BEvaluation Setting=few-shot2026.05 | 0.88 | 1.57 | 1.25 | 90 | |
| Qwen3-32BEvaluation Setting=zero-shot2026.05 | 1.11 | 2.03 | 1.43 | 86 | |
| Qwen3-8BEvaluation Setting=zero-shot2026.05 | 1.2 | 2.32 | 1.52 | 86 | |
| Apertus-8BEvaluation Setting=zero-shot2026.05 | 2.01 | 4.58 | 2.14 | 77 | |
| GMType=Naive baseline2026.05 | 2.29 | 7.44 | 2.73 | — | |
| Apertus-8BEvaluation Setting=few-shot2026.05 | 2.47 | 7.91 | 2.81 | 43 |