Granularity Estimation on GRANOLA-EQ (test)
69.84Kendall's τGPT-4.1 mini
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPT-4.1 mini2026.05 | 69.84 | 74.04 | 88.24 | |
| HiT Dist0 + RandomAnchBackbone=HiT, Feature combination=Dist0 + RandomAnch2026.05 | 55.53 | 69.69 | 78.06 | |
| HiT Dist0 + RadialAnchBackbone=HiT, Feature combination=Dist0 + RadialAnch2026.05 | 54.66 | 68.91 | 77.66 | |
| HiT RandomAnchBackbone=HiT, Anchor Type=RandomAnch2026.05 | 54.28 | 67.58 | 76.3 | |
| HiT Dist0 + NNBackbone=HiT, Feature combination=Dist0 + NN2026.05 | 54.04 | 67.55 | 74.05 | |
| HiT RadialAnchBackbone=HiT, Anchor Type=RadialAnch2026.05 | 53.16 | 66.04 | 76.7 | |
| HiT Dist0 + RandomBackbone=HiT, Feature combination=Dist0 + Random2026.05 | 52.51 | 66.67 | 73.65 | |
| HiT NNBackbone=HiT, Anchor Type=NN2026.05 | 52.28 | 65.13 | 72.93 | |
| HiT Dist0Base=Dist02026.05 | 50.7 | 52.37 | 75.73 | |
| HiT RandomBackbone=HiT, Anchor Type=Random2026.05 | 50.53 | 64.41 | 69.49 | |
| MiniLM RandomBackbone=MiniLM, Anchor Type=Random2026.05 | 28.79 | 37.87 | 41.14 | |
| MiniLM RandomAnchBackbone=MiniLM, Anchor Type=RandomAnch2026.05 | 28.73 | 37.76 | 42.31 | |
| MiniLM NNBackbone=MiniLM, Anchor Type=NN2026.05 | 28.65 | 36.94 | 39 | |
| WordNetnotes=could only derive a hierarchy for 17.61% of the answers2026.05 | 25.54 | 28.15 | 61.15 | |
| Word Count2026.05 | 4.15 | 1.07 | 7.91 |