Materiality Prediction on Finance News (test)
72.9AUROCHybrid (α= 0.4)
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Hybrid (α= 0.4)Threshold (τ*)=0.1, Alpha (α)=0.42026.06 | 72.9 | 21.2 | 13 | 58.3 | 68.8 | |
| Classification headThreshold (τ*)=0.1, Evaluation Protocol=linear probe2026.06 | 72.8 | 21.2 | 13 | 58.3 | 68.8 | |
| LLM zero-shotThreshold (τ*)=0.5, Evaluation Protocol=zero-shot2026.06 | 54.1 | 15.7 | 9.2 | 55.6 | 57.2 | |
| Random2026.06 | 50 | — | — | — | — | |
| Majority class2026.06 | — | 0 | — | 0 | 92.8 |