Event Prediction on STACKOVERFLOW (test)
10.341OTDFIM-PP
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| FIM-PPEvaluation Protocol=Fine-tuned, Loss Objective=SMAPE2025.09 | 10.341 | 0.525 | 0.984 | 86.133 | |
| FIM-PPEvaluation Protocol=Fine-tuned, Loss Objective=NLL2025.09 | 10.353 | 0.527 | 0.99 | 86.443 | |
| CDiff2025.09 | 10.735 | 0.571 | 1.153 | 100.586 | |
| FIM-PPEvaluation Protocol=Zero-shot, Loss Objective=SMAPE2025.09 | 11.334 | 0.631 | 1.02 | 91.864 | |
| TCDDM2025.09 | 11.41 | 0.63 | 1.201 | 107.893 | |
| FIM-PPEvaluation Protocol=Zero-shot, Loss Objective=NLL2025.09 | 11.52 | 0.657 | 1.03 | 93.296 | |
| HYPRO2025.09 | 11.59 | 0.586 | 1.227 | 109.014 | |
| A-NHP2025.09 | 11.595 | 0.575 | 1.188 | 105.799 | |
| Dual-TPP2025.09 | 11.719 | 0.591 | 1.296 | 106.697 | |
| NHP2025.09 | 11.807 | 0.596 | 1.261 | 108.074 | |
| IFTPP2025.09 | 13.124 | 0.702 | 1.182 | 108.409 | |
| FIM-PPEvaluation Protocol=fine-tuning, Optimization Objective=S-MAPE2025.09 | 19.846 | 0.832 | 1.004 | 87.11 | |
| FIM-PPmode=fine-tuned2026.04 | 19.938 | 0.823 | 1.012 | 87.503 | |
| FIM-PPEvaluation Protocol=fine-tuning, Optimization Objective=NLL2025.09 | 19.938 | 0.823 | 1.012 | 87.503 | |
| CDiff2026.04 | 20.191 | 0.916 | 1.18 | 102.367 | |
| CDiff2025.09 | 20.191 | 0.916 | 1.18 | 102.367 | |
| HYPRO2026.04 | 21.062 | 0.921 | 1.235 | 107.566 | |
| HYPRO2025.09 | 21.062 | 0.921 | 1.235 | 107.566 | |
| FIM-PPEvaluation Protocol=zero-shot, Optimization Objective=S-MAPE2025.09 | 21.182 | 0.857 | 1.047 | 93.715 | |
| Dual-TPP2026.04 | 21.229 | 0.936 | 1.223 | 107.274 | |
| Dual-TPP2025.09 | 21.229 | 0.936 | 1.223 | 107.274 | |
| NHP2026.04 | 21.655 | 0.97 | 1.266 | 108.867 | |
| NHP2025.09 | 21.655 | 0.97 | 1.266 | 108.867 | |
| A-NHP2026.04 | 22.019 | 0.978 | 1.225 | 100.137 | |
| A-NHP2025.09 | 22.019 | 0.978 | 1.225 | 100.137 | |
| TCDDM2026.04 | 22.042 | 1.205 | 1.228 | 108.111 | |
| TCDDM2025.09 | 22.042 | 1.205 | 1.228 | 108.111 | |
| IFTPP2026.04 | 22.339 | 0.97 | 1.251 | 105.674 | |
| IFTPP2025.09 | 22.339 | 0.97 | 1.251 | 105.674 | |
| EVIL2026.04 | 23.075 | 1.445 | 0.96 | 85.819 | |
| FIM-PPmode=zero-shot2026.04 | 23.527 | 1.188 | 1.039 | 92.919 | |
| FIM-PPEvaluation Protocol=zero-shot, Optimization Objective=NLL2025.09 | 23.527 | 1.188 | 1.039 | 92.919 | |
| EVILprior=synthetic2026.04 | 24.075 | 1.463 | 0.991 | 87.078 | |
| FIM-PPEvaluation Protocol=fine-tuned, Optimization Objective=S-MAPE2025.09 | 39.245 | 1.407 | 1.008 | 88.277 | |
| FIM-PPfine-tuned=true2026.04 | 39.792 | 1.336 | 1.018 | 88.248 | |
| FIM-PPEvaluation Protocol=fine-tuned, Optimization Objective=NLL2025.09 | 39.792 | 1.336 | 1.018 | 88.248 | |
| CDiff2026.04 | 41.245 | 1.141 | 1.199 | 106.175 | |
| CDiff2025.09 | 41.245 | 1.141 | 1.199 | 106.175 | |
| Dual-TPP2026.04 | 41.752 | 1.134 | 1.514 | 117.582 | |
| Dual-TPP2025.09 | 41.752 | 1.134 | 1.514 | 117.582 | |
| TCDDM2026.04 | 42.128 | 1.467 | 1.315 | 107.659 | |
| TCDDM2025.09 | 42.128 | 1.467 | 1.315 | 107.659 | |
| HYPRO2026.04 | 42.359 | 1.14 | 1.554 | 110.988 | |
| HYPRO2025.09 | 42.359 | 1.14 | 1.554 | 110.988 | |
| A-NHP2026.04 | 42.591 | 1.142 | 1.34 | 108.542 | |
| A-NHP2025.09 | 42.591 | 1.142 | 1.34 | 108.542 | |
| FIM-PPEvaluation Protocol=zero-shot, Optimization Objective=S-MAPE2025.09 | 43.63 | 1.488 | 1.05 | 93.544 | |
| NHP2026.04 | 43.791 | 1.244 | 1.487 | 116.952 | |
| NHP2025.09 | 43.791 | 1.244 | 1.487 | 116.952 | |
| EVIL2026.04 | 46.141 | 2.839 | 0.977 | 87.773 | |
| IFTPP2026.04 | 46.28 | 1.447 | 1.669 | 115.122 | |
| IFTPP2025.09 | 46.28 | 1.447 | 1.669 | 115.122 | |
| FIM-PPzero-shot=true2026.04 | 49.259 | 2.393 | 1.068 | 96.364 | |
| FIM-PPEvaluation Protocol=zero-shot, Optimization Objective=NLL2025.09 | 49.259 | 2.393 | 1.068 | 96.364 | |
| EVILPrior=synthetic2026.04 | 49.396 | 2.858 | 1.01 | 88.734 |