Sentiment Analysis on CEBaB
82.3AccuracyVariational Credal
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Variational Credal2026.02 | 82.3 | 0.05 | 0.35 | 0.74 | 0.76 | — | — | |
| Deep Ensembles2026.02 | 82.1 | 0.79 | 0.28 | 0.41 | 0.68 | — | — | |
| CBDL2026.02 | 82 | 0.58 | 0.31 | 0.45 | 0.72 | — | — | |
| MC Dropout2026.02 | 81.8 | 0.77 | 0.27 | 0.39 | 0.66 | — | — | |
| CreINNs2026.02 | 81.8 | 0.61 | 0.3 | 0.42 | 0.71 | — | — | |
| Semantic Entropy2026.02 | 81.2 | 0.81 | 0.26 | 0.38 | 0.67 | — | — | |
| P(True)2026.02 | 80.8 | 0.76 | 0.24 | 0.35 | 0.64 | — | — | |
| CREDENCE-DeBERTaCategory=Encoder, Backbone=DeBERTa, Parameters=66M–184M2026.04 | 73.4 | — | — | — | — | 0.302 | 0.785 | |
| CREDENCE-MistralCategory=LLM, Backbone=Mistral-7B, Parameters=3.8B–8B, Adapter=LoRA2026.04 | 72.3 | — | — | — | — | 0.279 | 0.758 | |
| CREDENCE-Llama-3Category=LLM, Backbone=Llama-3, Parameters=3.8B–8B, Adapter=LoRA2026.04 | 71.9 | — | — | — | — | 0.274 | 0.749 | |
| CREDENCE-RoBERTaCategory=Encoder, Backbone=RoBERTa, Parameters=66M–184M2026.04 | 71.6 | — | — | — | — | 0.287 | 0.785 | |
| Deep EnsembleCategory=General2026.04 | 71.1 | — | — | — | — | 0.201 | 0.345 | |
| CBM + EnsembleCategory=CBM2026.04 | 71 | — | — | — | — | 0.189 | 0.356 | |
| Temp. ScalingCategory=General2026.04 | 70.8 | — | — | — | — | 0.098 | 0.287 | |
| P-CBMCategory=CBM2026.04 | 70.6 | — | — | — | — | 0.156 | 0.341 | |
| Standard CBMCategory=CBM2026.04 | 70.4 | — | — | — | — | 0.121 | 0.298 | |
| MC DropoutCategory=General2026.04 | 70.2 | — | — | — | — | 0.185 | 0.312 | |
| CBM + MC DropCategory=CBM2026.04 | 70.1 | — | — | — | — | 0.168 | 0.324 | |
| CREDENCE-Phi-3Category=LLM, Backbone=Phi-3, Parameters=3.8B–8B, Adapter=LoRA2026.04 | 69.8 | — | — | — | — | 0.268 | 0.723 | |
| Evidential DLCategory=General2026.04 | 69.5 | — | — | — | — | 0.142 | 0.287 | |
| CREDENCE-DistilBERTCategory=Encoder, Backbone=DistilBERT, Parameters=66M–184M2026.04 | 68.2 | — | — | — | — | 0.251 | 0.742 |