Performance prediction on Sentiment categories (in-domain)
0.845ROC AUCCosine distance (fine-tuned)
Evaluation Results
| Method | Links | |
|---|---|---|
| Cosine distance (fine-tuned)Model dependency=model-dependent, Embedding status=fine-tuned2023.05 | 0.845 | |
| Vocabulary, structural, semantic driftModel dependency=model-agnostic2023.05 | 0.597 | |
| Semantic driftModel dependency=model-agnostic2023.05 | 0.586 | |
| Structural driftModel dependency=model-agnostic2023.05 | 0.572 | |
| Vocabulary driftModel dependency=model-agnostic2023.05 | 0.561 | |
| Combined prev. model-agnosticModel dependency=model-agnostic2023.05 | 0.551 | |
| Token frequency cross-entropyModel dependency=model-agnostic2023.05 | 0.54 | |
| Cosine distance (pre-trained)Model dependency=model-agnostic, Embedding status=pre-trained2023.05 | 0.535 | |
| Token frequency JS-divModel dependency=model-agnostic2023.05 | 0.512 | |
| Baseline (no-performance drop)Model dependency=model-agnostic2023.05 | 0.5 |