Performance prediction on Sentiment temporal (in-domain)
0.852ROC AUCCosine distance (fine-tuned)
Evaluation Results
| Method | Links | |
|---|---|---|
| Cosine distance (fine-tuned)Model dependency=model-dependent, Embedding status=fine-tuned2023.05 | 0.852 | |
| Vocabulary, structural, semantic driftModel dependency=model-agnostic2023.05 | 0.578 | |
| Structural driftModel dependency=model-agnostic2023.05 | 0.568 | |
| Semantic driftModel dependency=model-agnostic2023.05 | 0.565 | |
| Combined prev. model-agnosticModel dependency=model-agnostic2023.05 | 0.554 | |
| Vocabulary driftModel dependency=model-agnostic2023.05 | 0.552 | |
| Token frequency cross-entropyModel dependency=model-agnostic2023.05 | 0.543 | |
| Cosine distance (pre-trained)Model dependency=model-agnostic, Embedding status=pre-trained2023.05 | 0.534 | |
| Token frequency JS-divModel dependency=model-agnostic2023.05 | 0.519 | |
| Baseline (no-performance drop)Model dependency=model-agnostic2023.05 | 0.5 |