Rank Correlation on Multi-domain Multi-task Language Modeling
1Kendall's TauDMVM
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DMVMModel=LLaMa-3.2-1B, |T|=62026.07 | 1 | 1 | |
| DMVMModel=Qwen2.5-3B, |T|=52026.07 | 1 | 1 | |
| DMVMModel=Qwen2.5-3B, |T|=62026.07 | 1 | 1 | |
| DMVMModel=LLaMa-3.2-1B, |T|=52026.07 | 0.89 | 0.93 | |
| DMVMModel=Qwen2.5-3B, |T|=3, Task Distribution=overlapping2026.07 | 0.84 | 0.9 | |
| DMVMModel=LLaMa-3.2-1B, |T|=3, Task Distribution=overlapping2026.07 | 0.78 | 0.87 |