Model Change Detection on TinyChange (Overall)
0.915Overall AUCLT
Evaluation results
| Method | Links | |
|---|---|---|
| LTToken Count Per Test (Input)=28, Token Count Per Test (Output)=20, Cost Per Year ($)=0.142025.12 | 0.915 | |
| MMLU-ALGToken Count Per Test (Input)=2.1 × 10^5, Token Count Per Test (Output)=9.9 × 10^3, Cost Per Year ($)=3322025.12 | 0.878 | |
| METToken Count Per Test (Input)=2.9 × 10^4, Token Count Per Test (Output)=2.0 × 10^4, Cost Per Year ($)=1462025.12 | 0.67 |