Content Quality Assessment on Financial-advice prompts
1.69Content ScorePretrained
Evaluation results
| Method | Links | |
|---|---|---|
| PretrainedProbe=–, Model size=1.5B, Training epochs=1, Training corpus skew=70/30 right-skewed Reddit financial-advice corpus2026.05 | 1.69 | |
| GRASPProbe=unsupervised, Model size=1.5B, Training epochs=1, Training corpus skew=70/30 right-skewed Reddit financial-advice corpus2026.05 | 0.99 | |
| CAFT-time vsvd (top-10 AUROC)Probe=unsupervised, Model size=1.5B, Training epochs=1, Training corpus skew=70/30 right-skewed Reddit financial-advice corpus2026.05 | 0.87 | |
| Inference-ablate vsvd (top-10 AUROC)Probe=unsupervised, Model size=1.5B, Training epochs=1, Training corpus skew=70/30 right-skewed Reddit financial-advice corpus2026.05 | 0.82 | |
| Naive (corruption baseline)Probe=–, Model size=1.5B, Training epochs=1, Training corpus skew=70/30 right-skewed Reddit financial-advice corpus2026.05 | 0.77 |