Survey Response Prediction on TEDS 2024
58.3Exact Match AccuracyRF (demo+SetA)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| RF (demo+SetA)Evaluation Protocol=Supervised (5-fold CV), Input Features=demographics + Set A, number of trees=200, max depth=102026.07 | 58.3 | 88.2 | 0.95 | 0.72 | |
| Qwen3.5 27BEvaluation Protocol=Zero-shot, Model Parameters=27B, Quantization=Q42026.07 | 52.1 | 85.7 | 1.17 | 0.84 | |
| gpt-oss 120BEvaluation Protocol=Zero-shot, Model Parameters=120B, Quantization=Q42026.07 | 51.3 | 85.2 | 1.16 | 0.85 | |
| Gemma3 27BEvaluation Protocol=Zero-shot, Model Parameters=27B, Precision=FP162026.07 | 47.6 | 86.2 | 1.29 | 0.67 | |
| LR (demo only)Evaluation Protocol=Supervised (5-fold CV), Input Features=demographics only2026.07 | 47 | 83.1 | 1.35 | 0.38 | |
| Majority voteEvaluation Protocol=Supervised (5-fold CV)2026.07 | 46.6 | — | — | — |