nudge classification on labeled N = 197 (test)
100PrecisionLLaMA 3.1 8B
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLaMA 3.1 8BStrategy=Self-Consistency x72026.02 | 100 | 12 | 21 | 61 | |
| LLaMA 3.1 8BInput context=Full Document2026.02 | 72 | 51 | 60 | 70 | |
| LLaMA 3.1 8BInput context=Title, Abstract, Intro2026.02 | 63 | 72 | 67 | 69 | |
| Gemini 2.5 ProInput context=Full Document2026.02 | 61 | 65 | 63 | 66 |