Longitudinal Classification on TalkLife (80/20)
34.6Macro F1LLaMA-8B (LiFT)
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA-8B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 34.6 | |
| Qwen-14B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 32.1 | |
| LLaMA-8B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 30.2 | |
| LLaMA-8B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 29.1 | |
| Qwen-14B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 28.6 | |
| Qwen-14B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 27.2 | |
| LLaMA-8B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 26.2 | |
| Qwen-14B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 24.9 | |
| LLaMA-8B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 22.3 | |
| LLaMA-8B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 22.1 | |
| Qwen-14B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 20.9 | |
| Qwen-14B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 20.1 | |
| OLMo-7B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 12.3 | |
| OLMo-7B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 12.1 | |
| OLMo-7B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 10.4 | |
| OLMo-1B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 10.1 | |
| OLMo-1B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 9.8 | |
| OLMo-1B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 8.5 | |
| OLMo-7B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 5.9 | |
| OLMo-7B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 5.6 | |
| OLMo-7B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 5 | |
| OLMo-1B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 4.4 | |
| OLMo-1B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 4.4 | |
| OLMo-1B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 4 |