Longitudinal Classification on AnnoMI (80/20)
52.6Macro F1 ScoreLLaMA-8B (LiFT)
Evaluation results
| Method | Links | |
|---|---|---|
| LLaMA-8B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 52.6 | |
| Qwen-14B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 51.2 | |
| LLaMA-8B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 49.6 | |
| Qwen-14B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 48.5 | |
| LLaMA-8B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 42.8 | |
| Qwen-14B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 41.1 | |
| LLaMA-8B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 40.6 | |
| Qwen-14B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 39.2 | |
| OLMo-7B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 36.5 | |
| OLMo-7B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 34.6 | |
| OLMo-7B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 33.6 | |
| OLMo-7B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 32.1 | |
| OLMo-1B (LiFT)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 31.6 | |
| LLaMA-8B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 31.1 | |
| OLMo-7B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 30.6 | |
| Qwen-14B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 30.3 | |
| OLMo-1B (LiFT)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 29.7 | |
| OLMo-7B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 27.8 | |
| OLMo-1B (base)Shots=3, Seen in training=✓, Train/Test Split=80/202026.03 | 26.2 | |
| LLaMA-8B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 26.2 | |
| OLMo-1B (LiFT)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 25.2 | |
| OLMo-1B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 25 | |
| Qwen-14B (base)Shots=0, Seen in training=✓, Train/Test Split=80/202026.03 | 24.4 | |
| OLMo-1B (base)Shots=1, Seen in training=✓, Train/Test Split=80/202026.03 | 21.1 |