High-stakes specialized classification on DDI (test)
61.12Macro-F1EvoPool
Evaluation Results
| Method | Links | |
|---|---|---|
| EvoPoolBackbone=Llama-3.1-8B2026.06 | 61.12 | |
| EvoPoolBackbone=RoBERTa-large2026.06 | 59.74 | |
| Self-TrainDownstream Model=RoBERTa-large2026.06 | 57.82 | |
| GoldenDownstream Model=RoBERTa-large2026.06 | 57.74 | |
| EvoPoolBackbone=Qwen2-1.5B2026.06 | 57.45 | |
| EvoPoolDownstream Model=Llama-3.1-8B2026.06 | 53.79 | |
| EvoPoolDownstream Model=RoBERTa-large2026.06 | 53.4 | |
| EvoPoolDownstream Model=Qwen3-1.7B2026.06 | 52.93 | |
| Self-TrainDownstream Model=Qwen3-1.7B2026.06 | 45.92 | |
| Self-TrainDownstream Model=Llama-3.1-8B2026.06 | 45.81 | |
| LLM-AnnotationBackbone=Llama-3.1-8B2026.06 | 45.49 | |
| EvoPoolBackbone=gpt-4o-mini2026.06 | 45.39 | |
| GoldenDownstream Model=Qwen3-1.7B2026.06 | 44.91 | |
| LLM-AnnotationBackbone=Qwen2-1.5B2026.06 | 39.46 | |
| GoldenDownstream Model=Llama-3.1-8B2026.06 | 38.63 | |
| DataSculptBackbone=Llama-3.1-8B2026.06 | 34.63 | |
| DataSculptBackbone=Qwen2-1.5B2026.06 | 29.55 | |
| AlchemistBackbone=Llama-3.1-8B2026.06 | 27.16 | |
| LLM-AnnotationBackbone=RoBERTa-large2026.06 | 27.07 | |
| AlchemistBackbone=RoBERTa-large2026.06 | 26.87 | |
| AlchemistBackbone=Qwen2-1.5B2026.06 | 26.71 | |
| LLM annotationBackbone=gpt-4o-mini2026.06 | 23.45 | |
| LLM-EvalDownstream Model=RoBERTa-large2026.06 | 23.45 | |
| LLM-EvalDownstream Model=Qwen3-1.7B2026.06 | 23.45 | |
| LLM-EvalDownstream Model=Llama-3.1-8B2026.06 | 23.45 | |
| LLM-AnnotationDownstream Model=Llama-3.1-8B2026.06 | 23.05 | |
| LLM-AnnotationDownstream Model=RoBERTa-large2026.06 | 22.34 | |
| LLM-AnnotationDownstream Model=Qwen3-1.7B2026.06 | 22.06 | |
| AlchemistDownstream Model=Qwen3-1.7B2026.06 | 21.55 | |
| AlchemistDownstream Model=Llama-3.1-8B2026.06 | 21.21 | |
| AlchemistDownstream Model=RoBERTa-large2026.06 | 18.06 | |
| DataSculptDownstream Model=Llama-3.1-8B2026.06 | 17.78 | |
| DataSculptDownstream Model=Qwen3-1.7B2026.06 | 17.56 | |
| DataSculptBackbone=RoBERTa-large2026.06 | 17.46 | |
| DataSculptDownstream Model=RoBERTa-large2026.06 | 17.46 | |
| AlchemistBackbone=gpt-4o-mini2026.06 | 11.89 | |
| DataSculptBackbone=gpt-4o-mini2026.06 | 11.34 |