Complex reasoning on FEVER (test)
85.18Macro F1EvoPool
Evaluation results
| Method | Links | |
|---|---|---|
| EvoPoolBackbone=Llama-3.1-8B2026.06 | 85.18 | |
| EvoPoolDownstream Model=Llama-3.1-8B2026.06 | 84.35 | |
| EvoPoolBackbone=Qwen2-1.5B2026.06 | 83.6 | |
| EvoPoolDownstream Model=Qwen3-1.7B2026.06 | 82.62 | |
| LLM-AnnotationBackbone=Llama-3.1-8B2026.06 | 82.36 | |
| EvoPoolBackbone=RoBERTa-large2026.06 | 82.27 | |
| EvoPoolDownstream Model=RoBERTa-large2026.06 | 81.32 | |
| EvoPoolBackbone=gpt-4o-mini2026.06 | 81.17 | |
| LLM-AnnotationBackbone=Qwen2-1.5B2026.06 | 79.88 | |
| GoldenDownstream Model=RoBERTa-large2026.06 | 78.05 | |
| LLM-AnnotationBackbone=RoBERTa-large2026.06 | 77.67 | |
| LLM-AnnotationDownstream Model=Llama-3.1-8B2026.06 | 76.45 | |
| LLM-AnnotationDownstream Model=Qwen3-1.7B2026.06 | 76.26 | |
| LLM annotationBackbone=gpt-4o-mini2026.06 | 75.99 | |
| LLM-EvalDownstream Model=RoBERTa-large2026.06 | 75.99 | |
| LLM-EvalDownstream Model=Qwen3-1.7B2026.06 | 75.99 | |
| LLM-EvalDownstream Model=Llama-3.1-8B2026.06 | 75.99 | |
| Self-TrainDownstream Model=RoBERTa-large2026.06 | 75.56 | |
| LLM-AnnotationDownstream Model=RoBERTa-large2026.06 | 74.28 | |
| AlchemistBackbone=Qwen2-1.5B2026.06 | 71.09 | |
| Self-TrainDownstream Model=Qwen3-1.7B2026.06 | 70.99 | |
| Self-TrainDownstream Model=Llama-3.1-8B2026.06 | 68.79 | |
| GoldenDownstream Model=Qwen3-1.7B2026.06 | 64.77 | |
| AlchemistBackbone=Llama-3.1-8B2026.06 | 63.9 | |
| DataSculptBackbone=Qwen2-1.5B2026.06 | 62.83 | |
| GoldenDownstream Model=Llama-3.1-8B2026.06 | 60.42 | |
| DataSculptBackbone=Llama-3.1-8B2026.06 | 50.83 | |
| DataSculptBackbone=RoBERTa-large2026.06 | 36.72 | |
| DataSculptDownstream Model=Qwen3-1.7B2026.06 | 35.41 | |
| DataSculptDownstream Model=Llama-3.1-8B2026.06 | 34.34 | |
| DataSculptDownstream Model=RoBERTa-large2026.06 | 32.85 | |
| AlchemistBackbone=RoBERTa-large2026.06 | 29.69 | |
| AlchemistBackbone=gpt-4o-mini2026.06 | 16.67 | |
| AlchemistDownstream Model=RoBERTa-large2026.06 | 16.67 | |
| AlchemistDownstream Model=Qwen3-1.7B2026.06 | 16.67 | |
| AlchemistDownstream Model=Llama-3.1-8B2026.06 | 16.67 | |
| DataSculptBackbone=gpt-4o-mini2026.06 | 3.39 |