Abstract Generation from Embeddings on 5-task 1.2M dataset
0.39Win Rate (Orig)ctELM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ctELMBase model=Llama-3.1-8B-Instruct2026.01 | 0.39 | 0.4 | 0.38 | 0.4 | |
| ctELMBase model=gemma-3-4b-it2026.01 | 0.31 | 0.29 | — | — | |
| ctELMBase model=medgemma-4b-it2026.01 | 0.22 | 0.16 | — | — | |
| ctELMBase model=gemma-3-1b-it2026.01 | 0.12 | 0.13 | — | — | |
| Vec2Text-ft2026.01 | 0.01 | — | — | — | |
| Vec2Text-sect-ft2026.01 | 0.01 | — | — | — | |
| Vec2Text2026.01 | 0 | — | — | — | |
| Vec2Text-sect2026.01 | 0 | — | — | — |