Definition Modeling on 3D-EX
54.84BLEU ScoreLM-LEXICON-MOE
Evaluation results
| Method | Links | ||
|---|---|---|---|
| LM-LEXICON-MOEParameter Count=4x8B, Mode=BoN-Oracle2026.02 | 54.84 | 50.5 | |
| LM-LEXICON-DENSEParameter Count=8B, Mode=BoN-Oracle2026.02 | 48.78 | 49.71 | |
| LM-LEXICON-MOEParameter Count=4x8B, Mode=BoN-ORM2026.02 | 45.86 | 46.38 | |
| LM-LEXICON-MOEParameter Count=4x8B, Mode=Zero-shot2026.02 | 45.69 | 46.07 | |
| LM-LEXICON-DENSEParameter Count=8B, Mode=Zero-shot2026.02 | 35.01 | 43.32 | |
| LM-LEXICON-DENSEParameter Count=8B, Mode=BoN-ORM2026.02 | 34.83 | 42.68 | |
| Rerank-T5Supervised training=true2026.02 | 34.43 | 38.57 | |
| Contrast-T5Supervised training=true2026.02 | 34.27 | 37.62 | |
| GEMINI-1.5-PROIn-Context Learning=Retrieval-ICL, shots=322026.02 | 32.99 | 39.14 | |
| MDM-T5Supervised training=true2026.02 | 32.67 | 32.38 | |
| SimpDefinerSupervised training=true2026.02 | 32.08 | 31.57 | |
| GPT-4-TURBOIn-Context Learning=Retrieval-ICL, shots=322026.02 | 29.73 | 37.66 | |
| GEMINI-1.5-PROIn-Context Learning=Random-ICL, shots=322026.02 | 29.4 | 38.02 | |
| Flan-T5-DefSupervised training=true2026.02 | 26.43 | 25.12 | |
| GPT-4-TURBOIn-Context Learning=Random-ICL, shots=322026.02 | 25.93 | 34.48 | |
| LlamaDictSupervised training=true2026.02 | 24.56 | 26.11 | |
| CLAUDE-3-OPUSIn-Context Learning=Random-ICL, shots=322026.02 | 18.57 | 28.49 | |
| CLAUDE-3-OPUSIn-Context Learning=Retrieval-ICL, shots=322026.02 | 17.46 | 24.67 |