Definition Generation on CHEER (test)
19.5BLEUCoT
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| CoTLM-based Backbone=Qwen2-72B2025.05 | 19.5 | 43.49 | 67.67 | 2.77 | 2.54 | |
| DPLM-based Backbone=Qwen2-72B, with UGC=true2025.05 | 19.27 | 44.37 | 67.58 | 2.71 | 2.45 | |
| CoTLM-based Backbone=GPT-4o2025.05 | 18.33 | 44.49 | 67.46 | 2.6 | 2.3 | |
| DPLM-based Backbone=GPT-4o, with UGC=true2025.05 | 17.85 | 45.22 | 67.56 | 2.5 | 2.13 | |
| CoTLM-based Backbone=GPT-4o Mini2025.05 | 16.64 | 44.79 | 66.55 | 2.32 | 2.04 | |
| DPLM-based Backbone=GPT-4o Mini, with UGC=true2025.05 | 15.53 | 44.81 | 66.67 | 2.26 | 1.93 | |
| DPLM-based Backbone=Qwen2-7B, with UGC=true2025.05 | 15.35 | 43.05 | 65.38 | 2.19 | 1.97 | |
| CoTLM-based Backbone=Qwen2-7B2025.05 | 15.26 | 40.41 | 65.12 | 2.3 | 2.14 | |
| FOCUSLM-based Backbone=GPT-4o2025.05 | 15.08 | 35.1 | 66.05 | 2.95 | 2.92 | |
| FOCUSLM-based Backbone=GPT-4o Mini2025.05 | 13.37 | 33.42 | 65.05 | 2.64 | 2.67 | |
| FOCUSLM-based Backbone=Qwen2-7B2025.05 | 12.41 | 33.57 | 63.89 | 2.39 | 2.51 | |
| FOCUSLM-based Backbone=Qwen2-72B2025.05 | 12.09 | 29.81 | 64.75 | 2.88 | 3.2 | |
| DPLM-based Backbone=Qwen2-72B, with UGC=false2025.05 | 10.87 | 41.58 | 66.13 | 2.07 | 1.65 | |
| DPLM-based Backbone=Qwen2-7B, with UGC=false2025.05 | 10.27 | 41.49 | 64.77 | 1.89 | 1.55 | |
| DPLM-based Backbone=GPT-4o, with UGC=false2025.05 | 9.56 | 39.42 | 66.56 | 2.05 | 1.62 | |
| DPLM-based Backbone=GPT-4o Mini, with UGC=false2025.05 | 7.96 | 38.81 | 65.65 | 1.87 | 1.49 | |
| SDefinerLM-based Backbone=MASS2025.05 | 0.67 | 26.94 | 54.78 | 1.01 | 1 | |
| MASS-zhLM-based Backbone=MASS2025.05 | 0.4 | 28.5 | 56.67 | 1.02 | 1.01 |