Question Generation
0.186BLEUMANTA-LM
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| MANTA-LM# Params=101 M2026.05 | 0.186 | 0.378 | 0.613 | 0.88 | — | |
| RDLM2026.05 | 0.179 | 0.315 | 0.576 | — | — | |
| SeqDiffuSeq# Params=108 M2026.05 | 0.175 | — | 0.617 | 0.925 | — | |
| DiffuSEQ# Params=91 M2026.05 | 0.173 | 0.367 | 0.612 | 0.906 | — | |
| FlowLM (FT)Type=Few-step, Steps=5, Training epoch=6000, Minimum Bayes Risk (MBR)=12026.04 | 0.1596 | 0.3484 | — | 0.9206 | 0.5898 | |
| FlowLM (FT)Type=Few-step, Steps=3, Training epoch=6000, Minimum Bayes Risk (MBR)=12026.04 | 0.1595 | 0.3489 | — | 0.9169 | 0.5878 | |
| DiffuSeqType=Multi-step, Steps=2000, Training epoch=34000, Minimum Bayes Risk (MBR)=12026.04 | 0.1527 | 0.3474 | — | 0.9113 | 0.5864 | |
| FlowLM (FT)Type=Few-step, Steps=1, Training epoch=6000, Minimum Bayes Risk (MBR)=12026.04 | 0.1524 | 0.355 | — | 0.8411 | 0.5713 | |
| DiffuSeq (DPM-solver)Type=Few-step, Steps=10, Training epoch=34000, Minimum Bayes Risk (MBR)=12026.04 | 0.1425 | 0.3509 | — | 0.8606 | 0.573 | |
| GPVAE-T5# Params=220 M2026.05 | 0.125 | 0.339 | 0.631 | 0.938 | — | |
| GPT2-large FT# Params=774 M2026.05 | 0.111 | 0.322 | 0.635 | 0.967 | — | |
| LevT# Params=80 M2026.05 | 0.093 | 0.289 | 0.549 | 0.891 | — | |
| GPT2-base FT# Params=117 M2026.05 | 0.074 | 0.271 | 0.605 | 0.96 | — |