Text Generation on DomainBench
71.37BLEU (Agriculture)SYTTA-16
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| SYTTA-16Model=QWEN-2.5-14B, Reference Strategy=Static-Ref2025.10 | 71.37 | 71.72 | 70.87 | 70.1 | 71.01 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Strategy=Dynamic-Ref2025.10 | 71.07 | 71.24 | 73.66 | 70.7 | 71.67 | |
| SYTTA-8Model=QWEN-2.5-14B, Reference Strategy=Dynamic-Ref2025.10 | 71.05 | 71.97 | 72.04 | 70.7 | 71.44 | |
| SYTTA-8Model=LLAMA-3.1-8B, Reference Strategy=Dynamic-Ref2025.10 | 70.35 | 70.95 | 71.73 | 70.22 | 70.82 | |
| SYTTA-4Model=LLAMA-3.1-8B, Reference Strategy=Dynamic-Ref2025.10 | 70.29 | 70.82 | 72.78 | 69.85 | 70.94 | |
| SYTTA-16Model=QWEN-2.5-7B, Reference Strategy=Dynamic-Ref2025.10 | 70.2 | 70.81 | 72.3 | 70.89 | 71.05 | |
| SYTTA-16Model=LLAMA-3.1-8B, Reference Strategy=Dynamic-Ref2025.10 | 70.19 | 69.03 | 70.92 | 70.09 | 70.06 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Strategy=Static-Ref2025.10 | 70.19 | 71.03 | 73.35 | 70.39 | 71.24 | |
| SYTTA-4Model=LLAMA-3.2-3B, Reference Strategy=Static-Ref2025.10 | 70.01 | 70.16 | 68.54 | 70.28 | 69.75 | |
| SYTTA-4Model=LLAMA-3.2-3B, Reference Strategy=Dynamic-Ref2025.10 | 69.94 | 69.5 | 69.24 | 70.27 | 69.74 | |
| SYTTA-4Model=QWEN-2.5-7B, Reference Strategy=Dynamic-Ref2025.10 | 69.78 | 71.03 | 73.48 | 70.26 | 71.14 | |
| SYTTA-16Model=LLAMA-3.2-3B, Reference Strategy=Dynamic-Ref2025.10 | 69.68 | 68.27 | 69.79 | 69.7 | 69.36 | |
| SYTTA-2Model=LLAMA-3.2-3B, Reference Strategy=Dynamic-Ref2025.10 | 69.25 | 70.06 | 70.77 | 70.05 | 70.03 | |
| SYTTA-16Model=QWEN-2.5-7B, Reference Strategy=Static-Ref2025.10 | 69.09 | 70.73 | 72.06 | 70.6 | 70.62 | |
| TentModel=QWEN-2.5-7B2025.10 | 69.06 | 70.4 | 67 | 68.87 | 68.83 | |
| SYTTA-8Model=LLAMA-3.2-3B, Reference Strategy=Dynamic-Ref2025.10 | 68.98 | 69.96 | 70.13 | 70.22 | 69.82 | |
| SYTTA-4Model=QWEN-2.5-7B, Reference Strategy=Static-Ref2025.10 | 68.9 | 70.73 | 73.56 | 70.05 | 70.81 | |
| SYTTA-16Model=QWEN-2.5-14B, Reference Strategy=Dynamic-Ref2025.10 | 68.86 | 70.69 | 73.91 | 70.56 | 71 | |
| SYTTA-4Model=QWEN-2.5-14B, Reference Strategy=Static-Ref2025.10 | 68.38 | 71.33 | 73.71 | 69.99 | 70.85 | |
| SYTTA-4Model=QWEN-2.5-14B, Reference Strategy=Dynamic-Ref2025.10 | 68.35 | 71.06 | 74.48 | 70.29 | 71.04 | |
| SYTTA-8Model=LLAMA-3.2-3B, Reference Strategy=Static-Ref2025.10 | 68.05 | 69.9 | 69.99 | 70.03 | 69.49 | |
| TentModel=QWEN-2.5-14B2025.10 | 68.01 | 69.39 | 68.42 | 69.92 | 68.94 | |
| TentModel=LLAMA-3.1-8B2025.10 | 67.46 | 69.03 | 67.69 | 67.91 | 68.02 | |
| EATAModel=LLAMA-3.2-3B2025.10 | 67.44 | 69.45 | 68.01 | 63.21 | 67.03 | |
| SYTTA-4Model=LLAMA-3.1-8B, Reference Strategy=Static-Ref2025.10 | 67.28 | 70.32 | 71.29 | 69.88 | 69.69 | |
| SYTTA-2Model=LLAMA-3.1-8B, Reference Strategy=Dynamic-Ref2025.10 | 67.26 | 70.89 | 71.44 | 69.95 | 69.89 | |
| SYTTA-8Model=LLAMA-3.1-8B, Reference Strategy=Static-Ref2025.10 | 67.22 | 70.75 | 71.78 | 69.95 | 69.93 | |
| SYTTA-2Model=LLAMA-3.1-8B, Reference Strategy=Static-Ref2025.10 | 67 | 71.02 | 69.72 | 69.8 | 69.38 | |
| TLMModel=LLAMA-3.1-8B2025.10 | 66.89 | 70.86 | 72.1 | 69.91 | 69.94 | |
| SYTTA-16Model=LLAMA-3.1-8B, Reference Strategy=Static-Ref2025.10 | 66.83 | 70.3 | 69.97 | 69.72 | 69.21 | |
| Base ModelModel=LLAMA-3.2-3B2025.10 | 66.66 | 67.72 | 66.74 | 67.75 | 67.22 | |
| Base ModelModel=LLAMA-3.1-8B2025.10 | 66.66 | 67.77 | 66.41 | 67.72 | 67.14 | |
| TentModel=LLAMA-3.2-3B2025.10 | 66.62 | 64.49 | 66.78 | 64.43 | 65.58 | |
| SYTTA-2Model=QWEN-2.5-7B, Reference Strategy=Dynamic-Ref2025.10 | 66.54 | 71.02 | 73.42 | 69.96 | 70.24 | |
| SYTTA-2Model=LLAMA-3.2-3B, Reference Strategy=Static-Ref2025.10 | 66.49 | 70.03 | 69.09 | 70.02 | 68.91 | |
| SYTTA-16Model=LLAMA-3.2-3B, Reference Strategy=Static-Ref2025.10 | 66.42 | 69.32 | 69.8 | 69.72 | 68.81 | |
| EATAModel=QWEN-2.5-7B2025.10 | 66.34 | 69.97 | 67.05 | 68.62 | 68 | |
| TLMModel=LLAMA-3.2-3B2025.10 | 66.28 | 70.17 | 70.95 | 69.3 | 69.17 | |
| EATAModel=LLAMA-3.1-8B2025.10 | 66.28 | 67.34 | 66.46 | 65.45 | 66.38 | |
| SYTTA-2Model=QWEN-2.5-14B, Reference Strategy=Dynamic-Ref2025.10 | 66.22 | 71.36 | 74.31 | 70.08 | 70.5 | |
| SYTTA-8Model=QWEN-2.5-14B, Reference Strategy=Static-Ref2025.10 | 65.99 | 71.2 | 72.35 | 70.54 | 70.02 | |
| SYTTA-2Model=QWEN-2.5-7B, Reference Strategy=Static-Ref2025.10 | 65.86 | 71.21 | 73.69 | 69.94 | 70.17 | |
| Base ModelModel=QWEN-2.5-7B2025.10 | 65.67 | 67.91 | 65.51 | 68.43 | 66.88 | |
| SYTTA-2Model=QWEN-2.5-14B, Reference Strategy=Static-Ref2025.10 | 65.4 | 71.04 | 73.92 | 69.76 | 70.03 | |
| Base ModelModel=QWEN-2.5-14B2025.10 | 65.21 | 68.28 | 65.98 | 68.33 | 66.95 | |
| TLMModel=QWEN-2.5-7B2025.10 | 64.99 | 70.07 | 74.07 | 70.22 | 69.84 | |
| TLMModel=QWEN-2.5-14B2025.10 | 64.81 | 70.83 | 75.38 | 70.46 | 70.37 | |
| EATAModel=QWEN-2.5-14B2025.10 | 64.73 | 70.27 | 68.02 | 69 | 68 | |
| SYTTA-8Model=QWEN-2.5-14B, Reference Type=Dynamic-Ref2025.10 | 26 | 34.8 | 27.35 | 33.09 | 30.31 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Type=Dynamic-Ref2025.10 | 25.99 | 33.22 | 31.64 | 32.71 | 30.89 | |
| SYTTA-16Model=QWEN-2.5-14B, Reference Type=Static-Ref2025.10 | 25.57 | 34.45 | 25.38 | 32.47 | 29.47 | |
| SYTTA-16Model=QWEN-2.5-7B, Reference Type=Dynamic-Ref2025.10 | 24.79 | 32.23 | 29.48 | 33.12 | 29.9 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Type=Static-Ref2025.10 | 24.72 | 33.11 | 31.33 | 32.57 | 30.43 | |
| SYTTA-8Model=LLAMA-3.1-8B, Reference Type=Dynamic-Ref2025.10 | 23.97 | 32.29 | 28.58 | 32.77 | 29.4 | |
| SYTTA-4Model=QWEN-2.5-7B, Reference Type=Dynamic-Ref2025.10 | 23.94 | 33.02 | 31.97 | 32.41 | 30.33 | |
| SYTTA-4Model=LLAMA-3.2-3B, Reference Type=Static-Ref2025.10 | 23.65 | 32.18 | 17.36 | 31.84 | 26.26 | |
| SYTTA-4Model=QWEN-2.5-14B, Reference Type=Dynamic-Ref2025.10 | 23.26 | 33.38 | 32.91 | 32.43 | 30.5 | |
| SYTTA-4Model=LLAMA-3.1-8B, Reference Type=Dynamic-Ref2025.10 | 23.08 | 32.9 | 28.78 | 32.33 | 29.27 | |
| SYTTA-4Model=LLAMA-3.2-3B, Reference Type=Dynamic-Ref2025.10 | 22.76 | 29.75 | 18.47 | 31.86 | 25.71 | |
| SYTTA-16Model=LLAMA-3.1-8B, Reference Type=Dynamic-Ref2025.10 | 22.7 | 28.54 | 27.08 | 30.91 | 27.31 | |
| SYTTA-4Model=QWEN-2.5-14B, Reference Type=Static-Ref2025.10 | 22.61 | 33.91 | 31.41 | 32.42 | 30.09 | |
| TentModel=QWEN-2.5-7B2025.10 | 22.45 | 32.45 | 17.26 | 31.28 | 25.86 | |
| SYTTA-4Model=QWEN-2.5-7B, Reference Type=Static-Ref2025.10 | 22.45 | 32.74 | 32.03 | 32.33 | 29.89 | |
| SYTTA-2Model=LLAMA-3.2-3B, Reference Type=Dynamic-Ref2025.10 | 21.91 | 32.45 | 27 | 32.03 | 28.35 | |
| SYTTA-8Model=LLAMA-3.2-3B, Reference Type=Dynamic-Ref2025.10 | 21.58 | 32.11 | 22.57 | 31.55 | 26.95 | |
| SYTTA-16Model=LLAMA-3.2-3B, Reference Type=Dynamic-Ref2025.10 | 21.48 | 23.05 | 20.96 | 30.73 | 24.05 | |
| SYTTA-16Model=QWEN-2.5-14B, Reference Type=Dynamic-Ref2025.10 | 21.43 | 32.07 | 32.16 | 32.89 | 29.64 | |
| SYTTA-16Model=QWEN-2.5-7B, Reference Type=Static-Ref2025.10 | 20.85 | 32.96 | 28.61 | 32.53 | 28.74 | |
| SYTTA-2Model=LLAMA-3.1-8B, Reference Type=Dynamic-Ref2025.10 | 20.07 | 33.85 | 28.23 | 32.37 | 28.63 | |
| SYTTA-8Model=LLAMA-3.2-3B, Reference Type=Static-Ref2025.10 | 19.59 | 31.3 | 23.36 | 31.08 | 26.33 | |
| SYTTA-8Model=LLAMA-3.1-8B, Reference Type=Static-Ref2025.10 | 18.74 | 33.37 | 27.35 | 32.06 | 27.88 | |
| SYTTA-2Model=LLAMA-3.1-8B, Reference Type=Static-Ref2025.10 | 18.57 | 33.53 | 24.44 | 32.54 | 27.27 | |
| SYTTA-8Model=QWEN-2.5-14B, Reference Type=Static-Ref2025.10 | 18.41 | 34.3 | 28.55 | 32.75 | 28.5 | |
| TLMModel=LLAMA-3.1-8B2025.10 | 18.35 | 32.27 | 28.17 | 31.71 | 27.63 | |
| SYTTA-2Model=QWEN-2.5-14B, Reference Type=Dynamic-Ref2025.10 | 18.33 | 34.17 | 32.94 | 32.7 | 29.53 | |
| SYTTA-16Model=LLAMA-3.2-3B, Reference Type=Static-Ref2025.10 | 17.64 | 29.58 | 20.98 | 30.35 | 24.64 | |
| SYTTA-2Model=LLAMA-3.2-3B, Reference Type=Static-Ref2025.10 | 17.32 | 30.92 | 21.83 | 31.78 | 25.46 | |
| TentModel=QWEN-2.5-14B2025.10 | 16.99 | 31.07 | 20.08 | 30.96 | 24.78 | |
| SYTTA-2Model=QWEN-2.5-7B, Reference Type=Dynamic-Ref2025.10 | 16.98 | 33.17 | 31.41 | 31.76 | 28.33 | |
| SYTTA-16Model=LLAMA-3.1-8B, Reference Type=Static-Ref2025.10 | 16.93 | 32.31 | 24.8 | 32.09 | 26.53 | |
| SYTTA-4Model=LLAMA-3.1-8B, Reference Type=Static-Ref2025.10 | 16.87 | 32.85 | 27.38 | 32.26 | 27.34 | |
| EATAModel=QWEN-2.5-7B2025.10 | 16.31 | 31.91 | 16.76 | 29.61 | 23.65 | |
| TLMModel=LLAMA-3.2-3B2025.10 | 16.11 | 30.98 | 26.76 | 29.35 | 25.8 | |
| SYTTA-2Model=QWEN-2.5-14B, Reference Type=Static-Ref2025.10 | 15.91 | 33.67 | 32.27 | 31.29 | 28.28 | |
| SYTTA-2Model=QWEN-2.5-7B, Reference Type=Static-Ref2025.10 | 14.87 | 33.26 | 32.01 | 31.78 | 27.98 | |
| EATAModel=QWEN-2.5-14B2025.10 | 13.41 | 30.59 | 21.03 | 29.93 | 23.74 | |
| TLMModel=QWEN-2.5-14B2025.10 | 12.12 | 32.01 | 34.53 | 32.31 | 27.74 | |
| TLMModel=QWEN-2.5-7B2025.10 | 11.96 | 29.98 | 32.76 | 31.72 | 26.6 | |
| Base ModelModel=QWEN-2.5-14B2025.10 | 11.67 | 26.09 | 15.99 | 26.59 | 20.09 | |
| TentModel=LLAMA-3.1-8B2025.10 | 11.41 | 28.54 | 17.48 | 25.51 | 20.73 | |
| Base ModelModel=QWEN-2.5-7B2025.10 | 10.18 | 24.48 | 13.61 | 25.98 | 18.56 | |
| EATAModel=LLAMA-3.1-8B2025.10 | 9.66 | 27.71 | 15.97 | 13.89 | 16.81 | |
| EATAModel=LLAMA-3.2-3B2025.10 | 9.45 | 29.32 | 16.55 | 18.19 | 18.37 | |
| Base ModelModel=LLAMA-3.1-8B2025.10 | 9.36 | 24.92 | 15.07 | 23.61 | 18.24 | |
| Base ModelModel=LLAMA-3.2-3B2025.10 | 9.09 | 24.57 | 15.89 | 23.39 | 18.24 | |
| TentModel=LLAMA-3.2-3B2025.10 | 9.02 | 20.41 | 17.71 | 16.96 | 16.03 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Strategy=Dynamic-Ref2025.10 | 4.35 | 8.82 | 9.58 | 7.27 | 7.51 | |
| SYTTA-16Model=QWEN-2.5-14B, Reference Strategy=Static-Ref2025.10 | 4.24 | 9.62 | 4.23 | 6.46 | 6.14 | |
| SYTTA-8Model=QWEN-2.5-7B, Reference Strategy=Static-Ref2025.10 | 4.01 | 8.86 | 9.28 | 6.95 | 7.27 | |
| SYTTA-8Model=QWEN-2.5-14B, Reference Strategy=Dynamic-Ref2025.10 | 4 | 9.04 | 6.07 | 6.96 | 6.52 |