Quality Assessment on Checklist
3.76Metric Agpt-4o
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| gpt-4oSampling strategy=Temperature (t=0.0)2025.09 | 3.76 | 4.61 | 4.61 | 4 | 4.62 | 4.4 | 4.76 | 4.78 | |
| gpt-4oSampling strategy=Temperature (t=1.0)2025.09 | 3.74 | 4.65 | 4.58 | 3.98 | 4.66 | 4.41 | 4.78 | 4.78 | |
| gpt-4oSampling strategy=Temperature (t=2.0)2025.09 | 3.66 | 4.73 | 4.52 | 3.99 | 4.63 | 4.37 | 4.74 | 4.77 | |
| gpt-4oSampling strategy=In-Context Regeneration (Task-Dependent)2025.09 | 3.54 | 4.81 | 4.33 | 3.97 | 4.26 | 4 | 4.63 | 4.13 | |
| gpt-4oSampling strategy=System Prompt (General)2025.09 | 3.52 | 4.56 | 4.3 | 3.83 | 4.01 | 3.82 | 4.7 | 4.34 | |
| gpt-4oSampling strategy=System Prompt (Task-Dependent)2025.09 | 3.48 | 4.72 | 4.32 | 3.47 | 3.66 | 3.39 | 4.45 | 4.12 | |
| gemini-2.5-flashSampling strategy=Temperature (t=0.0)2025.09 | 3.45 | 4.7 | 4.35 | 4.13 | 4.8 | 4.31 | 4.81 | 4.56 | |
| gemini-2.5-flashSampling strategy=System Prompt (General)2025.09 | 3.45 | 4.82 | 4.21 | 4.42 | 4.42 | 3.95 | 4.68 | 4.44 | |
| gemini-2.5-flashSampling strategy=System Prompt (Task-Dependent)2025.09 | 3.4 | 4.89 | 4.33 | 4.26 | 4.41 | 3.49 | 4.41 | 4.26 | |
| gpt-4oSampling strategy=In-Context Regeneration (General)2025.09 | 3.37 | 4.71 | 4.3 | 3.92 | 4.42 | 4.11 | 4.66 | 4.14 | |
| gemini-2.5-flashSampling strategy=Temperature (t=1.0)2025.09 | 3.37 | 4.81 | 4.41 | 4.07 | 4.81 | 4.32 | 4.73 | 4.57 | |
| gemini-2.5-flashSampling strategy=Temperature (t=2.0)2025.09 | 3.35 | 4.85 | 4.45 | 4.05 | 4.79 | 4.23 | 4.73 | 4.54 | |
| gemini-2.5-flashSampling strategy=In-Context Regeneration (Task-Dependent)2025.09 | 3.31 | 4.88 | 4.43 | 3.93 | 4.7 | 4.12 | 4.52 | 4.33 | |
| claude-4-sonnetSampling strategy=System Prompt (Task-Dependent)2025.09 | 3.26 | 4.35 | 4.37 | 4.17 | 4.03 | 3.79 | 4.6 | 4.24 | |
| claude-4-sonnetSampling strategy=In-Context Regeneration (General)2025.09 | 3.19 | 4.63 | 4.33 | 4.3 | 4.59 | 4.36 | 4.72 | 4.7 | |
| claude-4-sonnetSampling strategy=In-Context Regeneration (Task-Dependent)2025.09 | 3.14 | 4.62 | 4.52 | 3.94 | 4.22 | 4.16 | 4.53 | 4.38 | |
| claude-4-sonnetSampling strategy=System Prompt (General)2025.09 | 3.14 | 4.43 | 4.43 | 4.3 | 4.22 | 4.17 | 4.6 | 4.53 | |
| gemini-2.5-flashSampling strategy=In-Context Regeneration (General)2025.09 | 3.13 | 4.82 | 4.26 | 4.13 | 4.79 | 4.21 | 4.69 | 4.32 | |
| claude-4-sonnetSampling strategy=Temperature (t=0.5)2025.09 | 3.09 | 4.68 | 4.19 | 4.24 | 4.75 | 4.45 | 4.69 | 4.86 | |
| claude-4-sonnetSampling strategy=Temperature (t=1.0)2025.09 | 3.09 | 4.67 | 4.23 | 4.33 | 4.76 | 4.45 | 4.73 | 4.85 | |
| claude-4-sonnetSampling strategy=Temperature (t=0.0)2025.09 | 3.05 | 4.7 | 4.12 | 4.29 | 4.79 | 4.43 | 4.65 | 4.85 | |
| Llama-3.1-8B-InstructSampling strategy=System Prompt (Task-Dependent)2025.09 | 2.72 | 4.42 | 3.88 | 2.51 | 2.23 | 2.48 | 3.77 | 3.61 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=In-Context Regeneration (General)2025.09 | 2.64 | 4.15 | 3.44 | 1.89 | 2.95 | 3.36 | 3.75 | 4.17 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=Temperature (t=0.0)2025.09 | 2.58 | 4.05 | 3.37 | 1.9 | 3.22 | 3.63 | 3.75 | 4.37 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=In-Context Regeneration (Task-Dependent)2025.09 | 2.57 | 4 | 3.6 | 1.84 | 2.7 | 3.06 | 3.45 | 3.94 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=System Prompt (Task-Dependent)2025.09 | 2.55 | 4.21 | 3.13 | 1.66 | 2.08 | 2.22 | 3.12 | 3.25 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=Temperature (t=0.5)2025.09 | 2.54 | 3.97 | 3.2 | 1.83 | 3.15 | 3.62 | 3.82 | 4.39 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=System Prompt (General)2025.09 | 2.48 | 3.99 | 3.07 | 1.5 | 2.24 | 2.54 | 3.45 | 3.59 | |
| Mistral-7B-Instruct-v0.3Sampling strategy=Temperature (t=1.0)2025.09 | 2.41 | 4.08 | 3.29 | 1.71 | 3.12 | 3.61 | 3.86 | 4.35 | |
| Llama-3.1-8B-InstructSampling strategy=System Prompt (General)2025.09 | 2.22 | 4.19 | 4.05 | 2.79 | 2.38 | 2.98 | 3.95 | 3.74 | |
| Llama-3.1-8B-InstructSampling strategy=In-Context Regeneration (General)2025.09 | 2.21 | 4.68 | 4.12 | 3.04 | 2.85 | 3.44 | 4.37 | 4.28 | |
| Llama-3.1-8B-InstructSampling strategy=In-Context Regeneration (Task-Dependent)2025.09 | 2.07 | 4.59 | 4.13 | 2.62 | 2.49 | 2.93 | 3.78 | 3.97 | |
| Llama-3.1-8B-InstructSampling strategy=Temperature (t=0.0)2025.09 | 1.99 | 4.54 | 4.23 | 3.09 | 3.01 | 3.57 | 4.31 | 4.52 | |
| Llama-3.1-8B-InstructSampling strategy=Temperature (t=0.5)2025.09 | 1.98 | 4.59 | 4.18 | 3.02 | 3.1 | 3.7 | 4.23 | 4.53 | |
| Llama-3.1-8B-InstructSampling strategy=Temperature (t=1.0)2025.09 | 1.97 | 4.48 | 4.22 | 2.93 | 3 | 3.61 | 4.4 | 4.5 |