# Argument Quality Assessment on Webis-ArgQuality 20 Source: [Argument Quality Assessment on Webis-ArgQuality 20]() Collection index: [llms.txt]() Data updated: 2026-05-28T09:42:12.723Z Evaluation of model performance on argument quality assessment using the Webis-ArgQuality 20 dataset, measured using correlation and agreement metrics such as Pearson (r), RMSE, and Kendall's Tau. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Argument Quality Assessment | | Dataset (including any stated split) | Webis-ArgQuality 20 | | Metric | Pearson Correlation (r) | | Unit | SCALAR | | Direction | Higher is better | | Results loaded | 36 of 36 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Pearson Correlation (r)](): Higher is better; unit: SCALAR. - [Spearman Correlation (ρ)](): Higher is better; unit: SCALAR. - [Kendall's Tau](): Higher is better; unit: SCALAR. - [Mean Absolute Error (MAE)](): Lower is better; unit: SCALAR. - [Root Mean Square Error (RMSE)](): Lower is better; unit: SCALAR. - [Kappa IAA](): Higher is better; unit: SCALAR. - [Agreement (%)](): Higher is better; unit: PERCENT. ## Recorded results | Method | Pearson Correlation (r) | Result date | Report paper | | --- | --- | --- | --- | | Llama-70B | 0.473 | Not recorded | 6a17cc45dbd7150506f814be | | Llama-70B | 0.465 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-72B | 0.463 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-72B | 0.453 | Not recorded | 6a17cc45dbd7150506f814be | | Llama-70B | 0.442 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-72B | 0.435 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-32B | 0.402 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-32B | 0.398 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-104B | 0.392 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-7B | 0.37 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-104B | 0.365 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-7B | 0.354 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-104B | 0.354 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-7B | 0.345 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-7B | 0.322 | Not recorded | 6a17cc45dbd7150506f814be | | Command-R-7B | 0.301 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-32B | 0.296 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x22B | 0.29 | Not recorded | 6a17cc45dbd7150506f814be | | Llama-8B | 0.258 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x22B | 0.237 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x7B | 0.233 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-7B | 0.232 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-7B | 0.221 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x22B | 0.218 | Not recorded | 6a17cc45dbd7150506f814be | | Qwen2.5-7B | 0.188 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x7B | 0.174 | Not recorded | 6a17cc45dbd7150506f814be | | Llama-8B | 0.155 | Not recorded | 6a17cc45dbd7150506f814be | | Mixtral-8x7B | 0.093 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-7B | 0.082 | Not recorded | 6a17cc45dbd7150506f814be | | Llama-8B | 0.057 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-7B | 0.002 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-7B | -0.034 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-22B | -0.047 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-22B | -0.072 | Not recorded | 6a17cc45dbd7150506f814be | | Mistral-22B | -0.086 | Not recorded | 6a17cc45dbd7150506f814be | | Olmo2-7B | -0.087 | Not recorded | 6a17cc45dbd7150506f814be | ### Llama-70B Pearson Correlation (r): 0.473. Result ID: 6a180d7dfbc373592c12330e. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Llama-70B Pearson Correlation (r): 0.465. Result ID: 6a180d7dfbc373592c12330f. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Qwen2.5-72B Pearson Correlation (r): 0.463. Result ID: 6a180d7dfbc373592c123310. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Qwen2.5-72B Pearson Correlation (r): 0.453. Result ID: 6a180d7dfbc373592c123311. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Llama-70B Pearson Correlation (r): 0.442. Result ID: 6a180d7dfbc373592c12330d. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Qwen2.5-72B Pearson Correlation (r): 0.435. Result ID: 6a180d7dfbc373592c123312. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Olmo2-32B Pearson Correlation (r): 0.402. Result ID: 6a180d7dfbc373592c123307. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Olmo2-32B Pearson Correlation (r): 0.398. Result ID: 6a180d7dfbc373592c123309. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Command-R-104B Pearson Correlation (r): 0.392. Result ID: 6a180d7dfbc373592c123314. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Command-R-7B Pearson Correlation (r): 0.37. Result ID: 6a180d7dfbc373592c1232fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Command-R-104B Pearson Correlation (r): 0.365. Result ID: 6a180d7dfbc373592c123313. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Qwen2.5-7B Pearson Correlation (r): 0.354. Result ID: 6a180d7dfbc373592c1232fc. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Command-R-104B Pearson Correlation (r): 0.354. Result ID: 6a180d7dfbc373592c123315. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Command-R-7B Pearson Correlation (r): 0.345. Result ID: 6a180d7dfbc373592c123300. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Qwen2.5-7B Pearson Correlation (r): 0.322. Result ID: 6a180d7dfbc373592c1232fb. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Command-R-7B Pearson Correlation (r): 0.301. Result ID: 6a180d7dfbc373592c1232ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Olmo2-32B Pearson Correlation (r): 0.296. Result ID: 6a180d7dfbc373592c123308. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Mixtral-8x22B Pearson Correlation (r): 0.29. Result ID: 6a180d7dfbc373592c12330b. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Llama-8B Pearson Correlation (r): 0.258. Result ID: 6a180d7dfbc373592c1232f5. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Mixtral-8x22B Pearson Correlation (r): 0.237. Result ID: 6a180d7dfbc373592c12330a. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Mixtral-8x7B Pearson Correlation (r): 0.233. Result ID: 6a180d7dfbc373592c123302. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Mistral-7B Pearson Correlation (r): 0.232. Result ID: 6a180d7dfbc373592c1232f2. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Mistral-7B Pearson Correlation (r): 0.221. Result ID: 6a180d7dfbc373592c1232f4. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Mixtral-8x22B Pearson Correlation (r): 0.218. Result ID: 6a180d7dfbc373592c12330c. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Qwen2.5-7B Pearson Correlation (r): 0.188. Result ID: 6a180d7dfbc373592c1232fd. [Reporting paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Mixtral-8x7B Pearson Correlation (r): 0.174. Result ID: 6a180d7dfbc373592c123301. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Llama-8B Pearson Correlation (r): 0.155. Result ID: 6a180d7dfbc373592c1232f6. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Mixtral-8x7B Pearson Correlation (r): 0.093. Result ID: 6a180d7dfbc373592c123303. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Mistral-7B Pearson Correlation (r): 0.082. Result ID: 6a180d7dfbc373592c1232f3. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Llama-8B Pearson Correlation (r): 0.057. Result ID: 6a180d7dfbc373592c1232f7. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Olmo2-7B Pearson Correlation (r): 0.002. Result ID: 6a180d7dfbc373592c1232fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Olmo2-7B Pearson Correlation (r): -0.034. Result ID: 6a180d7dfbc373592c1232f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Mistral-22B Pearson Correlation (r): -0.047. Result ID: 6a180d7dfbc373592c123305. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. ### Mistral-22B Pearson Correlation (r): -0.072. Result ID: 6a180d7dfbc373592c123306. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"cot"}. This record does not assert independent reproduction. ### Mistral-22B Pearson Correlation (r): -0.086. Result ID: 6a180d7dfbc373592c123304. [Reporting paper]() [Method origin paper]() [Implementation]() Recorded evaluation configuration: {"Prompt":"zero"}. This record does not assert independent reproduction. ### Olmo2-7B Pearson Correlation (r): -0.087. Result ID: 6a180d7dfbc373592c1232f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Prompt":"few"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.