Social Risks (2-class) Evaluation on ValEval Generalized
92.16AccuracyChatEval
Evaluation Results
| Method | Links | |
|---|---|---|
| ChatEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 92.16 | |
| FairEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 91.08 | |
| WideDeepEvaluation Protocol=Prompt-based Evaluation2024.07 | 90.54 | |
| VanillaEvaluation Protocol=Prompt-based Evaluation2024.07 | 89.6 | |
| CalibrateEvaluation Protocol=Prompt-based Evaluation2024.07 | 89.6 | |
| Chain-of-thoughtEvaluation Protocol=Prompt-based Evaluation2024.07 | 89.53 | |
| CrowdworkerEvaluation Protocol=Tuning-based Evaluation2024.07 | 89.18 | |
| CLAVE-MistralEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 88.65 | |
| Few-shotEvaluation Protocol=Prompt-based Evaluation2024.07 | 88.11 | |
| AllureEvaluation Protocol=Prompt-based Evaluation2024.07 | 88.11 | |
| G-EvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 87.23 | |
| CLAVE-LlamaEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 85.41 | |
| Mistral-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 53.51 | |
| Phi-3Evaluation Protocol=Tuning-based Evaluation, Backbone=Phi-32024.07 | 48.11 | |
| GPT-2-LargeEvaluation Protocol=Tuning-based Evaluation, Backbone=GPT-2-Large2024.07 | 24.59 | |
| Llama2-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 22.43 |