Schwartz Value (3-class) Evaluation on ValEval Generalized
88.91AccuracyCrowdworker
Evaluation Results
| Method | Links | |
|---|---|---|
| CrowdworkerEvaluation Protocol=Tuning-based Evaluation2024.07 | 88.91 | |
| CLAVE-LlamaEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 83.71 | |
| CLAVE-MistralEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 82.45 | |
| FairEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 82.35 | |
| ChatEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 82.35 | |
| WideDeepEvaluation Protocol=Prompt-based Evaluation2024.07 | 82.35 | |
| Mistral-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 78.19 | |
| Llama2-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 77.69 | |
| GPT-2-LargeEvaluation Protocol=Tuning-based Evaluation, Backbone=GPT-2-Large2024.07 | 77.36 | |
| Chain-of-thoughtEvaluation Protocol=Prompt-based Evaluation2024.07 | 73.68 | |
| Phi-3Evaluation Protocol=Tuning-based Evaluation, Backbone=Phi-32024.07 | 72.93 | |
| VanillaEvaluation Protocol=Prompt-based Evaluation2024.07 | 71.62 | |
| CalibrateEvaluation Protocol=Prompt-based Evaluation2024.07 | 70.74 | |
| G-EvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 69.36 | |
| AllureEvaluation Protocol=Prompt-based Evaluation2024.07 | 67.86 | |
| Few-shotEvaluation Protocol=Prompt-based Evaluation2024.07 | 66.98 |