Schwartz Value (3-class) Evaluation on ValEval (Original)
76.29Accuracy (3-class)Mistral-7b
Evaluation Results
| Method | Links | |
|---|---|---|
| Mistral-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 76.29 | |
| CLAVE-MistralEvaluation Protocol=Tuning-based Evaluation, Backbone=Mistral-7b2024.07 | 75.26 | |
| Phi-3Evaluation Protocol=Tuning-based Evaluation, Backbone=Phi-32024.07 | 71.93 | |
| CLAVE-LlamaEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 69.85 | |
| GPT-2-LargeEvaluation Protocol=Tuning-based Evaluation, Backbone=GPT-2-Large2024.07 | 69.02 | |
| Llama2-7bEvaluation Protocol=Tuning-based Evaluation, Backbone=Llama2-7b2024.07 | 64.26 | |
| CrowdworkerEvaluation Protocol=Tuning-based Evaluation2024.07 | 60.21 | |
| CalibrateEvaluation Protocol=Prompt-based Evaluation2024.07 | 55.53 | |
| VanillaEvaluation Protocol=Prompt-based Evaluation2024.07 | 54.79 | |
| Few-shotEvaluation Protocol=Prompt-based Evaluation2024.07 | 54.29 | |
| Chain-of-thoughtEvaluation Protocol=Prompt-based Evaluation2024.07 | 54.04 | |
| AllureEvaluation Protocol=Prompt-based Evaluation2024.07 | 53.59 | |
| G-EvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 52.76 | |
| FairEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 40.83 | |
| WideDeepEvaluation Protocol=Prompt-based Evaluation2024.07 | 25 | |
| ChatEvalEvaluation Protocol=Prompt-based Evaluation2024.07 | 16.46 |