Feedback Evaluation Alignment on FLASK
0.405Kendall's TauPrometheus-2-7B
Evaluation results
| Method | Links | |
|---|---|---|
| Prometheus-2-7BCoT=true, Training objective=Prometheus-2-7B, Inference method=Decode2025.03 | 0.405 | |
| Mistral-7B-Instruct + RAFTCoT=false, Training objective=RAFT, Data source=GPT-4 (score only), Inference method=RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.375 | |
| TRACTCoT=true, Training objective=C-RAFT, Data source=Self, Inference method=C-RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.373 | |
| Mistral-7B-Instruct + CE (GPT-4 CoT)CoT=true, Training objective=CE, Data source=GPT-4, Inference method=Decode, Backbone=Mistral-7B-Instruct2025.03 | 0.328 | |
| Mistral-7B-Instruct + CE (GPT-4 Score)CoT=false, Training objective=CE, Data source=GPT-4 (score only), Inference method=Decode, Backbone=Mistral-7B-Instruct2025.03 | 0.294 | |
| Mistral-7B-Instruct + RAIL BaselineCoT=false, Inference method=RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.109 |