Feedback Evaluation Alignment on Vicuna Bench
0.423Kendall's TauTRACT
Evaluation results
| Method | Links | |
|---|---|---|
| TRACTCoT=true, Training objective=C-RAFT, Data source=Self, Inference method=C-RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.423 | |
| Prometheus-2-7BCoT=true, Training objective=Prometheus-2-7B, Inference method=Decode2025.03 | 0.411 | |
| Mistral-7B-Instruct + RAFTCoT=false, Training objective=RAFT, Data source=GPT-4 (score only), Inference method=RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.401 | |
| Mistral-7B-Instruct + CE (GPT-4 CoT)CoT=true, Training objective=CE, Data source=GPT-4, Inference method=Decode, Backbone=Mistral-7B-Instruct2025.03 | 0.38 | |
| Mistral-7B-Instruct + CE (GPT-4 Score)CoT=false, Training objective=CE, Data source=GPT-4 (score only), Inference method=Decode, Backbone=Mistral-7B-Instruct2025.03 | 0.344 | |
| Mistral-7B-Instruct + RAIL BaselineCoT=false, Inference method=RAIL, Backbone=Mistral-7B-Instruct2025.03 | 0.122 |