Reward Modeling on RewardBench Average 2
39.7AccuracyFLIP
Evaluation results
| Method | Links | |
|---|---|---|
| FLIPModel Family=QWEN3, Model Size=8B2026.02 | 39.7 | |
| FLIPModel Family=QWEN3, Model Size=4B2026.02 | 38.1 | |
| FLIPModel Family=MISTRAL, Model Size=7B2026.02 | 37.3 | |
| FLIPModel Family=QWEN3, Model Size=0.6B2026.02 | 36.3 | |
| FLIPModel Family=GEMMA3, Model Size=4B2026.02 | 35.7 | |
| FLIPModel Family=QWEN3, Model Size=1.7B2026.02 | 35.5 | |
| FLIPModel Family=OLMO2, Model Size=7B2026.02 | 35.3 | |
| FLIPModel Family=LLAMA3, Model Size=8B2026.02 | 35.1 | |
| FLIPModel Family=OLMO2, Model Size=1B2026.02 | 33.1 | |
| FLIPModel Family=GEMMA3, Model Size=1B2026.02 | 33.1 | |
| Pointwise RatingModel Family=QWEN3, Model Size=8B2026.02 | 32.2 | |
| FLIPModel Family=GEMMA3, Model Size=270M2026.02 | 31.2 | |
| Listwise Ranking*Model Family=MISTRAL, Model Size=7B2026.02 | 30.6 | |
| Listwise Ranking*Model Family=GEMMA3, Model Size=4B2026.02 | 30 | |
| Pointwise RatingModel Family=QWEN3, Model Size=4B2026.02 | 29.9 | |
| FLIPModel Family=LLAMA3, Model Size=1B2026.02 | 29.8 | |
| Listwise Ranking*Model Family=LLAMA3, Model Size=8B2026.02 | 29.1 | |
| Pairwise Ranking*Model Family=GEMMA3, Model Size=4B2026.02 | 28.3 | |
| FLIPModel Family=LLAMA3, Model Size=3B2026.02 | 28.2 | |
| Pairwise Ranking*Model Family=MISTRAL, Model Size=7B2026.02 | 27.3 | |
| Pairwise Ranking*Model Family=QWEN3, Model Size=4B2026.02 | 26.9 | |
| Pairwise Ranking*Model Family=QWEN3, Model Size=1.7B2026.02 | 25.9 | |
| Pairwise Ranking*Model Family=OLMO2, Model Size=7B2026.02 | 24.8 | |
| Pairwise Ranking*Model Family=QWEN3, Model Size=8B2026.02 | 24.8 | |
| Pointwise RatingModel Family=QWEN3, Model Size=1.7B2026.02 | 24 | |
| Listwise Ranking*Model Family=QWEN3, Model Size=1.7B2026.02 | 24 | |
| Pairwise Ranking*Model Family=LLAMA3, Model Size=8B2026.02 | 23.2 | |
| Pairwise Ranking*Model Family=GEMMA3, Model Size=1B2026.02 | 22.8 | |
| Listwise Ranking*Model Family=OLMO2, Model Size=7B2026.02 | 22.1 | |
| Listwise Ranking*Model Family=GEMMA3, Model Size=1B2026.02 | 21.9 | |
| Listwise Ranking*Model Family=LLAMA3, Model Size=3B2026.02 | 21.1 | |
| Listwise Ranking*Model Family=OLMO2, Model Size=1B2026.02 | 19.3 | |
| Pointwise RatingModel Family=GEMMA3, Model Size=4B2026.02 | 17.7 | |
| Pointwise RatingModel Family=LLAMA3, Model Size=1B2026.02 | 16.5 | |
| Pointwise RatingModel Family=GEMMA3, Model Size=270M2026.02 | 16.5 | |
| Pointwise RatingModel Family=QWEN3, Model Size=0.6B2026.02 | 16.2 | |
| Pairwise Ranking*Model Family=LLAMA3, Model Size=3B2026.02 | 15.7 | |
| Listwise Ranking*Model Family=LLAMA3, Model Size=1B2026.02 | 15.5 | |
| Pointwise RatingModel Family=LLAMA3, Model Size=8B2026.02 | 15.5 | |
| Listwise Ranking*Model Family=QWEN3, Model Size=8B2026.02 | 15.3 | |
| Listwise Ranking*Model Family=QWEN3, Model Size=0.6B2026.02 | 15 | |
| Listwise Ranking*Model Family=QWEN3, Model Size=4B2026.02 | 14.9 | |
| Pointwise RatingModel Family=LLAMA3, Model Size=3B2026.02 | 13.9 | |
| Listwise Ranking*Model Family=GEMMA3, Model Size=270M2026.02 | 13.8 | |
| Pairwise Ranking*Model Family=QWEN3, Model Size=0.6B2026.02 | 13.7 | |
| Pointwise RatingModel Family=GEMMA3, Model Size=1B2026.02 | 13.3 | |
| Pointwise RatingModel Family=OLMO2, Model Size=1B2026.02 | 13.1 | |
| Pairwise Ranking*Model Family=GEMMA3, Model Size=270M2026.02 | 11.1 | |
| Pairwise Ranking*Model Family=LLAMA3, Model Size=1B2026.02 | 10.3 | |
| Pointwise RatingModel Family=OLMO2, Model Size=7B2026.02 | 8.9 | |
| Pointwise RatingModel Family=MISTRAL, Model Size=7B2026.02 | 7.9 | |
| Pairwise Ranking*Model Family=OLMO2, Model Size=1B2026.02 | 1.7 |