Reward Model Transfer on HelpSteer3 (H3) v1 (test)
8.96AOGANCHOR
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 8.96 | — | — | 8.96 | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 6.78 | — | — | 6.78 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 6.01 | — | — | 6.01 | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 5.79 | — | — | 5.79 | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 5.57 | — | — | 5.57 | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 4.59 | — | — | 4.59 | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 3.83 | — | — | 3.83 | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 3.61 | — | — | 3.2 | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 3.39 | — | — | 3.39 | |
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 3.28 | — | — | 3.28 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 2.08 | — | — | 2.08 | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 1.42 | — | — | 1.24 | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | 0.55 | — | — | -2.87 | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | -1.85 | — | — | -4.23 | |
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | -5.68 | — | — | -12.33 | |
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=Zero-shot transfer2026.05 | -6.01 | — | — | -19.05 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | 67.2 | 3.57 | — | |
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | 9.5 | 0.33 | — | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | -39.9 | -2.12 | — | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | -65.9 | -2.3 | — | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | 32.23 | 1.71 | — | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | -87.7 | -3.06 | — | |
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | -295.1 | -15.67 | — | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=In-distribution2026.05 | — | -332.1 | -11.59 | — |