Reward Model Transfer on Anthropic Helpful (AH)
9.95AOGSEAM
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | 9.95 | — | — | -5.72 | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | 8.2 | — | — | -3.39 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | 8.19 | — | — | 8.19 | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | 8.06 | — | — | 5.94 | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 5.88 | — | — | 3.5 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 4.41 | — | — | 4.41 | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 3.26 | — | — | 3.08 | |
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 3.13 | — | — | 3.13 | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | 1.46 | — | — | 1.46 | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 1.37 | — | — | 0.96 | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 0.6 | — | — | 0.6 | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 0.25 | — | — | 0.25 | |
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=UF, Evaluation Setting=Zero-shot transfer2026.05 | 0.17 | — | — | -6.48 | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | -0.04 | — | — | -3.1 | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | -1.58 | — | — | -3.88 | |
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=H3, Evaluation Setting=Zero-shot transfer2026.05 | -2.61 | — | — | -2.61 | |
| ANCHORTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 106.9 | 3.39 | — | |
| ANCHORTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 1 | 2.75 | — | |
| Conf.-basedTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 70.3 | 2.23 | — | |
| Conf.-basedTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 661.5 | 1.72 | — | |
| NaiveTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 98.7 | 3.13 | — | |
| NaiveTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | 173.1 | 0.45 | — | |
| SEAMTransfer Pair=Llama-3.2-1B-Instruct -> Llama-3.1-8B-Instruct, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | -411.4 | -13.04 | — | |
| SEAMTransfer Pair=Qwen3-1.7B -> Qwen3-8B, Source Domain=AH, Evaluation Setting=In-distribution2026.05 | — | -1.3 | -3.42 | — |