Fact Verification on FEVER (val)
0.555True Deferral-Advice Lossaugmented surrogate
Evaluation results
| Method | Links | |
|---|---|---|
| augmented surrogateadvice-cost multiplier λ=02026.03 | 0.555 | |
| augmented surrogateadvice-cost multiplier λ=0.52026.03 | 0.558 | |
| augmented surrogateadvice-cost multiplier λ=12026.03 | 0.566 | |
| augmented surrogateadvice-cost multiplier λ=22026.03 | 0.58 | |
| augmented surrogateadvice-cost multiplier λ=42026.03 | 0.596 | |
| augmented surrogateadvice-cost multiplier λ=62026.03 | 0.607 | |
| Best fixedadvice-cost multiplier λ=02026.03 | 0.611 | |
| augmented surrogateadvice-cost multiplier λ=82026.03 | 0.613 | |
| augmented surrogateadvice-cost multiplier λ=102026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=02026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=0.52026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=12026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=22026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=42026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=62026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=82026.03 | 0.619 | |
| L2Dadvice-cost multiplier λ=102026.03 | 0.619 | |
| Best fixedadvice-cost multiplier λ=0.52026.03 | 0.619 | |
| Best fixedadvice-cost multiplier λ=12026.03 | 0.626 | |
| Learned j, random kadvice-cost multiplier λ=02026.03 | 0.633 | |
| Learned j, random kadvice-cost multiplier λ=0.52026.03 | 0.64 | |
| Random j, learned kadvice-cost multiplier λ=02026.03 | 0.64 | |
| Best fixedadvice-cost multiplier λ=22026.03 | 0.641 | |
| Learned j, random kadvice-cost multiplier λ=12026.03 | 0.647 | |
| Random j, learned kadvice-cost multiplier λ=0.52026.03 | 0.657 | |
| Learned j, random kadvice-cost multiplier λ=22026.03 | 0.662 | |
| Random j, learned kadvice-cost multiplier λ=12026.03 | 0.664 | |
| Best fixedadvice-cost multiplier λ=42026.03 | 0.671 | |
| Random j, learned kadvice-cost multiplier λ=22026.03 | 0.674 | |
| Random (j, k)advice-cost multiplier λ=02026.03 | 0.675 | |
| Random (j, k)advice-cost multiplier λ=0.52026.03 | 0.682 | |
| Random (j, k)advice-cost multiplier λ=12026.03 | 0.69 | |
| Best fixedadvice-cost multiplier λ=62026.03 | 0.695 | |
| Best fixedadvice-cost multiplier λ=82026.03 | 0.695 | |
| Best fixedadvice-cost multiplier λ=102026.03 | 0.695 | |
| Learned j, random kadvice-cost multiplier λ=42026.03 | 0.695 | |
| Random j, learned kadvice-cost multiplier λ=42026.03 | 0.695 | |
| Random j, learned kadvice-cost multiplier λ=62026.03 | 0.704 | |
| Random (j, k)advice-cost multiplier λ=22026.03 | 0.705 | |
| Random j, learned kadvice-cost multiplier λ=82026.03 | 0.711 | |
| Random j, learned kadvice-cost multiplier λ=102026.03 | 0.715 | |
| Learned j, random kadvice-cost multiplier λ=62026.03 | 0.723 | |
| Random (j, k)advice-cost multiplier λ=42026.03 | 0.735 | |
| Learned j, random kadvice-cost multiplier λ=82026.03 | 0.76 | |
| Random (j, k)advice-cost multiplier λ=62026.03 | 0.765 | |
| Learned j, random kadvice-cost multiplier λ=102026.03 | 0.788 | |
| Random (j, k)advice-cost multiplier λ=82026.03 | 0.795 | |
| Random (j, k)advice-cost multiplier λ=102026.03 | 0.825 |