Claim Verification on Climate-FEVER MVR-50
100Commit Rateconfidence_weighted_vote
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| confidence_weighted_voteMode=static, emits_quorum_certificate=no2026.06 | 100 | 28 | 12 | 8.3 | |
| confidence_weighted_voteMode=rushing, emits_quorum_certificate=no2026.06 | 100 | 28 | 12 | 2.3 | |
| all_nodes_gmMode=static, emits_quorum_certificate=no2026.06 | 100 | 28 | 4 | 20 | |
| all_nodes_gmMode=rushing, emits_quorum_certificate=no2026.06 | 100 | 26 | 6 | 20 | |
| angular_threshold_gmMode=static, emits_quorum_certificate=no2026.06 | 100 | 28 | 8 | 3.5 | |
| angular_threshold_gmMode=rushing, emits_quorum_certificate=no2026.06 | 100 | 28 | 8 | 0.6 | |
| majority_voteMode=rushing, emits_quorum_certificate=no2026.06 | 94 | 24 | 0 | 0 | |
| B1 abstaining_majorityMode=static, emits_quorum_certificate=yes2026.06 | 94 | 24 | 6 | 11.1 | |
| B1 abstaining_majorityMode=rushing, emits_quorum_certificate=yes2026.06 | 94 | 24 | 2 | 1.1 | |
| B2 margin_majority (m=1)Mode=rushing, emits_quorum_certificate=yes2026.06 | 92 | 22 | 0 | 0 | |
| B3 cert. + majorityMode=rushing, emits_quorum_certificate=yes2026.06 | 92 | 22 | 0 | 0 | |
| H-CSCMode=rushing, emits_quorum_certificate=yes2026.06 | 92 | 22 | 0 | 0 | |
| majority_voteMode=static, emits_quorum_certificate=no2026.06 | 90 | 22 | 0 | 5.4 | |
| H-CSCMode=static, emits_quorum_certificate=yes2026.06 | 90 | 22 | 2 | 6.9 | |
| B2 margin_majority (m=1)Mode=static, emits_quorum_certificate=yes2026.06 | 88 | 20 | 0 | 9 | |
| B3 cert. + majorityMode=static, emits_quorum_certificate=yes2026.06 | 88 | 20 | 0 | 8.8 | |
| V1 verdict-cond. sem.Mode=static, emits_quorum_certificate=yes2026.06 | 82 | 22 | 2 | 3.4 | |
| V1 verdict-cond. sem.Mode=rushing, emits_quorum_certificate=yes2026.06 | 80 | 22 | 0 | 0 | |
| CSC strict-semantic (B0)Mode=static, emits_quorum_certificate=yes2026.06 | 54 | 16 | 2 | 2.1 | |
| CSC strict-semantic (B0)Mode=rushing, emits_quorum_certificate=yes2026.06 | 48 | 12 | 2 | 0.6 |