List your company
ResearchFormerly WizWand

Counterfactual Reasoning on Counterfactual Eval (dev)

63.4Mean ScorePE2
-0.24816.27632.849.324Nov 9, 2023
Updated 8mo ago

Evaluation results

MethodLinks
PE2Initialization=Induction, Sub-task=syntax_svo2023.1163.47.74
PE2Initialization=Induction, Sub-task=chess_original2023.1161.63.01
APOInitialization=Induction, Sub-task=chess_original2023.1159.22.04
PE2Initialization=Induction, Sub-task=arithmetic_base162023.11583.1
APOInitialization=Induction, Sub-task=syntax_svo2023.1157.87.88
APEInitialization=Induction, Sub-task=chess_original2023.1157.64.13
Iter. APEInitialization=Induction, Sub-task=chess_original2023.11563.52
PE2Initialization=Induction, Sub-task=syntax_sov2023.1155.64.8
APOInitialization=Induction, Sub-task=arithmetic_base162023.1155.45.46
Iter. APEInitialization=Induction, Sub-task=syntax_svo2023.1149.89.24
PE2Initialization=Induction, Sub-task=chess_cf2023.1149.65.57
APEInitialization=Induction, Sub-task=syntax_svo2023.1146.28.57
APOInitialization=Induction, Sub-task=syntax_sov2023.1146.27.47
PE2Initialization=Induction, Sub-task=syntax_ovs2023.1145.25.91
PE2Initialization=Induction, Sub-task=12-task average2023.1144.93—
Iter. APEInitialization=Induction, Sub-task=syntax_sov2023.1144.63.14
PE2Initialization=Induction, Sub-task=syntax_vos2023.114410.45
APOInitialization=Induction, Sub-task=chess_cf2023.11434.15
PE2Initialization=Induction, Sub-task=syntax_vso2023.1142.47.42
PE2Initialization=Induction, Sub-task=syntax_osv2023.1141.84.79
Iter. APEInitialization=Induction, Sub-task=chess_cf2023.1140.23.12
APEInitialization=Induction, Sub-task=chess_cf2023.11403.58
APOInitialization=Induction, Sub-task=arithmetic_base82023.1138.82.56
APEInitialization=Induction, Sub-task=syntax_sov2023.1138.28.28
APOInitialization=Induction, Sub-task=12-task average2023.1138.03—
PE2Initialization=Induction, Sub-task=arithmetic_base82023.1137.83.54
APOInitialization=Induction, Sub-task=syntax_vso2023.1136.811.41
APEInitialization=Induction, Sub-task=arithmetic_base162023.1134.410.61
APOInitialization=Induction, Sub-task=syntax_ovs2023.1133.86.01
APEInitialization=Induction, Sub-task=syntax_vos2023.1131.614.37
Iter. APEInitialization=Induction, Sub-task=arithmetic_base162023.1130.66.09
Iter. APEInitialization=Induction, Sub-task=syntax_vos2023.1130.613.92
APEInitialization=Induction, Sub-task=syntax_ovs2023.113010.58
Iter. APEInitialization=Induction, Sub-task=syntax_ovs2023.113010.58
Iter. APEInitialization=Induction, Sub-task=12-task average2023.1129.52—
PE2Initialization=Induction, Sub-task=arithmetic_base92023.1129.415.32
APEInitialization=Induction, Sub-task=12-task average2023.1129.02—
APOInitialization=Induction, Sub-task=syntax_vos2023.1128.89.13
APOInitialization=Induction, Sub-task=syntax_osv2023.1127.811.02
APEInitialization=Induction, Sub-task=syntax_vso2023.112611.35
Iter. APEInitialization=Induction, Sub-task=syntax_vso2023.1124.411.64
APOInitialization=Induction, Sub-task=arithmetic_base92023.1123.819.74
Iter. APEInitialization=Induction, Sub-task=arithmetic_base82023.1120.216.57
APEInitialization=Induction, Sub-task=arithmetic_base82023.111915.53
Iter. APEInitialization=Induction, Sub-task=syntax_osv2023.1113.610.71
Iter. APEInitialization=Induction, Sub-task=arithmetic_base92023.111216.84
APEInitialization=Induction, Sub-task=syntax_osv2023.1111.68.89
APEInitialization=Induction, Sub-task=arithmetic_base92023.1111.215.38
PE2Initialization=Induction, Sub-task=arithmetic_base112023.1110.45.5
APOInitialization=Induction, Sub-task=arithmetic_base112023.1152.19
APEInitialization=Induction, Sub-task=arithmetic_base112023.112.41.5
Iter. APEInitialization=Induction, Sub-task=arithmetic_base112023.112.21.33