CoMIX-SHIFT
Benchmarks
TaskDatasetSOTA resultTrendResults
CoMIX-SHIFT Triple shift
91.1Exact Match (EM)
4
CoMIX-SHIFT (Template holdout)
49.8Exact Match (EM)
4
CoMIX-SHIFT Long shift
62.5Exact Match (EM)
4
CoMIX-SHIFT Pair shift
93.9EM
4
CoMIX-SHIFT (Unseen)
95.7Exact Match (EM)
4
CoMIX-SHIFT (Seen)
100Exact Match (EM)
4