List your company

Systematic Generalization on SCAN Add Jump (test)

99.8AccuracyG-GRU
-3.99222.95449.976.846May 17, 2023

Evaluation results

MethodLinks
G-GRUGroup=Verb, Training iterations=200K2023.0599.8
G-LSTMGroup=Verb, Training Iterations=200K, Evaluation Protocol=trained2023.0598.3
EquiLSTMGroup=Verb, Training Iterations=10K, Evaluation Protocol=fine-tuned2023.0597.9
EquiZeroLSTMGroup=Verb, Training Iterations=10K, Evaluation Protocol=fine-tuned2023.0597.9
EquiZeroGRUGroup=Verb, Fine-tuning iterations=10K2023.0593.6
G-RNNGroup=Verb, Training iterations=200K iterations2023.0587.4
EquiZeroRNNGroup=Verb, Training iterations=10K iterations fine-tuning2023.0584.8
EquiRNNGroup=Verb, Training iterations=10K iterations fine-tuning2023.0583.9
EquiGRUGroup=Verb, Fine-tuning iterations=10K2023.0581.1
EquizeroLSTMGroup=Verb, Zero-shot=true, Iterations=200K2023.0575.2
EquiLSTMGroup=Verb, Zero-shot=true, Iterations=200K2023.057.1
RNNGroup=-, Training iterations=200K iterations2023.050.2
LSTMGroup=–, Training Iterations=200K, Evaluation Protocol=trained2023.050
GRUGroup=–, Training iterations=200K2023.050
LSTMGroup=–, Zero-shot=true, Iterations=200K2023.050