List your company

Systematic Generalization on SCAN Add Jump (val)

99.6AccuracyG-GRU
61.01671.03381.0591.067May 17, 2023

Evaluation results

MethodLinks
G-GRUGroup=Verb, Training iterations=200K2023.0599.6
G-LSTMGroup=Verb, Training Iterations=200K, Evaluation Protocol=trained2023.0599.4
LSTMGroup=–, Training Iterations=200K, Evaluation Protocol=trained2023.0599.1
LSTMGroup=–, Zero-shot=true, Iterations=200K2023.0599.1
EquiLSTMGroup=Verb, Training Iterations=10K, Evaluation Protocol=fine-tuned2023.0598.9
EquizeroLSTMGroup=Verb, Zero-shot=true, Iterations=200K2023.0598.4
EquiZeroLSTMGroup=Verb, Training Iterations=10K, Evaluation Protocol=fine-tuned2023.0598.3
GRUGroup=–, Training iterations=200K2023.0596.9
EquiZeroGRUGroup=Verb, Fine-tuning iterations=10K2023.0596.4
EquiGRUGroup=Verb, Fine-tuning iterations=10K2023.0595.7
G-RNNGroup=Verb, Training iterations=200K iterations2023.0593.2
EquiRNNGroup=Verb, Training iterations=10K iterations fine-tuning2023.0592.2
EquiZeroRNNGroup=Verb, Training iterations=10K iterations fine-tuning2023.0591.7
RNNGroup=-, Training iterations=200K iterations2023.0591.4
EquiLSTMGroup=Verb, Zero-shot=true, Iterations=200K2023.0562.5