Regular Language Classification on 21 Regular Tasks OOD lengths 41–500 benchmark leaderboard · SOTA2 Research

Regular Language Classification on 21 Regular Tasks OOD lengths 41–500

100Even PairsLSTM

Evaluation Results

Method	Links
LSTM2026.05		100	100	100	60.3	100	97.7	100	98.4	89	82.1	100	100	100	100	100	100	100	100	100	100	97.3
BBT-GRC2026.05		100	94	100	100	100	98.5	84.6	84.7	84.3	90.5	99.4	99.4	100	100	100	100	99.9	100	100	100	100
MLP-LDRU2026.05		100	100	100	100	100	100	100	98.5	98.1	96	100	100	100	100	100	100	100	100	100	100	100
TF2026.05		91.5	31.4	49.9	23.3	98.2	92.5	97.6	98.4	98.7	98.7	70.7	85.5	74.3	50	100	89.2	86.4	58.5	79.5	51.6	58.2
RNN2026.05		77.4	100	100	100	100	100	95	97.1	99.2	92.7	100	100	100	100	100	82.2	65.4	99.4	61.4	96.9	85
TF2026.05		61.1	54.4	49.9	21.6	100	98.3	96	92.3	89.7	84.4	100	100	74.3	50	100	56	93	90	40.3	31	21.3
Gated DeltaNet2026.05		52.2	76.5	53.4	25.8	100	91.6	93.1	75.6	76	74.6	99.9	99.1	75.1	54.7	100	52.4	22	18.9	30.1	21.5	69.4