Transformer sequence-copying
Benchmarks
TaskDatasetSOTA resultTrendResults
Transformer sequence-copying Heterogeneous regime (test)
77.9Masked Next-Token Accuracy
4
Transformer sequence-copying Homogeneous regime (test)
79.17Average Masked Next-Token Accuracy
4