SMCalFlow
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
SMCalFlow
88.9Program Accuracy
22
SMCalFlow-CS (16-C)
73.5Accuracy
20
SMCalFlow (test)
64.29SacreBLEU
9
SMCalFlow Few-shot 16 examples (test)
83.6Program Accuracy
8
SMCalFlow-CS (0-C)
40.7Exact Match Acc
8
SMCalFlow CS (i.i.d.)
88.5Exact Match Accuracy
8
SMCalFlow-CS (32-C)
70.4Accuracy
8
SMCalFlow CS (8-C)
77.3Exact Match Accuracy
8
SMCalFlow2Text v2.0 (val)
100BLEU
4