Graph prediction on CrossTask (test) benchmark leaderboard · SOTA2 Research

Graph prediction on CrossTask (test)

0.795Change Tire SuccessGround-truth labels → Graph

Evaluation Results

Method
Ground-truth labels → Graph2023.02	0.795	0.896	0.68	0.688	0.727	0.757
ASR → GPT → Labels → Graph2023.02	0.75	0.729	0.617	0.625	0.659	0.676
Unsupervised Task Graph Generation Pipeline2023.02	0.727	0.771	0.617	0.625	0.682	0.684
ASR → Labels → Graph2023.02	0.545	0.729	0.711	0.562	0.545	0.618
ASR → VPs → Labels → Graph2023.02	0.545	0.729	0.711	0.562	0.591	0.628
Proscript2023.02	0.523	0.896	0.57	0.625	0.614	0.646