TpuGraphs
Benchmarks
TaskDatasetSOTA resultTrendResults
TpuGraphs (test)
0.892OPA
4
TpuGraphs (train)
0.874OPA
4
TpuGraphs mean across layout (val)
0.674Kendall's Tau
3
TpuGraphs layout:nlp:default (val)
0.563Kendall's τ
3
TpuGraphs layout:nlp:random (val)
0.971Kendall's Tau
3
TpuGraphs layout:xla:default (val)
0.589Kendall's Tau
3
TpuGraphs layout:xla:random (val)
0.684Kendall's Tau
3
TpuGraphs-Layout XLA-Random
87.6Ordered Pair Accuracy
3
TpuGraphs Layout XLA-Default
79.6Ordered Pair Accuracy
3
TpuGraphs Layout NLP-Random
94.1Ordered Pair Accuracy
3
TpuGraphs Layout NLP-Default
82.1Ordered Pair Accuracy
3
TpuGraphs Layout+Tile
61.9Averaged Accuracy
3
TpuGraphs tile:xla (val)
96.94Tile Ranking Metric
2