Commonsense Reasoning on PDP
91.66AccuracyBatch Partitioning
Evaluation results
| Method | Links | |
|---|---|---|
| Batch PartitioningLM=RoBERTa, Avg.=85.14, Speed-up=1.4x2023.05 | 91.66 | |
| RoBERTaLM=RoBERTa, Avg.=83.952023.05 | 90 | |
| OK-TransformerLM=RoBERTa, Avg.=84.75, Speed-up=1.0x2023.05 | 90 | |
| Frozen knowledgeLM=RoBERTa, Avg.=80.01, Speed-up=1.5x2023.05 | 88.33 | |
| OK-TransformerLM=BERT, Avg.=66.56, Speed-up=1.0x2023.05 | 86.67 | |
| Batch PartitioningLM=BERT, Avg.=67.40, Speed-up=1.4x2023.05 | 86.67 | |
| BERTLM=BERT, Avg.=65.442023.05 | 85 | |
| Frozen knowledgeLM=BERT, Avg.=65.59, Speed-up=1.4x2023.05 | 83.33 |