Commonsense Reasoning on StoryCloze (test)
79.82AccuracyDense
Evaluation Results
| Method | Links | |
|---|---|---|
| DenseModel=OPT-175B, Sparsity=0%, Evaluation Protocol=Zero-shot2023.01 | 79.82 | |
| SparseGPTModel=OPT-175B, Sparsity=50%, Evaluation Protocol=Zero-shot2023.01 | 79.12 | |
| SparseGPTModel=OPT-175B, Sparsity=4:8, Evaluation Protocol=Zero-shot2023.01 | 78.1 | |
| SparseGPTModel=OPT-175B, Sparsity=2:4, Evaluation Protocol=Zero-shot2023.01 | 77.08 | |
| MagnitudeModel=OPT-175B, Sparsity=50%, Evaluation Protocol=Zero-shot2023.01 | 47.1 |