Causal Reasoning on Copa100
83AccuracyOur Trained Model
Evaluation results
| Method | Links | |
|---|---|---|
| Our Trained ModelModel Size=52B, Data type=W4, Zero-shot=true2023.05 | 83 | |
| Our Trained ModelModel Size=52B, Data type=W8A8, Zero-shot=true2023.05 | 82 | |
| Our Trained ModelModel Size=52B, Data type=FP16, Zero-shot=true2023.05 | 81 | |
| Our Trained ModelModel Size=6B, Data type=FP16, Zero-shot=true2023.05 | 79 | |
| Our Trained ModelModel Size=6B, Data type=W8A8, Zero-shot=true2023.05 | 77 | |
| Our Trained ModelModel Size=13B, Data type=FP16, Zero-shot=true2023.05 | 76 | |
| Our Trained ModelModel Size=13B, Data type=W4, Zero-shot=true2023.05 | 76 | |
| Our Trained ModelModel Size=13B, Data type=W8A8, Zero-shot=true2023.05 | 75 | |
| Our Trained ModelModel Size=6B, Data type=W4, Zero-shot=true2023.05 | 72 | |
| Our Trained ModelModel Size=410M, Data type=FP16, Zero-shot=true2023.05 | 65 | |
| Our Trained ModelModel Size=410M, Data type=W8A8, Zero-shot=true2023.05 | 64 | |
| Our Trained ModelModel Size=410M, Data type=W4, Zero-shot=true2023.05 | 64 |