Language Understanding on WinoGrande
80.82AccuracyDuQ
Evaluation results
| Method | Links | ||
|---|---|---|---|
| DuQModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=-2026.05 | 80.82 | 79.85 | |
| SNNModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=22026.05 | 79.48 | 78.97 | |
| PrefixQModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=-2026.05 | 79.32 | 78.85 | |
| SNNModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=12026.05 | 79.32 | 78.85 | |
| NLSModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=22026.05 | 79.08 | 78.82 | |
| NLSModel=Llama 3 70B, Precision=W8A8, Time Steps (T)=12026.05 | 78.85 | 78.64 | |
| NLSModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=12026.05 | 74.11 | 70.85 | |
| NLSModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=12026.05 | 73.72 | 72.84 | |
| DuQModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=-2026.05 | 73.56 | 72.81 | |
| SNNModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=42026.05 | 73.32 | 73.24 | |
| NLSModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=22026.05 | 73.24 | 72.63 | |
| SNNModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=22026.05 | 73.16 | 72.75 | |
| PrefixQModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=-2026.05 | 73.09 | 72.85 | |
| SNNModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=12026.05 | 73.09 | 72.85 | |
| NLSModel=Llama 3 8B, Precision=W8A8, Time Steps (T)=42026.05 | 73.09 | 72.77 | |
| NLSModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=22026.05 | 72.22 | 70.44 | |
| PrefixQModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=-2026.05 | 71.82 | 70.73 | |
| SNNModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=12026.05 | 71.82 | 70.73 | |
| SNNModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=22026.05 | 71.82 | 69.58 | |
| NLSModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=42026.05 | 71.19 | 69.69 | |
| SNNModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=42026.05 | 70.4 | 69.45 | |
| PrefixQModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=-2026.05 | 70.24 | 68.81 | |
| SNNModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=12026.05 | 70.24 | 68.81 | |
| PrefixQModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=-2026.05 | 70.09 | 67.84 | |
| SNNModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=12026.05 | 70.09 | 67.84 | |
| NLSModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=42026.05 | 70.01 | 69.03 | |
| SNNModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=22026.05 | 69.93 | 68.73 | |
| SNNModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=42026.05 | 69.85 | 68.85 | |
| NLSModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=22026.05 | 69.61 | 68.77 | |
| NLSModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=22026.05 | 69.53 | 67.6 | |
| SNNModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=42026.05 | 69.46 | 67.7 | |
| SNNModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=22026.05 | 69.06 | 67.37 | |
| NLSModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=12026.05 | 68.35 | 68.71 | |
| NLSModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=42026.05 | 68.27 | 66.89 | |
| DuQModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=-2026.05 | 67.88 | 62.25 | |
| DuQModel=Llama 3 8B, Precision=W6A6, Time Steps (T)=-2026.05 | 67.88 | 62.25 | |
| NLSModel=Llama 2 7B, Precision=W6A6, Time Steps (T)=12026.05 | 67.48 | 67.16 | |
| DuQModel=Llama 2 7B, Precision=W8A8, Time Steps (T)=-2026.05 | 66.69 | 62.09 |