Question Answering on SQuAD (Score)
89.3ScorePPFT w/o noise
Evaluation Results
| Method | Links | |
|---|---|---|
| PPFT w/o noiseBackbone=Llama-3.1-8B2026.04 | 89.3 | |
| MSSRfullBackbone=Llama-3.1-8B2026.03 | 79.95 | |
| MSSRschBackbone=Llama-3.1-8B2026.03 | 79.5 | |
| AccuBackbone=Llama-3.1-8B2026.03 | 78.53 | |
| MSSRsplBackbone=Llama-3.1-8B2026.03 | 78.26 | |
| LossBackbone=Llama-3.1-8B2026.03 | 77.74 | |
| FixedBackbone=Llama-3.1-8B2026.03 | 77.17 | |
| MSSRfullBackbone=Gemma2-9B2026.03 | 77.16 | |
| MSSRsplBackbone=Gemma2-9B2026.03 | 76.1 | |
| NoneBackbone=Llama-3.1-8B2026.03 | 76.03 | |
| MSSRschBackbone=Gemma2-9B2026.03 | 75.83 | |
| AccuBackbone=Gemma2-9B2026.03 | 74.67 | |
| FixedBackbone=Gemma2-9B2026.03 | 74.23 | |
| MSSRfullBackbone=Qwen2.5-7B2026.03 | 74.21 | |
| NoneBackbone=Gemma2-9B2026.03 | 73.98 | |
| AccuBackbone=Qwen2.5-7B2026.03 | 73.89 | |
| LossBackbone=Qwen2.5-7B2026.03 | 73.5 | |
| MSSRsplBackbone=Qwen2.5-7B2026.03 | 73.46 | |
| LossBackbone=Gemma2-9B2026.03 | 73.42 | |
| MSSRschBackbone=Qwen2.5-7B2026.03 | 73.38 | |
| PPFT w/o noiseBackbone=Llama-3.2-1B2026.04 | 73.03 | |
| FixedBackbone=Qwen2.5-7B2026.03 | 72.28 | |
| PPFTBackbone=Llama-3.1-8B2026.04 | 70.85 | |
| NoneBackbone=Qwen2.5-7B2026.03 | 70.59 | |
| PPFTBackbone=Llama-3.2-1B2026.04 | 65.79 | |
| SATFORMERInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 36.96 | |
| HYPERCONNECTIONSInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 36.72 | |
| DENSEFORMERInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 35.32 | |
| TRANSFORMERInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 34.91 | |
| RESFORMERInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 34.88 | |
| MUDDFORMERInput length=2k tokens, Evaluation protocol=Arora et al. [2024]2026.05 | 34.78 | |
| ParaphraseBackbone=Llama-3.2-1B2026.04 | 7.2 | |
| dχ-privacyBackbone=Llama-3.2-1B2026.04 | 3.13 | |
| dχ-privacyBackbone=Llama-3.1-8B2026.04 | 1.74 | |
| ParaphraseBackbone=Llama-3.1-8B2026.04 | 1.25 |