Natural Language Inference on RTE (Accuracy and Normalized Accuracy)
94.4Normalized AccuracyLinear
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| LinearBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 94.4 | — | |
| SVDBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 93.7 | — | |
| TABackbone=LLAMA-3 8B, LoRA rank=162026.03 | 93.6 | — | |
| FR-MergingBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 93.6 | — | |
| RobustMergeBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 93.6 | — | |
| EMR-MergingBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 92.9 | — | |
| KnOTS-TIESBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 92.1 | — | |
| LoRA-LEGOBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 92.1 | — | |
| AdaMergingBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 92.1 | — | |
| KnOTS-DARE-TIESBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 91.3 | — | |
| NSCBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 91.3 | — | |
| TIESBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 89.8 | — | |
| DARE-TIESBackbone=LLAMA-3 8B, LoRA rank=162026.03 | 89.8 | — | |
| FinetunedBackbone=LLAMA-3 8B, LoRA rank=162026.03 | — | 87 |