Question Answering on TriviaQA (ΔLL (%))
18.5ΔLL (%)CE
Evaluation Results
| Method | Links | |
|---|---|---|
| CEBackbone=0.5B, Adapter=LoRA2026.05 | 18.5 | |
| CEBackbone=0.5B, Adapter=DoRA2026.05 | 18.2 | |
| CEBackbone=0.5B, Adapter=SineLoRA2026.05 | 16.4 | |
| CEBackbone=7B, Adapter=DoRA2026.05 | 15.5 | |
| CEBackbone=7B, Adapter=LoRA2026.05 | 15.2 | |
| CEBackbone=7B, Adapter=SineLoRA2026.05 | 14.8 | |
| CEBackbone=0.5B, Adapter=RandLoRA2026.05 | 12.8 | |
| CEBackbone=7B, Adapter=RandLoRA2026.05 | 11.5 | |
| CE + TMKLBackbone=0.5B, Adapter=LoRA2026.05 | 1.2 | |
| CE + TMKLBackbone=0.5B, Adapter=DoRA2026.05 | 1.1 | |
| CE + TMKLBackbone=0.5B, Adapter=SineLoRA2026.05 | 0.9 | |
| CE + TMKLBackbone=0.5B, Adapter=RandLoRA2026.05 | 0.4 | |
| CE + TMKLBackbone=7B, Adapter=RandLoRA2026.05 | 0.2 | |
| CE + TMKLBackbone=7B, Adapter=SineLoRA2026.05 | -0.3 | |
| CE + TMKLBackbone=7B, Adapter=DoRA2026.05 | -0.4 | |
| CE + TMKLBackbone=7B, Adapter=LoRA2026.05 | -0.5 | |
| BaseBackbone=7B2026.05 | -0.952 | |
| BaseBackbone=0.5B2026.05 | -1.854 |