Common-sense reasoning on WG-S (In-Distribution)
78.09Accuracy (ACC)PoLAR-MLE
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| PoLAR-MLEBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 78.09 | 20.48 | 1.97 | |
| PoLAR-LABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 78.09 | 15.19 | 0.61 | |
| PoLAR-LA-LLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 78.09 | 15.06 | 0.76 | |
| MLEBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 77.92 | 21.11 | 2.23 | |
| LABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 77.92 | 16.41 | 0.57 | |
| PoLAR-VBLL (w/o LA)Backbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 77.26 | 8.19 | 0.61 | |
| PoLAR-VBLLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 77.26 | 3.89 | 0.58 | |
| C-LoRABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 77.16 | 18.31 | 0.85 | |
| PoLAR-BLoBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 76.49 | 5.21 | 0.67 | |
| TFB-LLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 76.25 | 12.34 | 0.59 | |
| TFBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 73.53 | 5.9 | 0.59 | |
| BLoBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 72.36 | 5.78 | 0.58 |