Common-sense reasoning on WG-M (In-Distribution)
83.61AccuracyPoLAR-MLE
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| PoLAR-MLEBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 83.61 | 18.64 | 0.9 | |
| PoLAR-LABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 83.61 | 3.16 | 0.53 | |
| PoLAR-LA-LLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 83.61 | 8.3 | 0.55 | |
| PoLAR-VBLL (w/o LA)Backbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 83.04 | 8.79 | 0.55 | |
| PoLAR-VBLLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 83.04 | 3.77 | 0.53 | |
| MLEBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 82.8 | 15.46 | 1.05 | |
| LABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 82.8 | 8.37 | 0.56 | |
| TFB-LLBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 82.7 | 8.02 | 0.61 | |
| PoLAR-BLoBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 82.29 | 7.7 | 0.61 | |
| C-LoRABackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 82.16 | 6.22 | 0.62 | |
| TFBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 80.71 | 3.28 | 0.55 | |
| BLoBBackbone=Llama-3.1-8B, Fine-tuning steps=50002026.04 | 79.32 | 3.91 | 0.6 |