Question Answering on ECQA
70.34AccuracyLLaMA3.1-8B
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=B-B2025.06 | 70.34 | 7.58 | 8.05 | 8.53 | 5 | 18.22 | 31.3 | |
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=B-T2025.06 | 70.34 | 7.64 | 8.1 | 8.57 | 7.2 | 20.22 | 32.86 | |
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=T-T2025.06 | 69.7 | 9.16 | 9.72 | 10.28 | 7.86 | 20.58 | 33.45 | |
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=T-T2025.06 | 67.68 | 1.36 | 1.67 | 1.96 | 36.59 | 43.66 | 51.24 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=B-B2025.06 | 67.13 | 1.11 | 1.46 | 1.81 | 10.04 | 22.52 | 35.02 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=B-T2025.06 | 67.13 | 1.3 | 1.63 | 1.96 | 10.5 | 22.65 | 34.81 | |
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=B-B2025.06 | 67.03 | 0.87 | 1.22 | 1.55 | 34.71 | 42.52 | 49.87 | |
| LLaMA3.1-8BModel=LLaMA3.1-8B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=B-T2025.06 | 67.03 | 1.35 | 1.67 | 1.96 | 34.71 | 42.65 | 50.15 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIME, Evaluation Mode (B-B, B-T, T-T)=T-T2025.06 | 66.12 | 2.14 | 2.47 | 2.8 | 12.94 | 24.71 | 36.5 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=T-T2025.06 | 62.99 | 2.54 | 2.82 | 2.99 | 33.3 | 41.9 | 50.17 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=B-B2025.06 | 62.44 | 1.9 | 2.32 | 2.72 | 28.61 | 36.72 | 44.53 | |
| LLaMA3.2-3BModel=LLaMA3.2-3B, Attribution Method (LIME/LIG)=LIG, Evaluation Mode (B-B, B-T, T-T)=B-T2025.06 | 62.44 | 1.97 | 2.37 | 2.73 | 29.04 | 37.17 | 45.05 |