Natural Language Explanation Generation on DRUID (test)
0.102FaithfulnessCLUE-Span+Steering
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CLUE-Span+SteeringModel=Qwen2.5-14B2025.05 | 0.102 | 28 | 20 | 0.77 | |
| CLUE-Span+SteeringModel=OLMo-2-1124-13B2025.05 | 0.099 | 15 | 70 | 0.69 | |
| CLUE-Span+SteeringModel=Gemma-2-9B-IT2025.05 | 0.098 | 30 | 47 | 0.81 | |
| CLUE-SpanModel=Qwen2.5-14B2025.05 | 0.089 | 20 | 38 | 0.78 | |
| CLUE-SpanModel=Gemma-2-9B-IT2025.05 | 0.043 | 23 | 43 | 0.76 | |
| CLUE-SpanModel=OLMo-2-1124-13B2025.05 | 0.014 | 8 | 79 | 0.65 | |
| PromptBaselineModel=Qwen2.5-14B2025.05 | -0.08 | — | — | 0.6 | |
| PromptBaselineModel=Gemma-2-9B-IT2025.05 | -0.12 | — | — | 0.57 | |
| PromptBaselineModel=OLMo-2-1124-13B2025.05 | -0.13 | — | — | 0.53 |