Long-form Question Answering refinement on ASQA (test)
16.63Error Rate (%)EIR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| EIRFeedback=Fine-grained (EIR)2024.07 | 16.63 | 0.51 | 0.73 | 0.82 | 0.77 | |
| GenericFeedback=Coarse-grained (GENERIC)2024.07 | 18.67 | 0.61 | 0.72 | 0.75 | 0.74 | |
| ImproveFeedback=Coarse-grained (IMPROVE)2024.07 | 20.85 | 0.68 | 0.7 | 0.71 | 0.7 | |
| BaselineType=Original dataset instances2024.07 | 34.81 | 1.2 | — | — | — | |
| Zero-shotModel=LLaMA2-13B-chat, Prompting=Zero-shot2024.07 | 35.02 | 1.08 | 0.5 | 0.62 | 0.55 |