Question Answering Repair on SealQA Hard (test)
108Pass CountCausalFlow
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| CausalFlowTotal=2542026.05 | 108 | 146 | 32 | 0.79 | |
| DirectTotal=2542026.05 | 93 | 161 | 0 | 1 | |
| Self-RefineTotal=2542026.05 | 92 | 162 | 27 | 0.17 | |
| Self-ReflectionTotal=2542026.05 | 92 | 162 | 28 | 0.01 |