Direction of change on TahoeQA
85.5C32 AccuracyVCR-Agent
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| VCR-Agenttraining=SFT, output_mode=Prompt2026.04 | 85.5 | 82.7 | 83 | 81.8 | 83.2 | 83.2 | 82 | |
| Mean2026.04 | 84.7 | 81.3 | 80.2 | 81.2 | 81.1 | 81.7 | 81 | |
| SFTmode=Supervised Fine-Tuning2026.04 | 83.9 | 81 | 81.5 | 82.2 | 82.7 | 82.3 | 82 | |
| K-neighbor2026.04 | 79.8 | 77.5 | 76.1 | 73.6 | 78.4 | 77.1 | 75.7 | |
| STATEvariant=ST2026.04 | 75.6 | 68.5 | 70.4 | 73.7 | 72.1 | 72.1 | 69.5 | |
| VCR-Agenttraining=SFT, output_mode=Generate2026.04 | 70.2 | 70.7 | 70.4 | 68.8 | 77.3 | 71.5 | 72.7 | |
| Random2026.04 | 52.5 | 52.6 | 51.7 | 52.2 | 55.8 | 53 | 51.3 | |
| Zero-shotmode=Zero-shot2026.04 | 10.1 | 6.3 | 5.5 | 4.9 | 6.1 | 6.6 | 6.2 |