Factuality Correction on VELI5 1.0 (test)
36Precision (Pr)FACTCORRECTOR
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FACTCORRECTORbase model=gpt-oss-120b2026.01 | 36 | 19 | 30 | 7 | 14 | |
| FACTCORRECTORbase model=mixtral-8x22b-instruct2026.01 | 34 | 9 | 24 | 14 | 7 | |
| RACbase model=gpt-oss-120b2026.01 | 34 | 15 | 27 | 6 | 13 | |
| LLM2base model=gpt-oss-120b2026.01 | 33 | 20 | 28 | 5 | 13 | |
| LLM1base model=mixtral-8x22b-instruct2026.01 | 32 | 10 | 23 | 12 | 7 | |
| LLM2base model=mixtral-8x22b-instruct2026.01 | 32 | 10 | 23 | 13 | 7 | |
| LLM1base model=granite-4.0-h-small2026.01 | 31 | 11 | 23 | 11 | 8 | |
| FACTCORRECTORbase model=granite-4.0-h-small2026.01 | 29 | 10 | 21 | 11 | 7 | |
| FACTCORRECTORbase model=llama-3.3-70b-instruct2026.01 | 27 | 7 | 18 | 5 | 8 | |
| CRITICbase model=mixtral-8x22b-instruct2026.01 | 26 | 8 | 19 | 9 | 6 | |
| LLM2base model=llama-3.3-70b-instruct2026.01 | 26 | 7 | 18 | 5 | 8 | |
| LLM1base model=llama-3.3-70b-instruct2026.01 | 25 | 6 | 18 | 5 | 8 | |
| SFTbase model=llama-3.3-70b-instruct2026.01 | 25 | 11 | 19 | 10 | 8 | |
| RACbase model=mixtral-8x22b-instruct2026.01 | 24 | 8 | 18 | 8 | 6 | |
| SFTbase model=granite-4.0-h-small2026.01 | 22 | 11 | 18 | 9 | 7 | |
| LLM1base model=gpt-oss-120b2026.01 | 21 | 16 | 19 | -1 | 13 | |
| RACbase model=granite-4.0-h-small2026.01 | 20 | 9 | 16 | 6 | 7 | |
| LLM2base model=granite-4.0-h-small2026.01 | 20 | 10 | 16 | 9 | 5 | |
| SFTbase model=mixtral-8x22b-instruct2026.01 | 19 | 10 | 16 | 5 | 8 | |
| CRITICbase model=llama-3.3-70b-instruct2026.01 | 19 | 6 | 13 | 3 | 5 | |
| CRITICbase model=granite-4.0-h-small2026.01 | 17 | 4 | 12 | 5 | 6 | |
| RACbase model=llama-3.3-70b-instruct2026.01 | 13 | 2 | 9 | 2 | 5 | |
| SFTbase model=gpt-oss-120b2026.01 | 8 | 8 | 8 | 7 | 2 | |
| CRITICbase model=gpt-oss-120b2026.01 | -4 | 1 | -2 | -1 | -3 |