Factual QA on NQ-Open
48.34AccuracyCorVer
Evaluation Results
| Method | Links | |
|---|---|---|
| CorVerModel=Llama-3.1-8B2026.05 | 48.34 | |
| CorVerModel=Llama-3.2-3B2026.05 | 43.41 | |
| FoRAGModel=Llama-3.1-8B2026.05 | 42.71 | |
| RLFHModel=Llama-3.1-8B2026.05 | 42.44 | |
| RawModel=Llama-3.1-8B2026.05 | 40.66 | |
| FSPOModel=Llama-3.1-8B2026.05 | 39.25 | |
| KnowRLModel=Llama-3.1-8B2026.05 | 38.53 | |
| FoRAGModel=Llama-3.2-3B2026.05 | 37.15 | |
| RLFHModel=Llama-3.2-3B2026.05 | 35.9 | |
| RawModel=Llama-3.2-3B2026.05 | 34.13 | |
| CorVerModel=Qwen3-8B2026.05 | 32.8 | |
| KnowRLModel=Llama-3.2-3B2026.05 | 30.53 | |
| FoRAGModel=Qwen3-8B2026.05 | 29.81 | |
| FSPOModel=Qwen3-8B2026.05 | 29.67 | |
| RawModel=Qwen3-8B2026.05 | 29.61 | |
| RLFHModel=Qwen3-8B2026.05 | 29.42 | |
| KnowRLModel=Qwen3-8B2026.05 | 28.45 | |
| CorVerModel=Qwen3-4B2026.05 | 26.59 | |
| FSPOModel=Qwen3-4B2026.05 | 25.65 | |
| FoRAGModel=Qwen3-4B2026.05 | 25.43 | |
| RLFHModel=Qwen3-4B2026.05 | 25.12 | |
| RawModel=Qwen3-4B2026.05 | 24.65 | |
| KnowRLModel=Qwen3-4B2026.05 | 17.3 | |
| FSPOModel=Llama-3.2-3B2026.05 | 10.61 | |
| Qwen3-1.7BType=Base Model2026.05 | 8.81 | |
| OPLoRAFine-tuning dataset=MetaMathQA2026.05 | 7.97 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open2026.05 | 7.73 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 7.5 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 7.45 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=4B2026.05 | 7.25 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=1.7B2026.05 | 7 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=0.6B2026.05 | 6.34 | |
| LoRAFine-tuning dataset=MetaMathQA2026.05 | 6.06 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 5.73 | |
| MiLoRAFine-tuning dataset=MetaMathQA2026.05 | 5.4 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 5.37 |