Factual question answering on TriviaQA
76.52AccuracyCorVer
Evaluation Results
| Method | Links | |
|---|---|---|
| CorVerModel=Llama-3.1-8B2026.05 | 76.52 | |
| RawModel=Llama-3.1-8B2026.05 | 71.86 | |
| RLFHModel=Llama-3.1-8B2026.05 | 69.55 | |
| FoRAGModel=Llama-3.1-8B2026.05 | 69.4 | |
| KnowRLModel=Llama-3.1-8B2026.05 | 68.41 | |
| CorVerModel=Qwen3-8B2026.05 | 63.99 | |
| FSPOModel=Llama-3.1-8B2026.05 | 63.43 | |
| RawModel=Qwen3-8B2026.05 | 62.84 | |
| CorVerModel=Llama-3.2-3B2026.05 | 62.24 | |
| FSPOModel=Qwen3-8B2026.05 | 61.81 | |
| RLFHModel=Qwen3-8B2026.05 | 61.39 | |
| FoRAGModel=Qwen3-8B2026.05 | 61.34 | |
| KnowRLModel=Qwen3-8B2026.05 | 60.92 | |
| FoRAGModel=Llama-3.2-3B2026.05 | 60.66 | |
| RLFHModel=Llama-3.2-3B2026.05 | 60.66 | |
| RawModel=Llama-3.2-3B2026.05 | 55.39 | |
| CorVerModel=Qwen3-4B2026.05 | 53.77 | |
| FSPOModel=Qwen3-4B2026.05 | 52.88 | |
| FoRAGModel=Qwen3-4B2026.05 | 52.65 | |
| RLFHModel=Qwen3-4B2026.05 | 52.5 | |
| RawModel=Qwen3-4B2026.05 | 51.14 | |
| KnowRLModel=Llama-3.2-3B2026.05 | 49.6 | |
| KnowRLModel=Qwen3-4B2026.05 | 40.9 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=1.7B2026.05 | 32.46 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open2026.05 | 32.41 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=0.6B2026.05 | 32.18 | |
| FoLoRAFine-tuning dataset=MetaMathQA, Calibration data=NQ Open, Calibration model size=4B2026.05 | 32.07 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 30.58 | |
| LoRA-NullFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 30.53 | |
| MiLoRAFine-tuning dataset=MetaMathQA2026.05 | 29.69 | |
| LoRAFine-tuning dataset=MetaMathQA2026.05 | 29.62 | |
| OPLoRAFine-tuning dataset=MetaMathQA2026.05 | 29.59 | |
| Qwen3-1.7BType=Base Model2026.05 | 28.78 | |
| NAG_SmolLM3-3BTarget Setting=Single-Target, Backbone=SmolLM3-3B2026.04 | 22.6 | |
| NAG_Qwen3-1.7BTarget Setting=Single-Target, Backbone=Qwen3-1.7B2026.04 | 22.3 | |
| FSPOModel=Llama-3.2-3B2026.05 | 22.28 | |
| NAG_Llama-3.2-3BTarget Setting=Single-Target, Backbone=Llama-3.2-3B2026.04 | 21.3 | |
| BETRTarget Setting=Single-Target2026.04 | 20.2 | |
| FineWeb-Edu2026.04 | 20.1 | |
| NAG_SmolLM3-3BTarget Setting=Multi-Target, Backbone=SmolLM3-3B2026.04 | 19.9 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy, Calibration model size=4B2026.05 | 19.85 | |
| NAG_Qwen3-1.7BTarget Setting=Multi-Target, Backbone=Qwen3-1.7B2026.04 | 19.2 | |
| NAG_Llama-3.2-3BTarget Setting=Multi-Target, Backbone=Llama-3.2-3B2026.04 | 18 | |
| CorDAFine-tuning dataset=MetaMathQA, Calibration data=model-generated pretraining-proxy2026.05 | 16.58 | |
| Random2026.04 | 15.6 | |
| BETRTarget Setting=Multi-Target2026.04 | 11.6 |