List your company

Question Answering on RAG Benchmarks

63.82HotpotQA ScoreFull-FT
8.54422.894537.24551.5955Apr 22, 2026

Evaluation results

MethodLinks
Full-FTTraining Stage=Finetuning2026.0463.8271.3875.8324.253.5657.76
GSATraining Stage=Finetuning, Compression Ratio=8x2026.0459.8868.6271.9920.2746.253.39
H-GSATraining Stage=Finetuning, Compression Ratio=16x2026.0456.4366.7669.5618.3742.4850.72
GSATraining Stage=Finetuning, Compression Ratio=16x2026.0454.2966.1667.9316.341.7849.29
UniGistTraining Stage=Finetuning, Compression Ratio=8x2026.0449.256464.1712.3736.5645.27
UniGistTraining Stage=Finetuning, Compression Ratio=16x2026.0443.561.8360.7210.8834.2642.24
KVLinkTraining Stage=Finetuning, Compression Ratio=8x2026.0441.1561.6562.6810.4731.2841.45
GSATraining Stage=Continued Pretraining, Compression Ratio=8x2026.0441.0952.0638.6512.9923.6233.68
KVLinkTraining Stage=Finetuning, Compression Ratio=16x2026.0436.9258.8562.218.1127.2438.67
H-GSATraining Stage=Continued Pretraining, Compression Ratio=16x2026.0434.3450.9833.619.0622.9830.19
GSATraining Stage=Continued Pretraining, Compression Ratio=16x2026.0430.5646.2832.678.1121.127.74
Llama3.2-1bTraining Stage=Base2026.0429.9840.8225.869.134.227.99
Full-PTTraining Stage=Continued Pretraining2026.0429.6439.7325.459.1831.7227.14
UniGistTraining Stage=Continued Pretraining, Compression Ratio=8x2026.0422.7744.4422.843.7218.8622.53
UniGistTraining Stage=Continued Pretraining, Compression Ratio=16x2026.0421.5141.6230.13.2314.5622.2
KVLinkTraining Stage=Continued Pretraining, Compression Ratio=8x2026.0417.5444.3625.034.0116.9621.58
KVLinkTraining Stage=Continued Pretraining, Compression Ratio=16x2026.0410.6733.121.220.744.9214.13