List your company
ResearchFormerly WizWand

Question Answering on MARCO Unfiltered (Acc, Rouge-L, PPL)

18.77Accuracy+Distributed
14.058815.281916.50517.7281May 25, 2026
Updated 5mo ago

Evaluation results

MethodLinks
+DistributedModel=Llama 3.1 8B2026.0518.7734.042.22
BaselineModel=Llama 3.1 8B2026.0518.6634.042.22
+ScramblerModel=Llama 3.1 8B2026.0518.6634.032.22
BaselineModel=Qwen 2 7B2026.0517.5829.4312.85
+ScramblerModel=Qwen 2 7B2026.0517.5229.3912.95
+DistributedModel=Qwen 2 7B2026.0517.4829.4212.84
BaselineModel=Qwen 2.5 32B2026.0517.0832.647.19
+ScramblerModel=Qwen 2.5 32B2026.0516.9232.697.2
+DistributedModel=Qwen 2.5 32B2026.0516.8532.687.19
+DistributedModel=Mistral 7B2026.0514.3427.342.99
+ScramblerModel=Mistral 7B2026.0514.2527.32.99
BaselineModel=Mistral 7B2026.0514.2427.312.99