List your company
ResearchFormerly WizWand

Semantic Needle-In-A-Haystack on S-NIAH

52.4AccuracyRLM
0.81614.20827.640.992Mar 20, 2026
Updated 7mo ago

Evaluation results

MethodLinks
RLMParadigm=P2, Model Family=Llama, Model Scale=405B2026.0352.4
λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=235B2026.0351.3
λ-RLMParadigm=P3, Model Family=Llama, Model Scale=405B2026.0349.8
RLMParadigm=P2, Model Family=Qwen3, Model Scale=235B2026.0346.8
λ-RLMParadigm=P3, Model Family=Llama, Model Scale=70B2026.0344.2
λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=32B2026.0341.8
λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=Cdsrl2026.0340.2
λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=8x22B2026.0338.6
DirectParadigm=P1, Model Family=Llama, Model Scale=405B2026.0335.2
DirectParadigm=P1, Model Family=Qwen3, Model Scale=235B2026.0331.7
RLMParadigm=P2, Model Family=Llama, Model Scale=70B2026.0331.5
RLMParadigm=P2, Model Family=Mistral, Model Scale=Cdsrl2026.0329.7
RLMParadigm=P2, Model Family=Qwen3, Model Scale=32B2026.0328.3
RLMParadigm=P2, Model Family=Mistral, Model Scale=8x22B2026.0326.4
λ-RLMParadigm=P3, Model Family=Qwen3, Model Scale=8B2026.0324.6
DirectParadigm=P1, Model Family=Llama, Model Scale=70B2026.0322.6
λ-RLMParadigm=P3, Model Family=Llama, Model Scale=8B2026.0322.1
DirectParadigm=P1, Model Family=Mistral, Model Scale=8x22B2026.0319.1
λ-RLMParadigm=P3, Model Family=Mistral, Model Scale=7B2026.0318.5
DirectParadigm=P1, Model Family=Qwen3, Model Scale=32B2026.0318.4
DirectParadigm=P1, Model Family=Mistral, Model Scale=Cdsrl2026.0314.3
RLMParadigm=P2, Model Family=Llama, Model Scale=8B2026.0310.2
RLMParadigm=P2, Model Family=Qwen3, Model Scale=8B2026.038.4
RLMParadigm=P2, Model Family=Mistral, Model Scale=7B2026.036.1
DirectParadigm=P1, Model Family=Llama, Model Scale=8B2026.034.1
DirectParadigm=P1, Model Family=Qwen3, Model Scale=8B2026.033.2
DirectParadigm=P1, Model Family=Mistral, Model Scale=7B2026.032.8