List your company
ResearchFormerly WizWand

Code Understanding on CRUX (test)

69.3Pass@1ReM-MoA*
57.02860.21463.466.586Jun 23, 2026
Updated 4mo ago

Evaluation results

MethodLinks
ReM-MoA*Width (N)=8, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0669.3
ReM-MoA*Width (N)=7, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0668.7
ReM-MoA*Width (N)=6, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0668
ReM-MoAWidth (N)=8, Depth (L)=3, Trend=↑↑2026.0667.3
ReM-MoA*Width (N)=5, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0667
ReM-MoAWidth (N)=7, Depth (L)=3, Trend=↑↑2026.0666.8
ReM-MoAWidth (N)=6, Depth (L)=3, Trend=↑↑2026.0666.2
ReM-MoA*Width (N)=4, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0666
ReM-MoAWidth (N)=5, Depth (L)=3, Trend=↑↑2026.0665.3
ReM-MoA*Width (N)=3, Depth (L)=3, Trend=↑↑, Distilled Reviewer=true2026.0664.6
ReM-MoAWidth (N)=4, Depth (L)=3, Trend=↑↑2026.0664.3
AttentionMoAWidth (N)=8, Depth (L)=3, Trend=↑↑2026.0663.6
AttentionMoAWidth (N)=7, Depth (L)=3, Trend=↑↑2026.0663.3
ReM-MoAWidth (N)=3, Depth (L)=3, Trend=↑↑2026.0663
AttentionMoAWidth (N)=6, Depth (L)=3, Trend=↑↑2026.0662.9
AttentionMoAWidth (N)=5, Depth (L)=3, Trend=↑↑2026.0662.3
AttentionMoAWidth (N)=4, Depth (L)=3, Trend=↑↑2026.0661.5
RMoAWidth (N)=8, Depth (L)=3, Trend=↑→2026.0660.7
RMoAWidth (N)=7, Depth (L)=3, Trend=↑→2026.0660.6
AttentionMoAWidth (N)=3, Depth (L)=3, Trend=↑↑2026.0660.5
RMoAWidth (N)=6, Depth (L)=3, Trend=↑→2026.0660.3
RMoAWidth (N)=5, Depth (L)=3, Trend=↑→2026.0659.8
RMoAWidth (N)=4, Depth (L)=3, Trend=↑→2026.0659.3
Standard MoAWidth (N)=6, Depth (L)=3, Trend=→2026.0658.6
Standard MoAWidth (N)=7, Depth (L)=3, Trend=→2026.0658.5
RMoAWidth (N)=3, Depth (L)=3, Trend=↑→2026.0658.5
Standard MoAWidth (N)=5, Depth (L)=3, Trend=→2026.0658.4
Standard MoAWidth (N)=8, Depth (L)=3, Trend=→2026.0658.3
Standard MoAWidth (N)=4, Depth (L)=3, Trend=→2026.0658
Standard MoAWidth (N)=3, Depth (L)=3, Trend=→2026.0657.5