List your company
ResearchFormerly WizWand

Artifact Finding on QGP-RepoScan

77.8Success RateLangGraph (STATEQGP)
-3.11217.89438.959.906May 22, 2026
Updated 5mo ago

Evaluation results

MethodLinks
LangGraph (STATEQGP)Model=gpt-5.4, Task inst.=362026.0577.841.7502.537
Native (STATEQGP)Model=gpt-4.1-mini, Task inst.=362026.0572.238.6702.229
LangGraph (STATEQGP)Model=gpt-4.1-mini, Task inst.=362026.0572.237.9402.127
Native (STATEQGP)Model=gpt-4.1, Task inst.=362026.0572.238.5302.276
LangGraph (STATEQGP)Model=gpt-4.1, Task inst.=362026.0572.238.9202.328
LETTA/MEMGPT (Standard)Model=gpt-5.4, Task inst.=362026.0572.237.250.91.718
LG+Memory (Standard)Model=gpt-5.4, Task inst.=362026.0572.236.690.53.353
Native (STATEQGP)Model=gpt-5.4, Task inst.=362026.0569.43702.337
LG+Memory (Standard)Model=gpt-4.1, Task inst.=362026.0547.231.860.63.117
Native (Verifier-gated)Model=gpt-5.4, Task inst.=362026.0547.226.4721.60.804
LETTA/MEMGPT (Standard)Model=gpt-4.1, Task inst.=362026.0544.431.833.30.412
LangGraph (Verifier-gated)Model=gpt-4.1, Task inst.=362026.0538.919.3374.70.589
Native (Verifier-gated)Model=gpt-4.1, Task inst.=362026.0533.318.64640.692
Native (Standard)Model=gpt-4.1, Task inst.=362026.0530.617.1155.70.615
LangGraph (Standard)Model=gpt-4.1, Task inst.=362026.0530.617.7868.10.7
Native (Standard)Model=gpt-5.4, Task inst.=362026.0530.620.8911.21.177
LangGraph (Verifier-gated)Model=gpt-5.4, Task inst.=362026.0522.214.8174.30.374
LangGraph (Standard)Model=gpt-5.4, Task inst.=362026.0516.711.8366.30.48
Native (Verifier-gated)Model=gpt-4.1-mini, Task inst.=362026.058.36.6487.20.128
LangGraph (Standard)Model=gpt-4.1-mini, Task inst.=362026.058.35.3686.80.106
LG+Memory (Standard)Model=gpt-4.1-mini, Task inst.=362026.055.62.2546.80.389
Native (Standard)Model=gpt-4.1-mini, Task inst.=362026.052.86.42880.103
LangGraph (Verifier-gated)Model=gpt-4.1-mini, Task inst.=362026.052.86.4488.10.103
LETTA/MEMGPT (Standard)Model=gpt-4.1-mini, Task inst.=362026.0502.3912.90.179