List your company
ResearchFormerly WizWand

Long-term Memory on LongMemEval

90.8ScoreGemma-4-31B-it
48.180859.245470.3181.3746May 19, 2026May 21, 2026May 24, 2026May 26, 2026May 29, 2026May 31, 2026Jun 3, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Gemma-4-31B-itBackbone=Gemma-4-31B-it, Quantization Method=BF162026.0590.8
Mix-QuantBackbone=Gemma-4-31B-it, Quantization Method=Mix-Quant2026.0590.4
Gemma-4-31B-it-NVFP4Backbone=Gemma-4-31B-it, Quantization Method=NVFP4 W4A42026.0589.2
Qwen3.5-9BBackbone=Qwen3.5-9B, Quantization Method=BF162026.0586.27
Mix-QuantBackbone=Qwen3.5-9B, Quantization Method=Mix-Quant2026.0584.27
Gemma-4-26B-A4B-itBackbone=Gemma-4-26B-A4B-it, Quantization Method=BF162026.0580.5
Qwen3.5-9B-NVFP4Backbone=Qwen3.5-9B, Quantization Method=NVFP4 W4A42026.0578
PERSONATREEBackbone=Gemini 3 Flash2026.0676.2
TiMemBackbone=GPT-5.4 Mini2026.0674.9
Benchmark strongBackbone=GPT-5.4 Mini2026.0674.5
PERSONATREEBackbone=GPT-5.4 Mini2026.0674.3
TiMemBackbone=Gemini 3 Flash2026.0673.6
Benchmark strongBackbone=Gemini 3 Flash2026.0673.4
TiMemBackbone=Qwen3-32B2026.0672.7
Mix-QuantBackbone=Gemma-4-26B-A4B-it, Quantization Method=Mix-Quant2026.0572.45
PERSONATREEBackbone=Qwen3-32B2026.0672.3
A-MEMBackbone=GPT-5.4 Mini2026.0672.3
Benchmark strongBackbone=Qwen3-32B2026.0672.1
Mem0Backbone=GPT-5.4 Mini2026.0671.7
A-MEMBackbone=Gemini 3 Flash2026.0670.9
Flat retrievalBackbone=GPT-5.4 Mini2026.0670.3
A-MEMBackbone=Qwen3-32B2026.0670
Mem0Backbone=Gemini 3 Flash2026.0670
Flat retrievalBackbone=Gemini 3 Flash2026.0669.1
Mem0Backbone=Qwen3-32B2026.0668.6
Flat retrievalBackbone=Qwen3-32B2026.0668.1
Gemma-4-26B-A4B-it-NVFP4Backbone=Gemma-4-26B-A4B-it, Quantization Method=NVFP4 W4A42026.0562.42
Qwen3-8BBackbone=Qwen3-8B, Quantization Method=BF162026.0557
Mix-QuantBackbone=Qwen3-8B, Quantization Method=Mix-Quant2026.0554.85
Qwen3-8B-NVFP4Backbone=Qwen3-8B, Quantization Method=NVFP4 W4A42026.0549.82