List your company
ResearchFormerly WizWand

Multi-turn Dialogue on MTBench101

9.03ScoreFull-Context
2.48844.18675.8857.5833Jan 29, 2026
Updated 8mo ago

Evaluation results

MethodLinks
Full-ContextModel=Qwen3-4B, Compression Ratio=-2026.019.03
SONICModel=Qwen3-4B, Compression Ratio=50%2026.018.43
SONICModel=Qwen3-4B, Compression Ratio=80%2026.018.3
Full-ContextModel=Qwen3-1.7B, Compression Ratio=-2026.018.11
SONICModel=Qwen3-1.7B, Compression Ratio=50%2026.016.42
SONICModel=Qwen3-1.7B, Compression Ratio=80%2026.016.32
Full-ContextModel=Qwen3-0.6B, Compression Ratio=-2026.016
SONICModel=Qwen3-0.6B, Compression Ratio=50%2026.015.61
ExpectedAttentionModel=Qwen3-4B, Compression Ratio=50%2026.015.06
H2OModel=Qwen3-4B, Compression Ratio=50%2026.015.04
ExpectedAttentionModel=Qwen3-4B, Compression Ratio=80%2026.015.02
H2OModel=Qwen3-4B, Compression Ratio=80%2026.015
SnapKVModel=Qwen3-4B, Compression Ratio=50%2026.015
StreamingLLMModel=Qwen3-4B, Compression Ratio=50%2026.014.98
H2OModel=Qwen3-1.7B, Compression Ratio=50%2026.014.88
ExpectedAttentionModel=Qwen3-1.7B, Compression Ratio=50%2026.014.84
SnapKVModel=Qwen3-1.7B, Compression Ratio=50%2026.014.76
ExpectedAttentionModel=Qwen3-1.7B, Compression Ratio=80%2026.014.74
H2OModel=Qwen3-1.7B, Compression Ratio=80%2026.014.74
StreamingLLMModel=Qwen3-1.7B, Compression Ratio=50%2026.014.71
SnapKVModel=Qwen3-4B, Compression Ratio=80%2026.014.31
SnapKVModel=Qwen3-1.7B, Compression Ratio=80%2026.014.21
StreamingLLMModel=Qwen3-4B, Compression Ratio=80%2026.014.11
SONICModel=Qwen3-0.6B, Compression Ratio=80%2026.013.93
SnapKVModel=Qwen3-0.6B, Compression Ratio=50%2026.013.93
ExpectedAttentionModel=Qwen3-0.6B, Compression Ratio=50%2026.013.92
H2OModel=Qwen3-0.6B, Compression Ratio=50%2026.013.92
StreamingLLMModel=Qwen3-1.7B, Compression Ratio=80%2026.013.77
H2OModel=Qwen3-0.6B, Compression Ratio=80%2026.013.66
ExpectedAttentionModel=Qwen3-0.6B, Compression Ratio=80%2026.013.62
StreamingLLMModel=Qwen3-0.6B, Compression Ratio=50%2026.013.58
SnapKVModel=Qwen3-0.6B, Compression Ratio=80%2026.013.21
StreamingLLMModel=Qwen3-0.6B, Compression Ratio=80%2026.012.74