Coreference Resolution on CoreRes
94.79AccuracyFull-Context
Evaluation results
| Method | Links | |
|---|---|---|
| Full-ContextModel=Qwen3-4B, Compression Ratio=-2026.01 | 94.79 | |
| Full-ContextModel=Qwen3-1.7B, Compression Ratio=-2026.01 | 87.53 | |
| SONICModel=Qwen3-4B, Compression Ratio=50%2026.01 | 69.01 | |
| SONICModel=Qwen3-4B, Compression Ratio=80%2026.01 | 68.4 | |
| Full-ContextModel=Qwen3-0.6B, Compression Ratio=-2026.01 | 57.36 | |
| SONICModel=Qwen3-1.7B, Compression Ratio=50%2026.01 | 49.48 | |
| H2OModel=Qwen3-4B, Compression Ratio=50%2026.01 | 48.06 | |
| SnapKVModel=Qwen3-4B, Compression Ratio=50%2026.01 | 46.73 | |
| ExpectedAttentionModel=Qwen3-1.7B, Compression Ratio=50%2026.01 | 45.09 | |
| ExpectedAttentionModel=Qwen3-4B, Compression Ratio=50%2026.01 | 45 | |
| SONICModel=Qwen3-0.6B, Compression Ratio=50%2026.01 | 29.45 | |
| SONICModel=Qwen3-1.7B, Compression Ratio=80%2026.01 | 24.07 | |
| SONICModel=Qwen3-0.6B, Compression Ratio=80%2026.01 | 23.92 | |
| ExpectedAttentionModel=Qwen3-0.6B, Compression Ratio=50%2026.01 | 19.33 | |
| SnapKVModel=Qwen3-0.6B, Compression Ratio=50%2026.01 | 19.22 | |
| SnapKVModel=Qwen3-1.7B, Compression Ratio=50%2026.01 | 19.22 | |
| H2OModel=Qwen3-0.6B, Compression Ratio=50%2026.01 | 11.25 | |
| H2OModel=Qwen3-1.7B, Compression Ratio=50%2026.01 | 11.25 | |
| ExpectedAttentionModel=Qwen3-4B, Compression Ratio=80%2026.01 | 9.2 | |
| ExpectedAttentionModel=Qwen3-0.6B, Compression Ratio=80%2026.01 | 6.03 | |
| ExpectedAttentionModel=Qwen3-1.7B, Compression Ratio=80%2026.01 | 6.03 | |
| SnapKVModel=Qwen3-4B, Compression Ratio=80%2026.01 | 2.56 | |
| SnapKVModel=Qwen3-0.6B, Compression Ratio=80%2026.01 | 0.72 | |
| SnapKVModel=Qwen3-1.7B, Compression Ratio=80%2026.01 | 0.72 | |
| StreamingLLMModel=Qwen3-0.6B, Compression Ratio=80%2026.01 | 0 | |
| H2OModel=Qwen3-0.6B, Compression Ratio=80%2026.01 | 0 | |
| StreamingLLMModel=Qwen3-0.6B, Compression Ratio=50%2026.01 | 0 | |
| StreamingLLMModel=Qwen3-1.7B, Compression Ratio=80%2026.01 | 0 | |
| H2OModel=Qwen3-1.7B, Compression Ratio=80%2026.01 | 0 | |
| StreamingLLMModel=Qwen3-1.7B, Compression Ratio=50%2026.01 | 0 | |
| StreamingLLMModel=Qwen3-4B, Compression Ratio=80%2026.01 | 0 | |
| H2OModel=Qwen3-4B, Compression Ratio=80%2026.01 | 0 | |
| StreamingLLMModel=Qwen3-4B, Compression Ratio=50%2026.01 | 0 |