Multiple Choice Questions on Four-domain MCQ (test)
82.1AccuracyStill
Evaluation results
| Method | Links | |
|---|---|---|
| StillContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 82.1 | |
| StillContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 81 | |
| AMContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 80 | |
| H2OContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 78 | |
| StillContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 78 | |
| StillContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 77.3 | |
| AMContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 76 | |
| AM-OMPContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 69 | |
| AM-OMPContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 68 | |
| StillContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 67.3 | |
| SnapKVContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 66 | |
| H2OContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 66 | |
| KV-DistillContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 65.3 | |
| AMContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 62.8 | |
| SnapKVContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 61 | |
| AM-OMPContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 60 | |
| KV-DistillContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 59.7 | |
| AMContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 59.3 | |
| KV-DistillContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 58 | |
| Summ.Context length=8k, Compression ratio=8x, Cache budget=10242026.06 | 58 | |
| KVZipContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 56.3 | |
| KVZipContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 56 | |
| Summ.Context length=8k, Compression ratio=16x, Cache budget=5122026.06 | 56 | |
| AMContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 54 | |
| H2OContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 53.2 | |
| KV-DistillContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 53 | |
| H2OContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 51.3 | |
| Summ.Context length=16k, Compression ratio=8x, Cache budget=20482026.06 | 50.3 | |
| AM-OMPContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 50 | |
| KV-DistillContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 48.7 | |
| StreamingLLMContext length=8k, Compression ratio=8x, Cache budget=10242026.06 | 47 | |
| AM-OMPContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 45 | |
| KVZipContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 43 | |
| Summ.Context length=32k, Compression ratio=8x, Cache budget=40962026.06 | 38 | |
| StreamingLLMContext length=8k, Compression ratio=16x, Cache budget=5122026.06 | 36 | |
| H2OContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 35.7 | |
| Summ.Context length=64k, Compression ratio=8x, Cache budget=81922026.06 | 34.7 | |
| SnapKVContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 31.1 | |
| StreamingLLMContext length=16k, Compression ratio=8x, Cache budget=20482026.06 | 29.7 | |
| StreamingLLMContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 24 | |
| SnapKVContext length=32k, Compression ratio=8x, Cache budget=40962026.06 | 23.3 | |
| StreamingLLMContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 23.3 | |
| SnapKVContext length=64k, Compression ratio=8x, Cache budget=81922026.06 | 22 |