Image Quality Evaluation on Storyeval (test)
69.9Image ScorePRQ INT4
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PRQ INT4Comp.=1.60, Peak VRAM=20.69, Runtime=158.02026.03 | 69.9 | 72.4 | 18.8 | — | 69.9 | |
| PRQ INT2Comp.=2.00, Peak VRAM=20.69, Runtime=155.62026.03 | 69.8 | 73.3 | 17.9 | 20.66 | 69.8 | |
| QuaRot KV INT4Comp.=3.20, Peak VRAM=19.98, Runtime=239.62026.03 | 68.7 | 68.5 | 21.7 | 19.25 | 68.9 | |
| FlowCache Prune INT4Comp.=5.43, Peak VRAM=11.75, Runtime=72.42026.03 | 68.2 | 46.5 | 49 | — | 68 | |
| FlowCache Soft-Prune INT4Comp.=5.42, Peak VRAM=11.76, Runtime=75.22026.03 | 68 | 51.8 | 41.6 | — | 67.9 | |
| RTN INT4 Recent2Comp.=2.43, Peak VRAM=21.37, Runtime=68.62026.03 | 68 | 72.1 | 18.7 | — | 68.4 | |
| RTN INT4 RefreshComp.=3.20, Peak VRAM=22.64, Runtime=64.62026.03 | 67.8 | 65.4 | 25.2 | 18.55 | 67.9 | |
| RTN INT4Comp.=3.20, Peak VRAM=19.98, Runtime=88.82026.03 | 67.4 | 66.1 | 24.5 | 18.66 | 67.5 | |
| Age-Tier INT4Comp.=3.18, Peak VRAM=14.38, Runtime=102.42026.03 | 67.4 | 66.1 | 24.5 | 18.66 | 67.6 | |
| QuaRot KV INT4 Recent2Comp.=2.43, Peak VRAM=21.69, Runtime=112.92026.03 | 66.6 | 70.7 | 22.2 | — | 67 | |
| FlowCache Native Soft-Prune INT4Comp.=5.42, Peak VRAM=11.78, Runtime=64.22026.03 | 65.7 | 43.6 | 52.3 | 11.94 | 65.7 | |
| TPTQ INT2Comp.=2.72, Peak VRAM=19.77, Runtime=166.62026.03 | 65.4 | 61.5 | 30.1 | 17.03 | 65.8 | |
| KIVI INT4 RefreshComp.=3.19, Peak VRAM=22.63, Runtime=66.72026.03 | 64.5 | 41.4 | 56.9 | 12.49 | 64.1 | |
| KIVI INT4Comp.=3.19, Peak VRAM=19.99, Runtime=93.02026.03 | 63.5 | 42.4 | 57.5 | 12.41 | 63.5 | |
| SpatialMixed fg RTN INT 4 / bg RTN INT 4Comp.=3.18, Peak VRAM=14.38, Runtime=106.62026.03 | 60.6 | 58.7 | 34.9 | — | 60.7 | |
| QAQ INT2Comp.=5.19, Peak VRAM=14.42, Runtime=109.92026.03 | 57.9 | 32.4 | 63.5 | 11.79 | 58.5 | |
| QAQ INT4Comp.=3.15, Peak VRAM=14.42, Runtime=109.92026.03 | 56.7 | 23.8 | 71.9 | 11.03 | 57.1 | |
| FlowCache Soft-Prune INT2Comp.=6.72, Peak VRAM=11.76, Runtime=74.42026.03 | 53.2 | 49.7 | 49.5 | 14.18 | 53.6 | |
| KIVI INT2Comp.=5.31, Peak VRAM=19.99, Runtime=94.72026.03 | 53.1 | 24.3 | 73.5 | — | 52.7 | |
| FlowCache Prune INT2Comp.=7.68, Peak VRAM=11.14, Runtime=70.22026.03 | 51.6 | 49.2 | 50.6 | 14.26 | 51.6 | |
| FlowCache Adaptive INT2Comp.=4.26, Peak VRAM=14.38, Runtime=91.32026.03 | 49.8 | 45.1 | 52.8 | — | 49.6 | |
| FlowCache Hybrid INT2Comp.=4.59, Peak VRAM=14.38, Runtime=82.22026.03 | 49.2 | 47.9 | 51.2 | 13.95 | 49.4 | |
| QuaRot KV INT2Comp.=5.33, Peak VRAM=19.98, Runtime=239.02026.03 | 47.7 | 44.3 | 53.2 | 13.01 | 48 | |
| Age-Tier INT2Comp.=4.41, Peak VRAM=14.38, Runtime=101.92026.03 | 46.9 | 46.3 | 52.3 | 13.67 | 47.3 | |
| RTN INT2Comp.=5.33, Peak VRAM=19.98, Runtime=86.12026.03 | 46.4 | 45.9 | 52.6 | 13.57 | 47.1 | |
| SpatialMixed fg KIVI INT 4 / bg KIVI INT 2Comp.=3.45, Peak VRAM=14.38, Runtime=110.22026.03 | 45.4 | 45.3 | 65.4 | 13.2 | 45.1 | |
| SpatialMixed fg RTN INT 4 / bg RTN INT 2Comp.=3.69, Peak VRAM=14.38, Runtime=106.62026.03 | 42.1 | 43 | 58.7 | 12.64 | 41.9 | |
| Spatial Mixed (QuaRot fg, RTN bg)Comp.=3.46, Peak VRAM=14.38, Runtime=224.12026.03 | 40 | 44.4 | 59.9 | 12.97 | 39.8 |