List your company
ResearchFormerly WizWand

Question Answering on SpeechTriviaQA

42.2AccuracyAudioKV
19.746425.575731.40537.2343Apr 8, 2026
Updated 6mo ago

Evaluation results

MethodLinks
AudioKVModel=Qwen2.5-Omni-7B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0442.2
AdaKVModel=Qwen2.5-Omni-7B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0440.8
PyramidKVModel=Qwen2.5-Omni-7B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0439.8
SnapKVModel=Qwen2.5-Omni-7B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0439.6
AudioKVModel=Qwen2.5-Omni-3B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0431.9
AdaKVModel=Qwen2.5-Omni-3B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0430.6
PyramidKVModel=Qwen2.5-Omni-3B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0428.3
SnapKVModel=Qwen2.5-Omni-3B, KV cache budget=40%, max_gen_tokens=64, Judge=Gemini 2.5 Flash2026.0427.4
APinlin=✓, ldeep=-, FRR=93.56, Pre. GFLOPs=730.28, FLOPs Ratio=93.51, Setting=Conservative (τin=0.90, τdeep=0.80)2026.0421.58
Vanillalin=-, ldeep=-, FRR=100.0, Pre. GFLOPs=780.94, FLOPs Ratio=100.0, Setting=N/A2026.0421.29
APdeeplin=-, ldeep=✓, FRR=14.30, Pre. GFLOPs=718.12, FLOPs Ratio=91.96, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.0421.19
APdeeplin=-, ldeep=✓, FRR=33.29, Pre. GFLOPs=731.96, FLOPs Ratio=93.73, Setting=Conservative (τin=0.90, τdeep=0.80)2026.0421.09
APinlin=✓, ldeep=-, FRR=78.64, Pre. GFLOPs=612.93, FLOPs Ratio=78.49, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.0420.9
DAPlin=✓, ldeep=✓, FRR=33.76, Pre. GFLOPs=686.39, FLOPs Ratio=87.89, Setting=Conservative (τin=0.90, τdeep=0.80)2026.0420.9
DAPlin=✓, ldeep=✓, FRR=14.91, Pre. GFLOPs=566.30, FLOPs Ratio=72.52, Setting=Aggressive (τin=0.80, τdeep=0.70)2026.0420.61