Question Answering on HotpotQA (F1 and ROUGE-L)
65F1 ScoreKVComm
Evaluation results
| Method | Links | ||
|---|---|---|---|
| KVCommSender Model (Ms)=huihui-ai/Llama-3.2-3B-Instruct-abliterated, Receiver Model (Mr)=suayptalha/DeepSeek-R1-Distill-Llama-3B, Communication Ratio (M)=0.72025.10 | 65 | 65 | |
| KVCommSender Model (Ms)=ehristoforu/falcon3-ultraset, Receiver Model (Mr)=huihui-ai/Falcon3-7B-Instruct-abliterated, Communication Ratio (M)=0.52025.10 | 63 | 63 |