Machine Reading Comprehension on CMRC (Accuracy and Performance)
81.05F1 ScoreOracle
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| OracleTransfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 81.05 | 0 | 331.9 | 1 | |
| SCDTransfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 78.5 | 87.31 | 125.2 | 2.65 | |
| DroidSpeak-styleTransfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 70.52 | 127.34 | 198.7 | 1.67 | |
| SCD (Reuse-only)Transfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 64.21 | 69.02 | 118.2 | 2.81 | |
| Raw KV (BF16)Transfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 27.25 | 115.02 | 145.5 | 2.28 | |
| Quantized (4-bit)Transfer Pair=MistralLite→Mistral-7B, Network Bandwidth (Bnet)=200 Gbps2026.06 | 12.89 | 28.76 | 59.2 | 5.6 |