Utility Evaluation on NQ-Open
5.13Delta NQ-OpenCNT
Evaluation results
| Method | Links | |
|---|---|---|
| CNTModel=Llama3.2-3B, Transfer Rate (TR)=0.00112026.03 | 5.13 | |
| RDModel=Yi-1.5-6B2026.03 | 1.53 | |
| RDModel=Llama3.2-3B2026.03 | 1.03 | |
| RDModel=DeepSeek-V2-Lite2026.03 | 0.53 | |
| RDModel=Average2026.03 | 0.51 | |
| RDModel=Llama3-8B2026.03 | 0.41 | |
| CNTModel=Llama3-8B, Transfer Rate (TR)=0.00232026.03 | 0.27 | |
| CNTModel=Average, Transfer Rate (TR)=0.00142026.03 | -0.11 | |
| RDModel=Mistral-Nemo-Instruct2026.03 | -0.97 | |
| CNTModel=Mistral-Nemo-Instruct, Transfer Rate (TR)=0.00242026.03 | -1.38 | |
| CNTModel=DeepSeek-V2-Lite, Transfer Rate (TR)=0.00082026.03 | -1.68 | |
| CNTModel=Yi-1.5-6B, Transfer Rate (TR)=0.00022026.03 | -2.88 | |
| ActSVD-OPModel=Yi-1.5-6B2026.03 | -5.7 | |
| ActSVD-OPModel=Llama3.2-3B2026.03 | -6.87 | |
| ActSVD-OPModel=Average2026.03 | -11.73 | |
| ActSVD-OPModel=Mistral-Nemo-Instruct2026.03 | -12.08 | |
| ActSVD-OPModel=Llama3-8B2026.03 | -22.28 |