Question Answering on HPC Q&A Run 2 n=1000 (test)
0.697Cosine SimilarityQwen 2.5 14B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Qwen 2.5 14BSize=14B, Latency (s)=12.11, Resp. Length=140.32026.05 | 0.697 | 0.06 | 0.832 | |
| HPC-LLMSize=8B, Latency (s)=9.27, Resp. Length=131.32026.05 | 0.693 | 0.064 | 0.831 | |
| Phi-2Size=2.7B, Latency (s)=9.12, Resp. Length=135.42026.05 | 0.677 | 0.072 | 0.845 | |
| TinyLlamaSize=1.1B, Latency (s)=6.97, Resp. Length=95.72026.05 | 0.616 | 0.072 | 0.833 |