Clinical Contextual Question Answering on Finnish breast cancer EHR dataset Reduced subset N=955 1.0
90.6V1 AccuracyLlama-Poro-2-70B
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Llama-Poro-2-70BDeveloper=LumiOpen, VRAM (GB) Min=132.1, VRAM (GB) Max=135.1, Latency (s) Min=2.1, Latency (s) Max=154.12026.03 | 90.6 | 91.8 | 92.5 | |
| Llama-Poro-2-8BDeveloper=LumiOpen, VRAM (GB) Min=15.3, VRAM (GB) Max=16.8, Latency (s) Min=0.3, Latency (s) Max=19.52026.03 | 70.2 | 69.3 | 82.1 |