Viral mutation extraction on Influenza A viral proteins
53F1-ScoreVILLA
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| VILLAResponse Generator=Qwen3-Instruct:80B, Datastore=Influenza A (239)2026.03 | 53 | 57 | 51 | |
| HiPerRAGResponse Generator=GPT-4o, Datastore=Influenza A (239)2026.03 | 10 | 52 | 6 | |
| HiPerRAGResponse Generator=GPT-4o, Datastore=ASM journal (~ 440K)2026.03 | 9 | 50 | 5 | |
| PaperQA2 (RAG mode)Response Generator=Llama 3.1:8B, Datastore=Influenza A (239)2026.03 | 7 | 27 | 5 | |
| PaperQA2 (Agent mode)Response Generator=Llama 3.1:8B, Datastore=Influenza A (239)2026.03 | 5 | 43 | 3 | |
| VILLAResponse Generator=Llama 3.1:8B, Datastore=Influenza A (239)2026.03 | 3 | 3 | 8 | |
| OpenScholarResponse Generator=Llama 3.1:8B, Datastore=Semantic scholar (45 million)2026.03 | 2 | 4 | 1 | |
| HiPerRAGResponse Generator=Llama 3.1:8B, Datastore=ASM journal (~ 440K)2026.03 | 1 | 4 | 1 |