1-year Pancreatic Cancer prediction on EHRSHOT (test)
13.6F1 Score (std)LLMLingua2
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLMLingua2Backbone=Qwen2.5-7B2026.05 | 13.6 | 99.4 | 92.8 | 23.1 | — | |
| MedTPEBackbone=Qwen2.5-7B2026.05 | 13.2 | 99.6 | 54.9 | 23.1 | — | |
| Qwen2.5-7B2026.05 | 12.6 | 100 | 78.2 | — | — | |
| Gemma2-2B2026.05 | 8.9 | 98.3 | 19 | — | — | |
| MedTPEBackbone=Llama3-8B2026.05 | 6.8 | 98.9 | 77.6 | 28.3 | — | |
| MedTPEBackbone=Qwen2.5-1.5B2026.05 | 6.6 | 94.7 | 11.5 | 23.1 | — | |
| MedTPEBackbone=Gemma2-2B2026.05 | 6.4 | 95 | 14.6 | 21.2 | — | |
| LLMLingua2Backbone=Llama3-8B2026.05 | 6.1 | 97.8 | 190.4 | 28.3 | — | |
| Llama3-8B2026.05 | 5.5 | 99.9 | 152.7 | — | — | |
| Meditron3-8B2026.05 | 5.5 | 98.9 | 59.4 | — | — | |
| MedTPEBackbone=Llama3-1B2026.05 | 4.7 | 90 | 15.9 | 28.3 | — | |
| Qwen2.5-1.5B2026.05 | 4.7 | 87.7 | 30.8 | — | — | |
| LLMLingua2Backbone=Gemma2-2B2026.05 | 4.5 | 85.4 | 21.3 | 21.2 | — | |
| LLMLingua2Backbone=Qwen2.5-1.5B2026.05 | 4.4 | 86 | 32.1 | 23.1 | — | |
| LLMLingua2Backbone=Meditron3-8B2026.05 | 4.2 | 82.5 | 77.3 | 28.3 | — | |
| MedTPEBackbone=Meditron3-8B2026.05 | 4 | 98.9 | 37.6 | 28.3 | — | |
| Llama3-1B2026.05 | 3.9 | 74.8 | 28.5 | — | — | |
| LLMLingua2Backbone=Llama3-1B2026.05 | 2.4 | 50.3 | 39.3 | 28.3 | — | |
| MedTPEBackbone=Qwen2.5-1.5B, Compression Method=MedTPE2026.05 | 0.066 | 0.947 | — | 23.1 | 11.5 | |
| MedTPEBackbone=Llama3-1B, Compression Method=MedTPE2026.05 | 0.047 | 0.9 | — | 28.3 | 15.9 | |
| Qwen2.5-1.5BBackbone=Qwen2.5-1.5B, Compression Method=None (Original LLM)2026.05 | 0.047 | 0.877 | — | — | 30.8 | |
| LLMLingua2Backbone=Qwen2.5-1.5B, Compression Method=LLMLingua22026.05 | 0.044 | 0.86 | — | 23.1 | 32.1 | |
| Llama3-1BBackbone=Llama3-1B, Compression Method=None (Original LLM)2026.05 | 0.039 | 0.748 | — | — | 28.5 | |
| T5SummaryBackbone=Llama3-1B, Compression Method=T5Summary2026.05 | 0.039 | 0.94 | — | 99.9 | 2.5 | |
| LLMLingua2Backbone=Llama3-1B, Compression Method=LLMLingua22026.05 | 0.024 | 0.503 | — | 28.3 | 39.3 | |
| T5SummaryBackbone=Qwen2.5-1.5B, Compression Method=T5Summary2026.05 | 0.018 | 0.78 | — | 99.9 | 2.3 | |
| ZeTTBackbone=Llama3-1B, Compression Method=ZeTT2026.05 | 0.017 | 0.993 | — | 28.3 | 122.7 | |
| ZeTTBackbone=Qwen2.5-1.5B, Compression Method=ZeTT2026.05 | 0 | 0.884 | — | 23.1 | 120.6 |