30-day Readmission on EHRSHOT (test)
21.2F1 Score (std)LLMLingua2
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| LLMLingua2Backbone=Qwen2.5-7B2026.05 | 21.2 | 99 | 95.7 | 22.8 | — | |
| MedTPEBackbone=Qwen2.5-7B2026.05 | 21.2 | 99.6 | 59.1 | 22.8 | — | |
| Meditron3-8B2026.05 | 21.2 | 99.5 | 57.4 | — | — | |
| Qwen2.5-7B2026.05 | 21.1 | 100 | 95.7 | — | — | |
| Llama3-8B2026.05 | 21.1 | 99.8 | 126.1 | — | — | |
| MedTPEBackbone=Llama3-8B2026.05 | 21.1 | 99.5 | 63.2 | 27.5 | — | |
| MedTPEBackbone=Meditron3-8B2026.05 | 21.1 | 100 | 36.7 | 27.5 | — | |
| MedTPEBackbone=Qwen2.5-1.5B2026.05 | 20.9 | 99 | 10 | 22.8 | — | |
| MedTPEBackbone=Qwen2.5-1.5B, Compression Method=MedTPE2026.05 | 20.9 | 99 | — | 22.8 | 10 | |
| MedTPEBackbone=Gemma2-2B2026.05 | 20.6 | 97.3 | 10.9 | 20.5 | — | |
| Qwen2.5-1.5B2026.05 | 20.5 | 98.9 | 15.2 | — | — | |
| Qwen2.5-1.5BBackbone=Qwen2.5-1.5B, Compression Method=None (Original LLM)2026.05 | 20.5 | 98.9 | — | — | 15.2 | |
| LLMLingua2Backbone=Llama3-8B2026.05 | 19.8 | 94.5 | 182.5 | 27.5 | — | |
| MedTPEBackbone=Llama3-1B2026.05 | 19.1 | 87.7 | 16.6 | 27.5 | — | |
| MedTPEBackbone=Llama3-1B, Compression Method=MedTPE2026.05 | 19.1 | 87.7 | — | 27.5 | 16.6 | |
| Gemma2-2B2026.05 | 19 | 90.5 | 19.4 | — | — | |
| T5SummaryBackbone=Llama3-1B, Compression Method=T5Summary2026.05 | 19 | 90.9 | — | 99.9 | 5.8 | |
| LLMLingua2Backbone=Qwen2.5-1.5B2026.05 | 17.6 | 86 | 25.3 | 22.8 | — | |
| LLMLingua2Backbone=Qwen2.5-1.5B, Compression Method=LLMLingua22026.05 | 17.6 | 86 | — | 22.8 | 25.3 | |
| T5SummaryBackbone=Qwen2.5-1.5B, Compression Method=T5Summary2026.05 | 16.6 | 81.7 | — | 99.9 | 2.5 | |
| LLMLingua2Backbone=Meditron3-8B2026.05 | 11.8 | 58.7 | 93.4 | 27.5 | — | |
| Llama3-1B2026.05 | 9.8 | 42.5 | 28.1 | — | — | |
| Llama3-1BBackbone=Llama3-1B, Compression Method=None (Original LLM)2026.05 | 9.8 | 42.5 | — | — | 28.1 | |
| LLMLingua2Backbone=Llama3-1B2026.05 | 7.1 | 32.6 | 57.8 | 27.5 | — | |
| LLMLingua2Backbone=Llama3-1B, Compression Method=LLMLingua22026.05 | 7.1 | 32.6 | — | 27.5 | 57.8 | |
| LLMLingua2Backbone=Gemma2-2B2026.05 | 3.6 | 20.7 | 26.3 | 20.5 | — | |
| ZeTTBackbone=Llama3-1B, Compression Method=ZeTT2026.05 | 3 | 95.6 | — | 27.5 | 199.4 | |
| ZeTTBackbone=Qwen2.5-1.5B, Compression Method=ZeTT2026.05 | 0.2 | 61.4 | — | 22.8 | 117.9 |