Action Category Classification on CLIP
88.7F1 ScoreTTP+Cxt
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| TTP+CxtModel Group=BERT Models, Context Integration=+Cxt, Learning Mode=Supervised, Action Category=Appointment-related follow-up2026.05 | 88.7 | — | — | |
| DNote+CxtModel Group=BERT Models, Context Integration=+Cxt, Learning Mode=Supervised, Action Category=Appointment-related follow-up2026.05 | 88.2 | — | — | |
| TTP+CxtModel Group=BERT Models, Action Category=Case-specific instructions for patient2026.05 | 84.1 | — | — | |
| DNote+CxtModel Group=BERT Models, Action Category=Case-specific instructions for patient2026.05 | 83 | — | — | |
| GPT-5.2Model Group=LLM Models, Learning Mode=Zero-shot, Action Category=Appointment-related follow-up2026.05 | 81.2 | 90 | 74 | |
| GPT-5.2Model Group=LLM Models, Action Category=Case-specific instructions for patient2026.05 | 77.1 | 78 | 77 | |
| Gemini-3-FlashModel Group=LLM Models, Learning Mode=Zero-shot, Action Category=Appointment-related follow-up2026.05 | 76.5 | 82 | 72 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Lab-related follow-up2026.05 | 75.4 | 88.5 | 66.2 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Case-specific instructions for patient2026.05 | 75 | 75 | 75 | |
| Claude 3.5 SonnetModel Group=LLM Models, Learning Mode=Zero-shot, Action Category=Appointment-related follow-up2026.05 | 74.7 | 73 | 76 | |
| TTP+CxtModel Group=BERT Models, Action Category=Lab-related follow-up2026.05 | 74.5 | — | — | |
| DNote+CxtModel Group=BERT Models, Action Category=Lab-related follow-up2026.05 | 74.4 | — | — | |
| GPT-5.2Model Group=LLM Models, Action Category=Lab-related follow-up2026.05 | 73.3 | 73 | 74 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Lab-related follow-up2026.05 | 69.7 | 69.5 | 69.9 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Case-specific instructions for patient2026.05 | 67.7 | 67 | 69 | |
| TTP+CxtModel Group=BERT Models, Action Category=Medication-related follow-up2026.05 | 66.8 | — | — | |
| TTP+CxtModel Group=BERT Models, Action Category=Macro Average2026.05 | 66.8 | — | — | |
| DNote+CxtModel Group=BERT Models, Action Category=Medication-related follow-up2026.05 | 65.9 | — | — | |
| DNote+CxtModel Group=BERT Models, Action Category=Macro Average2026.05 | 63.1 | — | — | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Lab-related follow-up2026.05 | 60.1 | 60 | 60 | |
| DNote+CxtModel Group=BERT Models, Action Category=Procedure-related follow-up2026.05 | 59.7 | — | — | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Case-specific instructions for patient2026.05 | 58.1 | 58 | 58 | |
| GPT-5.2Model Group=LLM Models, Action Category=Macro Average2026.05 | 57 | 61.1 | 54.4 | |
| DNote+CxtModel Group=BERT Models, Action Category=Imaging-related follow-up2026.05 | 56.7 | — | — | |
| TTP+CxtModel Group=BERT Models, Action Category=Imaging-related follow-up2026.05 | 56.6 | — | — | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Medication-related follow-up2026.05 | 55.9 | 48 | 66.9 | |
| TTP+CxtModel Group=BERT Models, Action Category=Procedure-related follow-up2026.05 | 54.8 | — | — | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Macro Average2026.05 | 54.8 | 58.1 | 52.4 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Macro Average2026.05 | 54.1 | 53.1 | 55.8 | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Imaging-related follow-up2026.05 | 53.6 | 55.6 | 51.7 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Lab-related follow-up2026.05 | 52.7 | 52 | 53 | |
| GPT-5.2Model Group=LLM Models, Action Category=Imaging-related follow-up2026.05 | 52.5 | 54 | 51 | |
| MedGemma-27B-itModel Group=LLM Models, Learning Mode=Zero-shot, Action Category=Appointment-related follow-up2026.05 | 52 | 50 | 54 | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Procedure-related follow-up2026.05 | 50 | 50.6 | 49.4 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Imaging-related follow-up2026.05 | 49.2 | 51 | 48 | |
| GPT-5.2Model Group=LLM Models, Action Category=Procedure-related follow-up2026.05 | 49.1 | 50 | 48 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Imaging-related follow-up2026.05 | 48.5 | 49 | 48 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Procedure-related follow-up2026.05 | 48.3 | 49 | 47.7 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Procedure-related follow-up2026.05 | 47.6 | 48 | 47.2 | |
| DeepSeek-V3.2Model Group=LLM Models, Learning Mode=Zero-shot, Action Category=Appointment-related follow-up2026.05 | 47.4 | 45 | 50 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Procedure-related follow-up2026.05 | 46.2 | 46 | 46.4 | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Macro Average2026.05 | 44.6 | 44.6 | 44.6 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Medication-related follow-up2026.05 | 42.7 | 43 | 42.4 | |
| GPT-5.2Model Group=LLM Models, Action Category=Medication-related follow-up2026.05 | 40.5 | 42 | 39 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Macro Average2026.05 | 38.5 | 37.3 | 42.2 | |
| TTP+CxtModel Group=BERT Models, Action Category=Other helpful contextual information2026.05 | 36.5 | — | — | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Case-specific instructions for patient2026.05 | 36.3 | 37 | 36 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Medication-related follow-up2026.05 | 35 | 37.7 | 32.6 | |
| DNote+CxtModel Group=BERT Models, Action Category=Other helpful contextual information2026.05 | 34.9 | — | — | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Medication-related follow-up2026.05 | 31.3 | 31 | 31.6 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Imaging-related follow-up2026.05 | 30 | 20.4 | 56.8 | |
| GPT-5.2Model Group=LLM Models, Action Category=Other helpful contextual information2026.05 | 25 | 40.5 | 18 | |
| Gemini-3-FlashModel Group=LLM Models, Action Category=Other helpful contextual information2026.05 | 18.2 | 21 | 16 | |
| MedGemma-27B-itModel Group=LLM Models, Action Category=Other helpful contextual information2026.05 | 17.2 | 18 | 16.5 | |
| Claude 3.5 SonnetModel Group=LLM Models, Action Category=Other helpful contextual information2026.05 | 13.5 | 14 | 13 | |
| DeepSeek-V3.2Model Group=LLM Models, Action Category=Other helpful contextual information2026.05 | 11.8 | 12 | 11.6 |