List your company

Clinical Trial Eligibility Classification on N2C2 2018 (test)

89.05Micro F1 ScoreMedGemma 27b-it
71.73476.229580.72585.2205Apr 6, 2026

Evaluation results

MethodLinks
MedGemma 27b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-large2026.0489.0586.0288.4589.22
MedGemma 27b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-small2026.0488.885.1588.8989.06
MedGemma 27b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=ORI2026.0488.4983.3790.6389.02
Llama 3.1 8b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=ORI2026.0486.7180.5189.9887.4
MedGemma 27b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=NER2026.0486.2982.8485.1986.45
Llama 3.1 8b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-large2026.0485.482.6583.0185.42
Llama 3.1 8b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-small2026.0485.3377.5591.0786.34
Llama 3.1 8b-itFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=NER2026.0482.9375.9186.4983.69
GPT-oss 20bFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-small2026.0481.7277.280.3981.93
GPT-oss20bFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=RAG, Embedding Model=BAAI-large2026.0481.1776.5779.7481.37
GPT-oss20bFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=ORI2026.0479.174.6876.4779.21
GPT-oss20bFinetune Strategy=LoRA, Token Limit=8192, Input Strategy=NER2026.0474.5369.271.4674.65
GatorTron-2kFinetune Strategy=Full Finetune, Token Limit=2048, Input Strategy=NER2026.0474.236970.8174.33
BERTFinetune Strategy=Full Finetune, Token Limit=512, Input Strategy=NER2026.0472.466.3269.9372.6