List your company
ResearchFormerly WizWand

Binary Classification on Therapist Q&A (test)

0.598Kappa (κF1)MentalRoBERTa (MLP Labels)
0.463840.498670.53350.56833Nov 3, 2025
Updated 8mo ago

Evaluation results

MethodLinks
MentalRoBERTa (MLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=MLP Labels, Annotator Model=GPT-4, Confidence Threshold=0.72025.110.598
MentalRoBERTa (MLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=MLP Labels, Annotator Model=GPT-4, Confidence Threshold=0.52025.110.574
MentalRoBERTa (RLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=RLP Labels, Annotator Model=GPT-4, Confidence Threshold=0.72025.110.572
MentalRoBERTa (RLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=RLP Labels, Annotator Model=GPT-4, Confidence Threshold=0.52025.110.571
MentalRoBERTa (RLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=RLP Labels, Annotator Model=GPT-4o, Confidence Threshold=0.52025.110.556
MentalRoBERTa (RLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=RLP Labels, Annotator Model=GPT-4o, Confidence Threshold=0.72025.110.551
MentalRoBERTa (MLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=MLP Labels, Annotator Model=GPT-4o, Confidence Threshold=0.72025.110.531
MentalRoBERTa (Golden Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=Golden Labels, Annotator Model=GPT-4, Confidence Threshold=0.52025.110.515
MentalRoBERTa (Golden Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=Golden Labels, Annotator Model=GPT-4o, Confidence Threshold=0.52025.110.503
MentalRoBERTa (Golden Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=Golden Labels, Annotator Model=GPT-4, Confidence Threshold=0.72025.110.481
MentalRoBERTa (Golden Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=Golden Labels, Annotator Model=GPT-4o, Confidence Threshold=0.72025.110.475
MentalRoBERTa (MLP Labels)Backbone Model=MentalRoBERTa, Labeling Strategy=MLP Labels, Annotator Model=GPT-4o, Confidence Threshold=0.52025.110.469