List your company
ResearchFormerly WizWand

Rubric-based scoring on NCTE 1-7 scoring scale (transcript segments)

0.96MAEConstant Baseline
0.81521.79262.773.7474Apr 18, 2026
Updated 4mo ago

Evaluation results

MethodLinks
Constant BaselineInference protocol=Median prediction for MAE and mean prediction for MSE2026.040.961.35
DeBERTaV3 largeFine-tuning status=Fine-Tuned2026.040.961.31
BERT largeFine-tuning status=Fine-Tuned2026.040.971.34
RoBERTa baseFine-tuning status=Fine-Tuned2026.040.971.34
RoBERTa largeFine-tuning status=Fine-Tuned2026.040.971.37
ALBERT baseFine-tuning status=Fine-Tuned2026.040.981.34
BERT baseFine-tuning status=Fine-Tuned2026.040.981.36
ALBERT largeFine-tuning status=Fine-Tuned2026.040.991.45
DeBERTaV3 baseFine-tuning status=Fine-Tuned2026.0411.56
Mistral Small InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.021.78
Qwen2 4B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.182.29
Mixtral 8x22B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.212.41
Mixtral 8x7B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.392.85
Qwen2 30B A3B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.563.59
Llama 3.1 8B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.633.98
Qwen2 235B A22B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.674.16
Mistral Small 24B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.754.28
Llama 3.1 70B InstructFine-tuning status=Non-Fine-Tuned, Inference protocol=Prompted inference2026.041.985.32
RoBERTa largeFine-tuning status=Non-Fine-Tuned2026.043.2712.01
DeBERTaV3 largeFine-tuning status=Non-Fine-Tuned2026.043.6614.65
DeBERTaV3 baseFine-tuning status=Non-Fine-Tuned2026.044.0817.97
ALBERT largeFine-tuning status=Non-Fine-Tuned2026.044.2219.1
RoBERTa baseFine-tuning status=Non-Fine-Tuned2026.044.3320.08
ALBERT baseFine-tuning status=Non-Fine-Tuned2026.044.3420.12
BERT largeFine-tuning status=Non-Fine-Tuned2026.044.4521.07
BERT baseFine-tuning status=Non-Fine-Tuned2026.044.5822.29