MPT
Benchmarks
Task NameDataset NameSOTA ResultTrendResults
MPT Context-Free Average
58.5F1 Score
19
MPT Context-Free, Preference Transfer
30.92Precision
19
MPT Context-Free Preference Induction
0.549Precision
19
MPT Context-Free, Preference Recall
76.1Precision
19
MPT Context-Guided Average
67.18OA-F1
19
MPT Context-Guided, Preference Transfer
26.19P-EM
19
MPT Context-Guided, Preference Induction
37.95P-EM
19
MPT Context-Guided, Preference Recall
64.88P-EM
19
MPT (test)
0.251WER
6
MPT-7B
15Attack Success Rate
4