Detection Accuracy on finance_qa
100AccuracyMC2MARK
Evaluation results
| Method | Links | |
|---|---|---|
| MC2MARKmessage_length=16, base_model=Phi-3.5-mini-instruct2026.02 | 100 | |
| MC2MARKmessage_length=32, base_model=Phi-3.5-mini-instruct2026.02 | 99.97 | |
| MC2MARKmessage_length=64, base_model=Phi-3.5-mini-instruct2026.02 | 99.59 | |
| MC2MARKmessage_length=128, base_model=Phi-3.5-mini-instruct2026.02 | 98.54 | |
| BiMarkmessage_length=16, base_model=Phi-3.5-mini-instruct2026.02 | 95.9 | |
| MC2MARKmessage_length=256, base_model=Phi-3.5-mini-instruct2026.02 | 94.08 | |
| MPAC(1.5)message_length=16, base_model=Phi-3.5-mini-instruct2026.02 | 89.25 | |
| BiMarkmessage_length=32, base_model=Phi-3.5-mini-instruct2026.02 | 88.41 | |
| MC2MARKmessage_length=512, base_model=Phi-3.5-mini-instruct2026.02 | 86.84 | |
| BiMarkmessage_length=64, base_model=Phi-3.5-mini-instruct2026.02 | 78.78 | |
| MPAC(1.5)message_length=32, base_model=Phi-3.5-mini-instruct2026.02 | 76.47 | |
| MPAC(1.0)message_length=16, base_model=Phi-3.5-mini-instruct2026.02 | 75.81 | |
| MPAC(1.5)message_length=64, base_model=Phi-3.5-mini-instruct2026.02 | 69.38 | |
| BiMarkmessage_length=128, base_model=Phi-3.5-mini-instruct2026.02 | 66.99 | |
| MPAC(1.0)message_length=32, base_model=Phi-3.5-mini-instruct2026.02 | 66.44 | |
| MPAC(1.0)message_length=64, base_model=Phi-3.5-mini-instruct2026.02 | 65.96 | |
| MPAC(1.5)message_length=128, base_model=Phi-3.5-mini-instruct2026.02 | 65.08 | |
| MPAC(1.5)message_length=256, base_model=Phi-3.5-mini-instruct2026.02 | 60.34 | |
| MPAC(1.0)message_length=128, base_model=Phi-3.5-mini-instruct2026.02 | 58.46 | |
| MPAC(1.5)message_length=512, base_model=Phi-3.5-mini-instruct2026.02 | 57.1 | |
| MPAC(1.0)message_length=256, base_model=Phi-3.5-mini-instruct2026.02 | 56.95 | |
| MPAC(1.0)message_length=512, base_model=Phi-3.5-mini-instruct2026.02 | 54.9 | |
| BiMarkmessage_length=256, base_model=Phi-3.5-mini-instruct2026.02 | 50.77 | |
| BiMarkmessage_length=512, base_model=Phi-3.5-mini-instruct2026.02 | 33.07 |