FAQ annotation on Banking FAQ proprietary (test)
35.5Top-1 AccuracyMAFA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MAFA2025.10 | 35.5 | 62.5 | 86.5 | 0.79 | 0.802 | 0.815 | |
| Single-Agent w/ AnsEmbedding=Yes2025.10 | 27 | 48 | 73 | 0.722 | 0.743 | 0.763 | |
| Single-AgentEmbedding=Yes2025.10 | 25.5 | 39.5 | 71.5 | 0.707 | 0.728 | 0.748 | |
| Single-Agent w/ AnsEmbedding=No2025.10 | 22 | 45 | 69 | 0.712 | 0.703 | 0.713 | |
| Single-AgentEmbedding=No2025.10 | 21.5 | 36.5 | 68.5 | 0.671 | 0.691 | 0.713 | |
| Embedding-Only2025.10 | 18.5 | 21 | 46.5 | 0.545 | 0.668 | 0.692 | |
| BM252025.10 | 12 | 14.5 | 21 | 0.382 | 0.401 | 0.431 |