FAQ Annotation on Banking FAQ
35.5Top-1 AccuracyMAFA
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| MAFA2025.10 | 35.5 | 62.5 | 86.5 | 79 | 80.2 | 81.5 | |
| Single-Agent w/ AnsEmbedding=Yes2025.10 | 27 | 48 | 73 | 72.2 | 74.3 | 76.3 | |
| Single-AgentEmbedding=Yes2025.10 | 25.5 | 39.5 | 71.5 | 70.7 | 72.8 | 74.8 | |
| Single-Agent w/ AnsEmbedding=No2025.10 | 22 | 45 | 69 | 71.2 | 70.3 | 71.3 | |
| Single-AgentEmbedding=No2025.10 | 21.5 | 36.5 | 68.5 | 67.1 | 69.1 | 71.3 | |
| Embedding-Only2025.10 | 18.5 | 21 | 46.5 | 54.5 | 66.8 | 69.2 | |
| BM252025.10 | 12 | 14.5 | 21 | 38.2 | 40.1 | 43.1 |