Question Answering on MRAMG-Bench QA subset
40.8F1 ScoreCHOP
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| CHOPTop-K=102026.04 | 40.8 | 35.91 | 73.96 | |
| Native-500TTop-K=102026.04 | 40.72 | 35.73 | 73.81 | |
| CHOPTop-K=52026.04 | 38.14 | 34.12 | 73.49 | |
| Native-500TTop-K=52026.04 | 37.92 | 33.94 | 73.38 | |
| Cosine-ChunkingTop-K=102026.04 | 35.77 | 31.07 | 72.56 | |
| CHOPTop-K=32026.04 | 35.13 | 31.64 | 72.57 | |
| Native-500TTop-K=32026.04 | 34.97 | 31.44 | 72.53 | |
| Cosine-ChunkingTop-K=52026.04 | 33.51 | 29.62 | 72.06 | |
| Cosine-ChunkingTop-K=32026.04 | 30.93 | 27.3 | 71.19 | |
| Native-500TTop-K=12026.04 | 27.63 | 24.72 | 69.92 | |
| CHOPTop-K=12026.04 | 27.6 | 24.75 | 69.98 | |
| Cosine-ChunkingTop-K=12026.04 | 23.99 | 21.43 | 68.49 |