Question Answering on LongBench (8K Context)
11.6HotpotQAFOCUSFT
Evaluation Results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FOCUSFTcontext length=8K2026.05 | 11.6 | 33.8 | 11.3 | 12.8 | 17.4 | |
| Standard SFTcontext length=8K2026.05 | 10.7 | 28.6 | 8.7 | 12.2 | 15 |
Loading the SOTA2 catalog…
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FOCUSFTcontext length=8K2026.05 | 11.6 | 33.8 | 11.3 | 12.8 | 17.4 | |
| Standard SFTcontext length=8K2026.05 | 10.7 | 28.6 | 8.7 | 12.2 | 15 |