Question Answering on ∞Bench Zh.QA
49.1F1 ScoreEXTAGENTS
Evaluation results
| Method | Links | |
|---|---|---|
| EXTAGENTSBase Model=gpt-4o-mini-2024-07-18, Input (#tokens)=1024k2025.05 | 49.1 | |
| LLM×MapReduceBase Model=gpt-4o-mini-2024-07-18, Input (#tokens)=128k2025.05 | 44.3 | |
| EXTAGENTSBase Model=Llama-3.1-8B-Instruct, Input (#tokens)=256k2025.05 | 35.2 | |
| LLM×MapReduceBase Model=Llama-3.1-8B-Instruct, Input (#tokens)=128k2025.05 | 34.7 | |
| Direct InputBase Model=Llama-3.1-8B-Instruct, Input (#tokens)=128k2025.05 | 31.6 | |
| Direct InputBase Model=gpt-4o-mini-2024-07-18, Input (#tokens)=128k2025.05 | 20.6 | |
| Direct InputBase Model=DeepSeek-R1-Distill-Llama-8B, Input (#tokens)=32k2025.05 | 14.4 |