Question Answering on QnASet (Detailed Accuracy Breakdown)
21.6Overall AccuracyLITMUS (RE)AGENT
Evaluation results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| LITMUS (RE)AGENTAbbreviation=LRA2026.04 | 21.6 | 55.3 | 15.4 | 8 | 16 | 21 | 16.8 | |
| Single AgentAbbreviation=SA2026.04 | 20.1 | 51.8 | 9.8 | 16.8 | 13.6 | 21.8 | 9.6 | |
| ThoughtAgentAbbreviation=TA2026.04 | 15.9 | 39.5 | 13 | 8 | 6.4 | 10.9 | 19.2 | |
| GPT-4.1Abbreviation=GPT2026.04 | 15.9 | 27.2 | 18.7 | 16 | 9.6 | 15.1 | 9.6 | |
| LITMUS++Abbreviation=L++2026.04 | 15.1 | 25.4 | 10.6 | 22.4 | 7.2 | 13.4 | 12 | |
| Magentic-OneAbbreviation=M12026.04 | 10 | 41.2 | 7.3 | 5.6 | 2.4 | 1.7 | 4 |