Abstention and Hallucination Evaluation on Controlled 50-item Evaluation Set (R1-R5)
98AccuracyInstruction
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| InstructionModel=GPT-4o-mini2026.03 | 98 | 0 | 82 | |
| Composite Abstention ArchitectureModel=GPT-4o-mini2026.03 | 98 | 0 | 82 | |
| InstructionModel=GPT-4o2026.03 | 98 | 0 | 82 | |
| Composite Abstention ArchitectureModel=GPT-4o2026.03 | 98 | 0 | 82 | |
| Composite Abstention ArchitectureModel=GPT-3.5-turbo2026.03 | 96 | 4 | 78 | |
| InstructionModel=GPT-3.5-turbo2026.03 | 94 | 6 | 76 | |
| GateModel=GPT-4o2026.03 | 82 | 18 | 62 | |
| GateModel=GPT-4o-mini2026.03 | 80 | 20 | 60 | |
| GateModel=GPT-3.5-turbo2026.03 | 76 | 24 | 56 | |
| BaselineModel=GPT-4o2026.03 | 70 | 30 | 50 | |
| BaselineModel=GPT-4o-mini2026.03 | 62 | 38 | 42 | |
| BaselineModel=GPT-3.5-turbo2026.03 | 50 | 50 | 30 |