Abductive Natural Language Inference on AlphaNLI n=300 per condition (test)
95AccuracyFlat
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| FlatModel=gemma-4-31B-it2026.06 | 95 | 0 | 98 | 28.6 | — | |
| Transactional leadershipModel=gemma-4-31B-it2026.06 | 93 | 0 | 100 | 0 | — | |
| accept-only ablationModel=gemma-4-31B-it2026.06 | 93 | 0 | 100 | 0 | — | |
| Transformational leadershipModel=gemma-4-31B-it2026.06 | 92.7 | 6.3 | 99 | 4.8 | — | |
| Transactional leadershipModel=gpt-oss-120b2026.06 | 92.3 | 0 | 100 | 0 | — | |
| accept-only ablationModel=gpt-oss-120b2026.06 | 92.3 | 0 | 100 | 0 | — | |
| Situational leadershipModel=gpt-oss-120b2026.06 | 92.3 | 16.7 | 98 | 13 | — | |
| FlatModel=gpt-oss-120b2026.06 | 92 | 0 | 97.7 | 13 | — | |
| Theory-free controlModel=gemma-4-31B-it2026.06 | 92 | 0 | 99 | 0 | — | |
| directives-only ablationModel=gemma-4-31B-it2026.06 | 92 | 6.3 | 99 | 0 | — | |
| directives-only ablationModel=gpt-oss-120b2026.06 | 91.7 | 10 | 97.3 | 8.7 | — | |
| Situational leadershipModel=gemma-4-31B-it2026.06 | 91.7 | 27.3 | 98 | 4.8 | — | |
| Theory-free controlModel=gpt-oss-120b2026.06 | 90.3 | 0 | 96.3 | 8.7 | — | |
| Transformational leadershipModel=gpt-oss-120b2026.06 | 90.3 | 10 | 96.3 | 8.7 | — | |
| Situational leadershipModel=llama-4-scout2026.06 | 89.3 | 34 | 95.3 | 27.5 | — | |
| Theory-free controlModel=llama-4-scout2026.06 | 88 | 0 | 95.3 | 22.5 | — | |
| directives-only ablationModel=llama-4-scout2026.06 | 88 | 15.3 | 96 | 20 | — | |
| FlatModel=llama-4-scout2026.06 | 87.3 | 0 | 96 | 17.5 | — | |
| Transformational leadershipModel=llama-4-scout2026.06 | 87.3 | 15.3 | 95.3 | 20 | — | |
| Transactional leadershipModel=llama-4-scout2026.06 | 86.7 | 0 | 100 | 0 | — | |
| accept-only ablationModel=llama-4-scout2026.06 | 86.7 | 0 | 100 | 0 | — | |
| accept-only ablationModel=gpt-oss-120b2026.06 | — | — | — | — | 92.3 | |
| accept-only ablationModel=llama-4-scout2026.06 | — | — | — | — | 86.7 | |
| accept-only ablationModel=gemma-4-31B-it2026.06 | — | — | — | — | 93 | |
| directives-only ablationModel=gpt-oss-120b2026.06 | — | — | — | — | 91.7 | |
| directives-only ablationModel=llama-4-scout2026.06 | — | — | — | — | 88 | |
| directives-only ablationModel=gemma-4-31B-it2026.06 | — | — | — | — | 92 | |
| FlatModel=gpt-oss-120b2026.06 | — | — | — | — | 92 | |
| FlatModel=llama-4-scout2026.06 | — | — | — | — | 87.3 | |
| FlatModel=gemma-4-31B-it2026.06 | — | — | — | — | 95 | |
| Situational leadershipModel=gpt-oss-120b2026.06 | — | — | — | — | 92.3 | |
| Situational leadershipModel=llama-4-scout2026.06 | — | — | — | — | 89.3 | |
| Situational leadershipModel=gemma-4-31B-it2026.06 | — | — | — | — | 91.7 | |
| Theory-free controlModel=gpt-oss-120b2026.06 | — | — | — | — | 90.3 | |
| Theory-free controlModel=llama-4-scout2026.06 | — | — | — | — | 88 | |
| Theory-free controlModel=gemma-4-31B-it2026.06 | — | — | — | — | 92 | |
| Transactional leadershipModel=gpt-oss-120b2026.06 | — | — | — | — | 92.3 | |
| Transactional leadershipModel=llama-4-scout2026.06 | — | — | — | — | 86.7 | |
| Transactional leadershipModel=gemma-4-31B-it2026.06 | — | — | — | — | 93 | |
| Transformational leadershipModel=gpt-oss-120b2026.06 | — | — | — | — | 90.3 | |
| Transformational leadershipModel=llama-4-scout2026.06 | — | — | — | — | 87.3 | |
| Transformational leadershipModel=gemma-4-31B-it2026.06 | — | — | — | — | 92.7 |