Entity Categorization on Hobbies and Organizations n=150 (test)
82.5Q1 F-scoreHuman
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| HumanSchema=Full2026.02 | 82.5 | 88.6 | 73.8 | 69.3 | 78.6 | |
| HumanSchema=Coarse2026.02 | 82.5 | 90.1 | 81.2 | 73.4 | 81.8 | |
| 7 prompt ens.Schema=Coarse, Ensemble Type=Optimized prompt variants, Ensemble Size=72026.02 | 80 | 87.7 | 76.8 | 62.7 | 76.8 | |
| 7 prompt ens.Schema=Full, Ensemble Type=Optimized prompt variants, Ensemble Size=72026.02 | 80 | 85 | 71.4 | 58.9 | 73.7 | |
| Best promptSchema=Full, Note=Generated by optimizer models o3/Claude 4 Opus2026.02 | 78.2 | 85.8 | 71.7 | 55.9 | 72.9 | |
| Orig. promptSchema=Full2026.02 | 77 | 85.4 | 73.6 | 54.6 | 72.7 | |
| 7x orig. ens.Schema=Coarse, Ensemble Type=Repeated original prompt, Ensemble Size=72026.02 | 76.9 | 87.4 | 79.9 | 60 | 76.1 | |
| 7x orig. ens.Schema=Full, Ensemble Type=Repeated original prompt, Ensemble Size=72026.02 | 76.9 | 85.9 | 75.3 | 55 | 73.3 |