Schema Generation Quality Evaluation on Technical Evaluation Test Suite (6 domains)
6.8Schema GranularitySchemex Full
Evaluation Results
| Method | Links | |||||||
|---|---|---|---|---|---|---|---|---|
| Schemex FullCondition=3, Description=full system with one iteration of contrastive refinement building on Schemex Initial, Contrastive refinement iteration=12025.04 | 6.8 | 6.6 | 6.3 | 5.8 | — | — | — | |
| Schemex InitialCondition=2, Description=structured workflow with clustering followed by abstraction into a schema, Contrastive refinement iteration=02025.04 | 5.9 | 6.1 | 5.8 | 5.5 | — | — | — | |
| o1-proCondition=1, Reasoning model=state-of-the-art extended reasoning model, Context window=200K-token2025.04 | 5 | 5.6 | 5.5 | 5 | — | — | — |