List your company

Schema Generation Quality Evaluation on Technical Evaluation Test Suite (6 domains)

6.8Schema GranularitySchemex Full
4.9285.4145.96.386Apr 16, 2025

Evaluation results

MethodLinks
Schemex FullCondition=3, Description=full system with one iteration of contrastive refinement building on Schemex Initial, Contrastive refinement iteration=12025.046.86.66.35.8———
Schemex InitialCondition=2, Description=structured workflow with clustering followed by abstraction into a schema, Contrastive refinement iteration=02025.045.96.15.85.5———
o1-proCondition=1, Reasoning model=state-of-the-art extended reasoning model, Context window=200K-token2025.0455.65.55———