Interactive LLM Alignment on PRD (Product Requirement Document) Modules
74.9Module 1 Alignment ScoreScalable Interactive Oversight
Evaluation results
| Method | Links | ||||||
|---|---|---|---|---|---|---|---|
| Scalable Interactive OversightModel=GPT-52026.02 | 74.9 | 75.3 | 67.2 | 61.6 | 55.8 | 67 | |
| Scalable Interactive OversightModel=Claude-sonnet-4.52026.02 | 70.6 | 66.1 | 62.2 | 60.2 | 50 | 61.8 | |
| Vanilla interactionModel=GPT-52026.02 | 67.1 | 67.6 | 54.4 | 51.2 | 44.4 | 50.3 | |
| Vanilla interactionModel=Claude-sonnet-4.52026.02 | 67.1 | 57.6 | 52.4 | 58.7 | 41.6 | 56.5 | |
| Claude CodeModel=Claude-sonnet-4.52026.02 | 63.2 | 63.6 | 62.1 | 58.9 | 51.1 | 59.7 | |
| Vanilla interactionModel=Gemini-2.5-pro2026.02 | 61.8 | 44.8 | 36.9 | 33.6 | 24.2 | 35.9 | |
| Gemini CLIModel=Gemini-2.5-pro2026.02 | 60.9 | 51 | 47.2 | 40.4 | 32.7 | 46.4 | |
| CodexModel=GPT-52026.02 | 59.5 | 51.6 | 47.6 | 47.9 | 35.1 | 48.1 | |
| Scalable Interactive OversightModel=Gemini-2.5-pro2026.02 | 59 | 59.4 | 52.3 | 48.7 | 44.7 | 55.4 |