Scientific Paper Quality Assessment on System from GitHub repositories (example papers)
6.2NoveltyPAPERCLAW
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| PAPERCLAWmode=human-in-the-loop2026.06 | 6.2 | 7 | 7.5 | 8 | 7 | |
| AUTORESEARCHCLAW2026.06 | 4.3 | 4.5 | 3 | 7.3 | 4.3 | |
| The AI Scientist2026.06 | 3.9 | 4.9 | 4.8 | 6.8 | 4.8 | |
| Agent Laboratory2026.06 | 3 | 4 | 4 | 7 | 4 | |
| Naive single-LLM writermode=no agentic loop2026.06 | 2.5 | 5 | 4 | 7.3 | 4 |