Factual Historical Correctness on HIST-EVENT (pre-cutoff)
31.1Strict CorrectnessTalkie 1930 (it)
Evaluation results
| Method | Links | ||
|---|---|---|---|
| Talkie 1930 (it)Size=13B, Cutoff=19302026.06 | 31.1 | 51.2 | |
| TYPEWRITERLM (SEL.IN.)Size=7.24B, Cutoff=19132026.06 | 6.2 | 25.4 | |
| TYPEWRITERLM (LIMA)Size=7.24B, Cutoff=19132026.06 | 5.1 | 22.6 | |
| GPT-1900Size=3.3B, Cutoff=19002026.06 | 2.5 | 9.1 | |
| Mr. ChatterboxSize=340M, Cutoff=18992026.06 | 0 | 0 | |
| TimeCapsuleLLMSize=1.2B, Cutoff=18752026.06 | 0 | 0.3 |