Factual Knowledge Recall on CLIKE 1.0 (test)
87.2Recall Score (EN)Le ∈ L
Evaluation results
| Method | Links | |||||||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| Le ∈ LReasoning Paradigm=Upper Bounds2026.06 | 87.2 | 87.4 | 87.9 | 87.9 | 85.1 | 87.8 | 91.7 | 93.7 | 82 | 80.1 | 86.2 | 88.5 | 83.7 | 86.9 | 86.3 | |
| Le ∈ Choose - ReasonAboutOrigin (x13)Reasoning Paradigm=Upper Bounds2026.06 | 86.8 | 86.9 | 86.9 | 87.5 | 85.4 | 87.6 | 91.7 | 78.3 | 82.7 | 79.7 | 85.3 | 86.7 | 84.3 | 85.4 | 85.7 | |
| Le → Lq (x13)Reasoning Paradigm=Upper Bounds2026.06 | 84 | 83.2 | 81.5 | 84.2 | 72.3 | 78.3 | 85.5 | 83.6 | 69.8 | 63.6 | 68.5 | 70.6 | 66.9 | 76.3 | 76.1 | |
| Le ∈ LpredReasoning Paradigm=Upper Bounds2026.06 | 81.1 | 80.7 | 81.1 | 81.6 | 76.9 | 81 | 87.5 | 77.2 | 74.1 | 68 | 77.5 | 77.7 | 72.9 | 78.3 | 78.2 | |
| Le ∈ Choose - ReasonAboutOrigin (x13) - Majority VoteReasoning Paradigm=Multi-path2026.06 | 77.7 | 78.3 | 76.5 | 77.8 | 73.6 | 77.2 | 83.1 | 65.6 | 69.1 | 66.6 | 73.8 | 76.8 | 70.9 | 74.4 | 75 | |
| Le → Choose - ReasonAboutOriginReasoning Paradigm=Single-path2026.06 | 75.5 | 74.9 | 72.4 | 75.2 | 67.5 | 74.5 | 79.8 | 64 | 64.5 | 57.1 | 66.8 | 70.2 | 67 | 70 | 70.4 | |
| Le → Choose - Unlimited + ENReasoning Paradigm=Single-path2026.06 | 75.2 | 74.6 | 70.6 | 72.6 | 65.7 | 71.4 | 77.9 | 65.1 | 61.2 | 56.6 | 65.9 | 65.7 | 60.2 | 67.9 | 68.3 | |
| Le → Choose - UnlimitedReasoning Paradigm=Single-path2026.06 | 74.3 | 74.1 | 72.3 | 75 | 69.9 | 73.2 | 80 | 67.2 | 64.7 | 58.7 | 70.6 | 70.3 | 64.7 | 70.4 | 70.6 | |
| Le ∈ L - Majority VoteReasoning Paradigm=Multi-path2026.06 | 74.1 | 75.5 | 75.1 | 75.2 | 70.4 | 75 | 81.4 | 74.1 | 65 | 63.4 | 72.1 | 73.3 | 66.2 | 72.4 | 72.3 | |
| Le ∈ Lpred - Majority VoteReasoning Paradigm=Multi-path2026.06 | 73.9 | 73.8 | 73.2 | 74.1 | 69.6 | 74 | 80.9 | 65.1 | 65.5 | 60 | 69.1 | 70.7 | 64.6 | 70.4 | 70.6 | |
| Le → Choose - Unlimited + Lq + ENReasoning Paradigm=Single-path2026.06 | 73.4 | 73.6 | 71.9 | 74.1 | 68.9 | 73.8 | 79.4 | 64.6 | 58 | 54.9 | 66.8 | 68.1 | 65.3 | 68.7 | 69.2 | |
| Le ∈ L - Extracted AnswerReasoning Paradigm=Multi-path2026.06 | 73.3 | 73.2 | 73 | 74.1 | 66.9 | 70.3 | 79.4 | 73 | 59.2 | 58.1 | 67.4 | 68.3 | 59 | 68.9 | 68.8 | |
| Le ∈ L - NaiveReasoning Paradigm=Multi-path2026.06 | 73.1 | 74.7 | 73.8 | 73.6 | 68.9 | 74 | 82 | 74.6 | 61.9 | 62.9 | 70.1 | 71.8 | 64.6 | 71.2 | 71 | |
| Le → LqReasoning Paradigm=Baselines2026.06 | 72.6 | 70.7 | 67.3 | 66.2 | 58.1 | 60.5 | 73.5 | 63.5 | 44.8 | 53.4 | 52.6 | 62.2 | 52.1 | 61.3 | 62.1 | |
| Le → Lq (x13) - NaiveReasoning Paradigm=Baselines2026.06 | 72.1 | 71.9 | 69.1 | 72.2 | 59.8 | 66.3 | 75.2 | 71.4 | 54.4 | 50.4 | 56.5 | 61.2 | 53 | 64.1 | 64 | |
| Le → Lq (x13) - Majority VoteReasoning Paradigm=Baselines2026.06 | 70 | 69.5 | 67.3 | 70 | 55.7 | 62.2 | 74.1 | 67.2 | 52.5 | 48.6 | 53.3 | 54.4 | 50.9 | 61.2 | 61.2 | |
| Native Query LanguageReasoning Paradigm=Baselines2026.06 | 66.5 | 64.4 | 63.8 | 66.5 | 50.2 | 53.6 | 68.2 | 65.1 | 44.4 | 37.3 | 39.3 | 49.4 | 43.3 | 54.8 | 54.6 | |
| Le → ENReasoning Paradigm=Single-path2026.06 | 66.5 | 70.5 | 68.1 | 70 | 63.8 | 71.1 | 79.2 | 70.4 | 61.2 | 54.3 | 67.2 | 67.9 | 58.8 | 66.8 | 66.2 |