Question Answering on 50-question climate adaptation dataset 1.0 (test)
3Context Quality ScoreCAIRNS
Evaluation results
| Method | Links | ||||||||||
|---|---|---|---|---|---|---|---|---|---|---|---|
| CAIRNSPrompting=Zero-shot, SGP=Included, MTR=Included2025.12 | 3 | 3 | 3 | 2.94 | 1.86 | 2.5 | 2.78 | 2.72 | 0.528 | 0.814 | |
| CAIRNSPrompting=Few-shot, SGP=Included, MTR=Included2025.12 | 3 | 3 | 3 | 2.94 | 1.88 | 2.24 | 2.8 | 2.69 | 0.528 | 0.814 | |
| CAIRNS (-LWR)Prompting=Zero-shot, LWR=Removed2025.12 | 3 | 3 | 3 | 2.92 | 1.78 | 2.3 | 2.82 | 2.69 | 0.511 | 0.804 | |
| CAIRNS (-MTR)Prompting=Zero-shot, MTR=Removed2025.12 | 3 | 3 | 3 | 2.88 | 1.82 | 2.34 | 2.84 | 2.69 | 0.49 | 0.781 | |
| CAIRNS (-LWR)Prompting=Few-shot, LWR=Removed2025.12 | 3 | 3 | 3 | 2.92 | 1.8 | 2.4 | 2.82 | 2.69 | 0.511 | 0.804 | |
| CAIRNS (-MTR)Prompting=Few-shot, MTR=Removed2025.12 | 3 | 3 | 3 | 2.86 | 1.84 | 2.2 | 2.84 | 2.68 | 0.49 | 0.781 | |
| GeminiPrompting=Few-shot2025.12 | 2.86 | 1.98 | 3 | 0.36 | 1.02 | 2.56 | 1.84 | 1.95 | — | — | |
| GeminiPrompting=Zero-shot2025.12 | 2.84 | 2 | 3 | 0.42 | 1.04 | 2.6 | 1.84 | 1.96 | — | — | |
| CAIRNS (-SGP)Prompting=Zero-shot, SGP=Removed2025.12 | 1.78 | 2.44 | 3 | 2.94 | 1.6 | 2.18 | 2.86 | 2.39 | 0.74 | 0.799 | |
| CAIRNS (-SGP)Prompting=Few-shot, SGP=Removed2025.12 | 1.78 | 2.44 | 3 | 2.96 | 1.6 | 2 | 2.84 | 2.37 | 0.74 | 0.799 | |
| CAIRNS (-SGP -MTR)Prompting=Zero-shot, SGP=Removed, MTR=Removed2025.12 | 1.66 | 2.44 | 3 | 2.86 | 1.52 | 1.98 | 2.82 | 2.33 | 0.733 | 0.689 | |
| CAIRNS (-SGP +CD)Prompting=Zero-shot, SGP=Removed, CD=Added2025.12 | 1.64 | 2.44 | 3 | 2.9 | 1.54 | 2.14 | 2.64 | 2.32 | 0.778 | 0.832 | |
| CAIRNS (-SGP -MTR)Prompting=Few-shot, SGP=Removed, MTR=Removed2025.12 | 1.64 | 2.42 | 3 | 2.88 | 1.54 | 1.96 | 2.84 | 2.33 | 0.733 | 0.689 | |
| CAIRNS (-SGP +CD)Prompting=Few-shot, SGP=Removed, CD=Added2025.12 | 1.64 | 2.46 | 3 | 2.94 | 1.54 | 2.22 | 2.6 | 2.34 | 0.778 | 0.832 | |
| CAIRNS (-SGP -MTR +CD)Prompting=Zero-shot, SGP=Removed, MTR=Removed, CD=Added2025.12 | 1.5 | 2.36 | 2.96 | 2.82 | 1.58 | 2.02 | 2.48 | 2.23 | 0.754 | 0.688 | |
| CAIRNS (-SGP -MTR +CD)Prompting=Few-shot, SGP=Removed, MTR=Removed, CD=Added2025.12 | 1.5 | 2.34 | 2.96 | 2.82 | 1.54 | 2.16 | 2.48 | 2.25 | 0.754 | 0.688 |