Knowledge Retrieval on LAMA (full)
37.57AccuracyCoherence Boosting (CB)
Evaluation Results
| Method | Links | |
|---|---|---|
| Coherence Boosting (CB)Model=GPT-3 175B, alpha_k=-0.4, k*=22021.10 | 37.57 | |
| Coherence Boosting (CB)Model=GPT-3 13B, alpha_k=-0.5, k*=12021.10 | 35.02 | |
| Contextual Calibration (CC)Model=GPT-3 175B2021.10 | 34.78 | |
| Coherence Boosting (CB)Model=GPT-3 6.7B, alpha_k=-0.5, k*=12021.10 | 32.25 | |
| Contextual Calibration (CC)Model=GPT-3 13B2021.10 | 31.96 | |
| Contextual Calibration (CC)Model=GPT-3 6.7B2021.10 | 30.57 | |
| Coherence Boosting (CB)Model=GPT-3 2.7B, alpha_k=-0.5, k*=12021.10 | 28.75 | |
| f_baseModel=GPT-3 175B2021.10 | 26.76 | |
| Contextual Calibration (CC)Model=GPT-3 2.7B2021.10 | 26.3 | |
| Coherence Boosting (CB)Model=GPT-2 760M, alpha_k=-0.5, k*=32021.10 | 25.74 | |
| Coherence Boosting (CB)Model=GPT-2 1.6B, alpha_k=-0.5, k*=32021.10 | 25.43 | |
| Contextual Calibration (CC)Model=GPT-2 1.6B2021.10 | 23.97 | |
| Contextual Calibration (CC)Model=GPT-2 760M2021.10 | 23.9 | |
| Contextual Calibration (CC)Model=GPT-2 350M2021.10 | 22.87 | |
| Coherence Boosting (CB)Model=GPT-2 350M, alpha_k=-0.5, k*=22021.10 | 22.87 | |
| f_baseModel=GPT-3 13B2021.10 | 22.06 | |
| Coherence Boosting (CB)Model=GPT-2 125M, alpha_k=-0.5, k*=12021.10 | 19.85 | |
| f_baseModel=GPT-3 6.7B2021.10 | 19.42 | |
| Contextual Calibration (CC)Model=GPT-2 125M2021.10 | 17.45 | |
| f_baseModel=GPT-3 2.7B2021.10 | 17.33 | |
| f_baseModel=GPT-2 350M2021.10 | 14.78 | |
| f_baseModel=GPT-2 1.6B2021.10 | 14.29 | |
| f_baseModel=GPT-2 760M2021.10 | 13.88 | |
| f_baseModel=GPT-2 125M2021.10 | 8.48 |