Question Answering on StrategyQA (Factuality, Distinct N, P-BLEU)
59.6FactualityTypical + DFD (MPT-7B)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Typical + DFD (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Typical, Integration of DFD=True2025.03 | 59.6 | 52.95 | 75.17 | 82.89 | 20.63 | |
| Temperature + DFD (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Temperature, Integration of DFD=True2025.03 | 58.4 | 58.44 | 81.6 | 88.31 | 14.22 | |
| Top-k + DFD (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Top-k, Integration of DFD=True2025.03 | 58.4 | 52.95 | 76.8 | 85.06 | 18.47 | |
| Nucleus + DFD (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Nucleus, Integration of DFD=True2025.03 | 58.13 | 52.7 | 75.07 | 82.72 | 21.09 | |
| Typical (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Typical, Integration of DFD=False2025.03 | 58.07 | 51.23 | 73.13 | 81.13 | 22.53 | |
| Nucleus (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Nucleus, Integration of DFD=False2025.03 | 56.2 | 51.57 | 73.24 | 81.02 | 22.74 | |
| Top-k (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Top-k, Integration of DFD=False2025.03 | 55.6 | 51.04 | 73.55 | 81.72 | 22.23 | |
| Temperature (MPT-7B)Backbone=MPT-7B, Decoding Strategy=Temperature, Integration of DFD=False2025.03 | 54.93 | 56.81 | 79.54 | 86.33 | 16.88 |