Visual Dialogue on VisDial (val)
75.4NDCGUnrestricted SotA (Wang et al.)
Evaluation Results
| Method | Links | |
|---|---|---|
| Unrestricted SotA (Wang et al.)Evaluation Protocol=Fine-tuned2022.04 | 75.4 | |
| SotA2022.04 | 75.2 | |
| Restricted SotA+ (Murahari et al.)Evaluation Protocol=Fine-tuned2022.04 | 74.5 | |
| Flamingomode=Fine-tuned2022.04 | 61.8 | |
| FlamingoEvaluation Protocol=Fine-tuned2022.04 | 59.7 | |
| FlamingoFew-shot=32 shots2022.04 | 56.8 | |
| FlamingoShots=32, Evaluation Protocol=In-context learning2022.04 | 56.8 | |
| Flamingo-9Bshots=0-shot2023.09 | 48.4 | |
| SFT-CM3Leon-7Bshots=0-shot, SFT=true2023.09 | 22.6 |