Intent Question Answering on IntentQA (test)
67.1AccuracyLLoVi
Evaluation results
| Method | Links | |
|---|---|---|
| LLoViEvaluation Protocol=Zero-shot, LM=GPT-4, Params=1.8T2023.12 | 67.1 | |
| SeViLAEvaluation Protocol=Zero-shot, LM=Flan-T5, Params=4B2023.12 | 60.9 | |
| CaVIREvaluation Protocol=Supervised, LM=GPT-3, Params=175B2023.12 | 57.6 | |
| BlindGPTEvaluation Protocol=Supervised, LM=GPT-3, Params=175B2023.12 | 51.6 | |
| VGTEvaluation Protocol=Supervised, LM=Transformer, Params=511M2023.12 | 51.3 | |
| HQGAEvaluation Protocol=Supervised, Params=46M2023.12 | 47.7 |