Question Answering on MCQL
49.17AccuracyT5 (beam)
Evaluation results
| Method | Links | |
|---|---|---|
| T5 (beam)QA Model=T52026.04 | 49.17 | |
| T5 (beam)QA Model=BART2026.04 | 43 | |
| T5 (contrast)QA Model=T52026.04 | 42.67 | |
| GPT-3 (clustering)QA Model=T52026.04 | 39 | |
| TinyLlamaQA Model=T52026.04 | 37.83 | |
| T5 (contrast)QA Model=BART2026.04 | 36.67 | |
| GPT-3 (clustering)QA Model=BART2026.04 | 34.83 | |
| Ground-TruthQA Model=T52026.04 | 34 | |
| TinyLlamaQA Model=BART2026.04 | 33 | |
| GPT-3 (k-NN)QA Model=T52026.04 | 30.83 | |
| GPT-3 (COT-k-NN)QA Model=T52026.04 | 30.83 | |
| Ground-TruthQA Model=BART2026.04 | 27.33 | |
| GPT-3 (k-NN)QA Model=BART2026.04 | 26.5 | |
| GPT-3 (COT-k-NN)QA Model=BART2026.04 | 26.33 |