Question Answering on Qasper (val)
28.8F1LongChat 7B
Evaluation Results
| Method | Links | |
|---|---|---|
| LongChat 7BContext length=8K, Zero-shot=true2023.07 | 28.8 | |
| LONGLLAMA 3BContext length=8K, Zero-shot=true2023.07 | 26.6 | |
| LongChat 7BContext length=6K, Zero-shot=true2023.07 | 25 | |
| LONGLLAMA 3BContext length=6K, Zero-shot=true2023.07 | 23.2 | |
| LongChat 7BContext length=4K, Zero-shot=true2023.07 | 21.2 | |
| LONGLLAMA 3BContext length=4K, Zero-shot=true2023.07 | 20.7 | |
| LongChat 7BContext length=2K, Zero-shot=true2023.07 | 19.4 | |
| OpenLLaMA 3BContext length=2K, Zero-shot=true2023.07 | 18.7 | |
| LONGLLAMA 3BContext length=2K, Zero-shot=true2023.07 | 18.7 | |
| LLaMA 7BContext length=2K, Zero-shot=true2023.07 | 18.7 |