Conversational Question Answering on CoQA
62.65F1 ScoreRWKV-7B
Evaluation results
| Method | Links | |
|---|---|---|
| RWKV-7BBackbone=RWKV-7B, Pruning ratio=0%2024.03 | 62.65 | |
| Mamba-2.8BBackbone=Mamba-2.8B, Pruning ratio=0%2024.03 | 56.35 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=10.9%2024.03 | 52.66 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=9.4%2024.03 | 49.55 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=20.3%2024.03 | 48.32 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=25%2024.03 | 44.96 | |
| ShortGPTBackbone=Mamba-2.8B, Pruning ratio=31.3%2024.03 | 44.96 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=18.8%2024.03 | 40.54 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=25%2024.03 | 29.65 | |
| ShortGPTBackbone=RWKV-7B, Pruning ratio=28.1%2024.03 | 28.34 |