Social Understanding on Social QA
79.2AccuracyShakti-LLM
Evaluation Results
| Method | Links | |
|---|---|---|
| Shakti-LLMParameters=2.5B, Shots=5-shot2024.10 | 79.2 | |
| Phi-3 Mini-4kShots=5-shot2024.10 | 76.6 | |
| Mistral 8x7BParameters=8x7B, Shots=5-shot2024.10 | 75.9 | |
| Mistral 7BParameters=7B, Shots=5-shot2024.10 | 74.6 | |
| Llama 3 8BParameters=8B, Shots=5-shot2024.10 | 73.9 | |
| Gemma 7BParameters=7B, Shots=5-shot2024.10 | 65.5 |