Question Answering on TeleQnA Public Subset
86.6AccuracyLlama 3.1 405B
Evaluation Results
| Method | Links | |
|---|---|---|
| Llama 3.1 405BContext + TAE=true, Options=true2024.08 | 86.6 | |
| Claude 3.5 SonnetContext + TAE=true, Options=true2024.08 | 84.7 | |
| GPT-4o-miniContext + TAE=true, Options=true2024.08 | 83.3 | |
| Phi-2Context + TAE=true, Options=true2024.08 | 80.3 | |
| Llama 3.1 405BContext + TAE=true, Options=false2024.08 | 72.7 | |
| Claude 3.5 SonnetContext + TAE=false, Options=true2024.08 | 71.6 | |
| Llama 3.1 405BContext + TAE=false, Options=true2024.08 | 69.7 | |
| GPT-4o-miniContext + TAE=true, Options=false2024.08 | 68.9 | |
| Claude 3.5 SonnetContext + TAE=true, Options=false2024.08 | 68.6 | |
| GPT-4o-miniContext + TAE=false, Options=true2024.08 | 65.3 | |
| Falcon-7BContext + TAE=true, Options=false2024.08 | 60.1 | |
| Phi-2Context + TAE=false, Options=true2024.08 | 55.2 |