Question Answering on QUALITY
83.8Exact MatchCoA
Evaluation Results
| Method | Links | |
|---|---|---|
| CoABackbone=text-unicorn, Context Window=8k2024.06 | 83.8 | |
| VanillaBackbone=text-unicorn, Context Window=8k2024.06 | 83.4 | |
| RAGBackbone=text-unicorn, Context Window=8k2024.06 | 83 | |
| CoABackbone=gemini-ultra, Context Window=8k2024.06 | 80.6 | |
| CoABackbone=text-bison, Context Window=8k2024.06 | 65.42 | |
| RAGBackbone=gemini-ultra, Context Window=8k2024.06 | 62.4 | |
| VanillaBackbone=text-bison, Context Window=8k2024.06 | 61.86 | |
| VanillaBackbone=gemini-ultra, Context Window=32k2024.06 | 58.6 | |
| VanillaBackbone=gemini-ultra, Context Window=8k2024.06 | 57.4 | |
| RAGBackbone=text-bison, Context Window=8k2024.06 | 55.28 |