Answer Generation (Unstructured Context) on CRAG Task 1 (test)
34.23AccuracyDirect RAG
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Direct RAGUnderlying LLM=Llama 3-70B-Instruct, Context Window Size=4K tokens, Reranking=Disabled, Sufficiency Checking=Disabled, Temperature=0, Top-p=0.92026.02 | 34.23 | 43.09 | 22.68 | |
| DynaRAGUnderlying LLM=Llama 3-70B-Instruct, Evaluation Task=Task 1 (Web Context Only), Reranking=Enabled, Sufficiency Filtering=Enabled, Temperature=0, Top-p=0.92026.02 | 29.12 | 25.33 | 45.55 | |
| LLM OnlyUnderlying LLM=Llama 3-70B-Instruct, External Context=None, Temperature=0, Top-p=0.92026.02 | 28.53 | 34.95 | 36.52 |