Attributed Text Generation on ELI5
25.9Claim Correctness ScoreThink&Cite
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| Think&CiteBase LLM=GPT-4o2024.12 | 25.9 | 85.6 | 80.2 | |
| Vanilla RAGBase LLM=GPT-4o2024.12 | 20.3 | 53.1 | 55.2 | |
| Summary RAG w/ InteractBase LLM=GPT-4o2024.12 | 20.1 | 69.2 | 66.2 | |
| Snippet RAG w/ InteractBase LLM=GPT-4o2024.12 | 19.9 | 68.1 | 65.1 | |
| Snippet RAGBase LLM=GPT-4o2024.12 | 19.8 | 64.8 | 60.1 | |
| Vanilla RAG w/ ReRankBase LLM=GPT-4o2024.12 | 19.4 | 68.2 | 65.7 | |
| Summary RAGBase LLM=GPT-4o2024.12 | 18.7 | 64.4 | 63.9 | |
| Think&CiteBase LLM=LLaMA2024.12 | 17.4 | 77.5 | 75.3 | |
| VTG2024.12 | 16.7 | 82.6 | 71.6 | |
| Snippet RAGBase LLM=ChatGPT2024.12 | 14.3 | 50.4 | 45.1 | |
| Summary RAG w/ InteractBase LLM=ChatGPT2024.12 | 13.7 | 50.1 | 49.2 | |
| APO2024.12 | 13.5 | 26 | 24.5 | |
| Inline SearchBase LLM=ChatGPT2024.12 | 13.4 | 45.6 | 43.7 | |
| Snippet RAG w/ InteractBase LLM=ChatGPT2024.12 | 13.3 | 47.8 | 45.2 | |
| Summary RAGBase LLM=ChatGPT2024.12 | 12.5 | 51.5 | 48.2 | |
| Inline SearchBase LLM=GPT-4o2024.12 | 12.5 | 50.2 | 53.3 | |
| Vanilla RAGBase LLM=ChatGPT2024.12 | 12 | 51.1 | 50 | |
| FG-Reward2024.12 | 11.5 | 60.9 | 60.2 | |
| Vanilla RAG w/ ReRankBase LLM=ChatGPT2024.12 | 11.4 | 69.3 | 67.8 |