Insight Generation on Internal document collections (non-scientific domain) - Climate Change Awareness
4.72Insight ScoreINSIGHTGEN
Evaluation Results
| Method | Links | |||
|---|---|---|---|---|
| INSIGHTGENTarget Model=Claude-3.5-Sonnet, Evaluator=Gemini-2.5-Flash2026.04 | 4.72 | — | — | |
| INSIGHTGENTarget Model=GPT-4o, Evaluator=Gemini-2.5-Flash2026.04 | 4.64 | — | — | |
| GPT+COTTarget Model=Claude-3.5-Sonnet, Evaluator=Gemini-2.5-Flash2026.04 | 4.16 | — | — | |
| FAISS+COTTarget Model=Claude-3.5-Sonnet, Evaluator=Gemini-2.5-Flash2026.04 | 3.92 | — | — | |
| INSIGHTGENTarget Model=Claude-3.5-Sonnet, Evaluator=Claude-4-Sonnet2026.04 | 3.77 | — | — | |
| Direct GPTTarget Model=GPT-4o, Evaluator=Gemini-2.5-Flash2026.04 | 3.64 | — | — | |
| FAISSTarget Model=GPT-4o, Evaluator=Gemini-2.5-Flash2026.04 | 3.59 | — | — | |
| INSIGHTGENTarget Model=GPT-4o, Evaluator=Claude-4-Sonnet2026.04 | 3.53 | — | — | |
| FAISS+COTTarget Model=GPT-4o, Evaluator=Gemini-2.5-Flash2026.04 | 3.42 | — | — | |
| Direct GPTTarget Model=Claude-3.5-Sonnet, Evaluator=Gemini-2.5-Flash2026.04 | 3.42 | — | — | |
| GPT+COTTarget Model=GPT-4o, Evaluator=Gemini-2.5-Flash2026.04 | 3.41 | — | — | |
| GPT+COTTarget Model=Claude-3.5-Sonnet, Evaluator=Claude-4-Sonnet2026.04 | 2.81 | — | — | |
| FAISS+COTTarget Model=Claude-3.5-Sonnet, Evaluator=Claude-4-Sonnet2026.04 | 2.69 | — | — | |
| Direct GPTTarget Model=GPT-4o, Evaluator=Claude-4-Sonnet2026.04 | 2.66 | — | — | |
| FAISSTarget Model=GPT-4o, Evaluator=Claude-4-Sonnet2026.04 | 2.61 | — | — | |
| FAISS+COTTarget Model=GPT-4o, Evaluator=Claude-4-Sonnet2026.04 | 2.53 | — | — | |
| GPT+COTTarget Model=GPT-4o, Evaluator=Claude-4-Sonnet2026.04 | 2.39 | — | — | |
| Direct GPTTarget Model=Claude-3.5-Sonnet, Evaluator=Claude-4-Sonnet2026.04 | 2.33 | — | — | |
| FAISSTarget Model=Claude-3.5-Sonnet, Evaluator=Gemini-2.5-Flash2026.04 | 1.47 | — | — | |
| FAISSTarget Model=Claude-3.5-Sonnet, Evaluator=Claude-4-Sonnet2026.04 | 1.16 | — | — | |
| Direct GPTBase Model=GPT-4o2026.04 | — | 3.5 | 2.67 | |
| Direct GPTBase Model=Claude-3.5-Sonnet2026.04 | — | 2.61 | 2.06 | |
| FAISSBase Model=GPT-4o2026.04 | — | 3.17 | 2.61 | |
| FAISSBase Model=Claude-3.5-Sonnet2026.04 | — | 1.28 | 1.28 | |
| FAISS+CoTBase Model=GPT-4o2026.04 | — | 3.22 | 2.22 | |
| FAISS+CoTBase Model=Claude-3.5-Sonnet2026.04 | — | 3.94 | 2.67 | |
| GPT+CoTBase Model=GPT-4o2026.04 | — | 2.78 | 2.33 | |
| GPT+CoTBase Model=Claude-3.5-Sonnet2026.04 | — | 4.11 | 3 | |
| INSIGHTGENBase Model=GPT-4o2026.04 | — | 4.78 | 3.78 | |
| INSIGHTGENBase Model=Claude-3.5-Sonnet2026.04 | — | 4.61 | 3.78 |