Insight-level Evaluation on SCOpE-QA Inference Optimization collection
4.49Insight-level ScoreINSIGHTGEN
Evaluation Results
| Method | Links | |
|---|---|---|
| INSIGHTGENTarget Model=Claude-3.5-Sonnet, Evaluator Model=Gemini-1.5-Flash2026.04 | 4.49 | |
| FAISS+COTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Gemini-1.5-Flash2026.04 | 4.09 | |
| Direct GPTTarget Model=GPT-4o, Evaluator Model=Gemini-1.5-Flash2026.04 | 4.02 | |
| GPT+COTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Gemini-1.5-Flash2026.04 | 4 | |
| FAISSTarget Model=GPT-4o, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.98 | |
| INSIGHTGENTarget Model=GPT-4o, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.98 | |
| Direct GPTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.7 | |
| FAISSTarget Model=Claude-3.5-Sonnet, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.67 | |
| GPT+COTTarget Model=GPT-4o, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.48 | |
| FAISS+COTTarget Model=GPT-4o, Evaluator Model=Gemini-1.5-Flash2026.04 | 3.42 | |
| INSIGHTGENTarget Model=Claude-3.5-Sonnet, Evaluator Model=Claude-3-Sonnet2026.04 | 3.13 | |
| INSIGHTGENTarget Model=GPT-4o, Evaluator Model=Claude-3-Sonnet2026.04 | 3.03 | |
| FAISSTarget Model=GPT-4o, Evaluator Model=Claude-3-Sonnet2026.04 | 2.89 | |
| Direct GPTTarget Model=GPT-4o, Evaluator Model=Claude-3-Sonnet2026.04 | 2.78 | |
| FAISSTarget Model=Claude-3.5-Sonnet, Evaluator Model=Claude-3-Sonnet2026.04 | 2.67 | |
| FAISS+COTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Claude-3-Sonnet2026.04 | 2.64 | |
| Direct GPTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Claude-3-Sonnet2026.04 | 2.57 | |
| GPT+COTTarget Model=Claude-3.5-Sonnet, Evaluator Model=Claude-3-Sonnet2026.04 | 2.51 | |
| FAISS+COTTarget Model=GPT-4o, Evaluator Model=Claude-3-Sonnet2026.04 | 2.3 | |
| GPT+COTTarget Model=GPT-4o, Evaluator Model=Claude-3-Sonnet2026.04 | 2.13 |