Pairwise RAG Comparison on Pairwise RAG Comparison (test)
0.77NMSEMENTATBasic Prompt
Evaluation Results
| Method | Links | ||
|---|---|---|---|
| MENTATBasic PromptLM=GPT-4.1, Training Size=1002025.08 | 0.77 | 0.5 | |
| MENTATBasic PromptLM=GPT-4.1, Training Size=5002025.08 | 0.8 | 0.52 | |
| MENTATBasic PromptLM=GPT-5, Training Size=5002025.08 | 0.93 | 0.33 | |
| Gradient DescentLM=NeoBERT, Training Size=5002025.08 | 1.02 | 0.1 | |
| MENTATBasic PromptLM=GPT-5, Training Size=1002025.08 | 1.07 | 0.36 | |
| MENTAT-AvgLM=GPT-5, Training Size=1002025.08 | 1.31 | 0.35 | |
| MENTAT PromptLM=GPT-5, Training Size=1002025.08 | 1.43 | 0.33 | |
| Gradient DescentLM=NeoBERT, Training Size=1002025.08 | 1.44 | 0.02 | |
| MENTAT-AvgLM=GPT-4.1, Training Size=5002025.08 | 1.48 | 0.51 | |
| MENTAT PromptLM=GPT-4.1, Training Size=5002025.08 | 1.69 | 0.48 | |
| MENTAT-AvgLM=GPT-4.1, Training Size=1002025.08 | 1.82 | 0.48 | |
| MENTAT-AvgLM=GPT-5, Training Size=5002025.08 | 1.83 | 0.32 | |
| MENTAT PromptLM=GPT-5, Training Size=5002025.08 | 1.95 | 0.3 | |
| MENTAT PromptLM=GPT-4.1, Training Size=1002025.08 | 2 | 0.45 | |
| GEPALM=GPT-4.1, Training Size=1002025.08 | 2.16 | 0.44 | |
| Basic PromptLM=GPT-4.1, Training Size=1002025.08 | 2.18 | 0.47 | |
| Basic PromptLM=GPT-4.1, Training Size=5002025.08 | 2.18 | 0.47 | |
| Detailed PromptLM=GPT-5, Training Size=1002025.08 | 2.18 | 0.31 | |
| Detailed PromptLM=GPT-5, Training Size=5002025.08 | 2.18 | 0.31 | |
| Detailed PromptLM=GPT-4.1, Training Size=1002025.08 | 2.2 | 0.47 | |
| Detailed PromptLM=GPT-4.1, Training Size=5002025.08 | 2.2 | 0.47 | |
| Basic PromptLM=GPT-5, Training Size=1002025.08 | 2.25 | 0.35 | |
| Basic PromptLM=GPT-5, Training Size=5002025.08 | 2.25 | 0.35 | |
| GEPALM=GPT-5, Training Size=5002025.08 | 2.29 | 0.28 | |
| GEPALM=GPT-4.1, Training Size=5002025.08 | 2.4 | 0.43 | |
| GEPALM=GPT-5, Training Size=1002025.08 | 2.48 | 0.28 |