List your company
ResearchFormerly WizWand

Narrative Retrieval on CARDS

0.505MAPSpecFi-CS (gemma-3-27b-it abliterated + Qwen3-Embedding-4b)
0.28660.34330.40.4567Mar 23, 2026
Updated 7mo ago

Evaluation results

MethodLinks
SpecFi-CS (gemma-3-27b-it abliterated + Qwen3-Embedding-4b)Setup=SpecFi-CS, Model=gemma-3-27b-it abliterated, Embedding=Qwen3-Embedding-4b2026.030.5050.7380.660.4924.079
static* (gpt-4o + text-embedding-3-large)Setup=static*, Model=gpt-4o, Embedding=text-embedding-3-large2026.030.4880.7130.6490.48716.006
SpecFi-CS (gemma-3-27b-it + Qwen3-Embedding-4b)Setup=SpecFi-CS, Model=gemma-3-27b-it, Embedding=Qwen3-Embedding-4b2026.030.4680.7090.6310.49227.033
static* (gemma-3-27b-it abliterated + Qwen3-Embedding-4b)Setup=static*, Model=gemma-3-27b-it abliterated, Embedding=Qwen3-Embedding-4b2026.030.4640.6790.6370.46840.739
SpecFi-DR (gemma-3-27b-it abliterated + Qwen3-Embedding-4b)Setup=SpecFi-DR, Model=gemma-3-27b-it abliterated, Embedding=Qwen3-Embedding-4b2026.030.4570.6930.6190.45334.902
static* (gemma-3-27b-it + Qwen3-Embedding-4b)Setup=static*, Model=gemma-3-27b-it, Embedding=Qwen3-Embedding-4b2026.030.4350.6350.6160.43538.284
SpecFi-CS (gpt-4o + text-embedding-3-large)Setup=SpecFi-CS, Model=gpt-4o, Embedding=text-embedding-3-large2026.030.4260.660.5970.45615.124
SpecFi-DR (gemma-3-27b-it + Qwen3-Embedding-4b)Setup=SpecFi-DR, Model=gemma-3-27b-it, Embedding=Qwen3-Embedding-4b2026.030.4240.630.5810.43239.321
SpecFi-DR (gpt-4o + text-embedding-3-large)Setup=SpecFi-DR, Model=gpt-4o, Embedding=text-embedding-3-large2026.030.4210.6820.60.4417.19
zero shot (gpt-4o + text-embedding-3-large)Setup=zero shot, Model=gpt-4o, Embedding=text-embedding-3-large2026.030.3210.5090.4870.3729.091
zero shot (gemma-3-27b-it + Qwen3-Embedding-4b)Setup=zero shot, Model=gemma-3-27b-it, Embedding=Qwen3-Embedding-4b2026.030.3130.4690.4560.37118.867
zero shot (gemma-3-27b-it abliterated + Qwen3-Embedding-4b)Setup=zero shot, Model=gemma-3-27b-it abliterated, Embedding=Qwen3-Embedding-4b2026.030.2950.4280.4360.30817.205