Intent Classification on NyayaBench v2 (test)
84.8AccuracyGPTCache @0.85
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| GPTCache @0.85Threshold=0.85, Training=None2026.02 | 84.8 | 5.6 | 5 | |
| GPTCache @0.70Threshold=0.70, Training=None2026.02 | 83.1 | 16.9 | 5 | |
| SetFit-EN 16-shotTraining=320 examples2026.02 | 62.6 | — | — | |
| SetFit-Multi (118M)Parameters=118M, Training=160 examples, Evaluation Language=EN2026.02 | 55.4 | — | — | |
| SetFit-EN (22M)Parameters=22M, Training=160 examples2026.02 | 55.3 | 98.3 | 2.4 | |
| GPTCache KMeans (k=20)k=20, Training=None2026.02 | 49.1 | 98.3 | 5 |