Natural Language Inference on OCNLI (test)
0.8776AccuracyLLM-ce(7B)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM-ce(7B)#Param.=7B2024.06 | 0.8776 | 0.9609 | 0.8409 | 0.9493 | |
| D2LLM(7B)#Data=0.3M, #Param.=7B2024.06 | 0.7889 | 0.8145 | 0.7736 | 0.8149 | |
| BGE(326M)#Data=100M, #Param.=326M2024.06 | 0.7266 | 0.7646 | 0.7362 | 0.7191 | |
| LLaRA(7B)#Data=0.3M, #Param.=7B2024.06 | 0.6612 | 0.7115 | 0.6618 | 0.6889 | |
| Udever(7B)#Data=0.3M, #Param.=7B2024.06 | 0.6412 | 0.6811 | 0.6478 | 0.6698 | |
| SGPT(7B)#Data=0.3M, #Param.=7B2024.06 | 0.5977 | 0.6165 | 0.6029 | 0.5994 | |
| RocketQAv2(326M)#Data=0.3M, #Param.=326M2024.06 | 0.5603 | 0.5633 | 0.5123 | 0.5723 | |
| BGE-ft(326M)#Data=0.3M, #Param.=326M2024.06 | 0.5463 | 0.5689 | 0.5466 | 0.5702 | |
| LLM-be(7B)#Param.=7B2024.06 | 0.5219 | 0.5083 | 0.5155 | 0.5955 |