NLI on CMNLI (test)
83.47AccLLM-ce(7B)
Evaluation results
| Method | Links | ||||
|---|---|---|---|---|---|
| LLM-ce(7B)#Param.=7B2024.06 | 83.47 | 94.17 | 82.63 | 93.03 | |
| D2LLM(7B)#Data=0.3M, #Param.=7B2024.06 | 80.14 | 87.59 | 79.6 | 82.41 | |
| BGE(326M)#Data=100M, #Param.=326M2024.06 | 76.75 | 85.8 | 78.91 | 73.81 | |
| Udever(7B)#Data=0.3M, #Param.=7B2024.06 | 72.34 | 78.19 | 70.77 | 73.06 | |
| LLaRA(7B)#Data=0.3M, #Param.=7B2024.06 | 71.5 | 78.15 | 71.25 | 73.81 | |
| SGPT(7B)#Data=0.3M, #Param.=7B2024.06 | 65.98 | 72.59 | 66.43 | 67.27 | |
| RocketQAv2(326M)#Data=0.3M, #Param.=326M2024.06 | 61.64 | 67.79 | 59.66 | 69.05 | |
| BGE-ft(326M)#Data=0.3M, #Param.=326M2024.06 | 60.97 | 66.56 | 61.74 | 62.78 | |
| LLM-be(7B)#Param.=7B2024.06 | 56.19 | 61.75 | 56.24 | 67.62 |