Full-mode K2C on FK2C XF dataset 26-key (test)
84.6P@1Spark + RLHF-IME binary
Evaluation Results
| Method | Links | |
|---|---|---|
| Spark + RLHF-IME binaryBase Model=Spark, Training Mode=RLHF-IME, Annotation System=Binary Classification2023.11 | 84.6 | |
| Spark + RLHF-IME rankBase Model=Spark, Training Mode=RLHF-IME, Annotation System=Ranking2023.11 | 82.8 | |
| Spark + SFTBase Model=Spark, Training Mode=Supervised Fine-Tuning2023.11 | 81 | |
| GPT-4Model Family=public2023.11 | 18.1 | |
| ChatGPTModel Family=public2023.11 | 12.3 |