List your company

Safety Evaluation on CATQA Chinese (test)

55.67Chinese AccuracySFT
24.05432.26240.4748.678Feb 19, 2024

Evaluation results

MethodLinks
SFTTraining Regime=PEFT2024.0255.6754.5955.1339.81
SFTTraining Regime=Full-FT2024.0249.3654.4951.9336.61
RESTATraining Regime=PEFT2024.0238.936.6637.7822.46
RESTATraining Regime=Full-FT2024.0225.2729.5127.3912.07