List your company
ResearchFormerly WizWand

Rule Alignment Evaluation on RuLES

0.602P_manualPRIORITYRULES
0.287920.369460.4510.53254Feb 27, 2024
Updated 8mo ago

Evaluation results

MethodLinks
PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored, Reference Signal (+Lref)=true2024.020.6020.436
PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored, Reference Signal (+Lref)=true2024.020.60.383
PRIORITYRULESBackbone=Llama-2-13B, Training Data=ShareGPT2024.020.5770.382
PRIORITYRULESBackbone=Llama-2-13B, Training Data=ShareGPT, Reference Signal (+Lref)=true2024.020.5770.445
PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored, System Message (+sys)=true2024.020.5760.39
PRIORITYRULESBackbone=Llama-2-7B, Training Data=ShareGPT2024.020.5720.361
PRIORITYRULESBackbone=Llama-2-7B, Training Data=ShareGPT, Reference Signal (+Lref)=true2024.020.570.378
PRIORITYRULESBackbone=Llama-2-13B, Data Censorship=Uncensored2024.020.5680.447
PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored2024.020.5590.387
PRIORITYRULESBackbone=Llama-2-7B, System Message (+sys)=true, Training Data=ShareGPT2024.020.5490.415
PRIORITYRULESBackbone=Llama-2-7B, Data Censorship=Uncensored, System Message (+sys)=true2024.020.5480.372
PRIORITYRULESBackbone=Llama-2-13B, System Message (+sys)=true, Training Data=ShareGPT2024.020.4930.39
ShareGPT (+sys)Backbone=Llama-2-7B, System Message (+sys)=true2024.020.4530.267
ShareGPT (+sys)Backbone=Llama-2-13B, System Message (+sys)=true2024.020.4140.241
Llama-2 ChatBackbone=Llama-2-13B2024.020.4090.218
ShareGPTBackbone=Llama-2-13B2024.020.3750.196
Unc. ShareGPT (+sys)Backbone=Llama-2-7B, Data Censorship=Uncensored, System Message (+sys)=true2024.020.3620.212
Llama-2 ChatBackbone=Llama-2-7B2024.020.3490.198
ShareGPTBackbone=Llama-2-7B2024.020.3470.223
Unc. ShareGPTBackbone=Llama-2-7B, Data Censorship=Uncensored2024.020.3390.186
Unc. ShareGPT (+sys)Backbone=Llama-2-13B, Data Censorship=Uncensored, System Message (+sys)=true2024.020.3260.162
Unc. ShareGPTBackbone=Llama-2-13B, Data Censorship=Uncensored2024.020.30.151