List your company
ResearchFormerly WizWand

Sycophancy Assessment on BASIL 1.0 (All)

-0.096Change in Bayesian Error (RMSE)gpt-4o-mini
-0.10248-0.05874-0.0150.02874Aug 23, 2025
Updated 6mo ago

Evaluation results

MethodLinks
gpt-4o-miniElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.08-0.096
gpt-4o-miniElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.057
llama3.2:1b+DPOElicitation Method=Direct Probing, Calibration State=Calibrated2025.08-0.046
mistral:7bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.08-0.042
llama3.2:1b+SFTElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.034
mistral:7bElicitation Method=Direct Probing, Calibration State=Raw2025.08-0.032
mistral:7bElicitation Method=Direct Probing, Calibration State=Calibrated2025.08-0.031
phi4:14bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.025
llama3.2:1b+SFTElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.08-0.025
phi4:14bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.08-0.023
llama3.2:1b+DPOElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.08-0.023
llama3.2:1b+DPOElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.023
llama3.2:1b+DPOElicitation Method=Direct Probing, Calibration State=Raw2025.08-0.02
mistral:7bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.015
gpt-4o-miniElicitation Method=Direct Probing, Calibration State=Raw2025.08-0.012
phi4:14bElicitation Method=Direct Probing, Calibration State=Calibrated2025.08-0.011
claude-haiku-4-5Elicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.08-0.003
claude-haiku-4-5Elicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.080
llama3.2:1b+SFTElicitation Method=Direct Probing, Calibration State=Calibrated2025.080
llama3.2:1bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.080.001
llama3.2:3bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Calibrated2025.080.004
gpt-4o-miniElicitation Method=Direct Probing, Calibration State=Calibrated2025.080.004
claude-haiku-4-5Elicitation Method=Direct Probing, Calibration State=Raw2025.080.004
llama3.2:1bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.080.006
claude-haiku-4-5Elicitation Method=Direct Probing, Calibration State=Calibrated2025.080.009
phi4:14bElicitation Method=Direct Probing, Calibration State=Raw2025.080.016
llama3.2:3bElicitation Method=Direct Probing (Multiple Samples=5), Calibration State=Raw2025.080.018
llama3.2:3bElicitation Method=Direct Probing, Calibration State=Calibrated2025.080.028
llama3.2:1b+SFTElicitation Method=Direct Probing, Calibration State=Raw2025.080.028
llama3.2:3bElicitation Method=Direct Probing, Calibration State=Raw2025.080.037
llama3.2:1bElicitation Method=Direct Probing, Calibration State=Raw2025.080.059
llama3.2:1bElicitation Method=Direct Probing, Calibration State=Calibrated2025.080.066