List your company

General Capability Evaluation on General Capability Dataset

66.8General ScoreOrigin
-1.1764816.4712634.11951.76674Feb 7, 2025Apr 15, 2025Jun 22, 2025Aug 29, 2025Nov 4, 2025Jan 11, 2026Mar 20, 2026

Evaluation results

MethodLinks
OriginBase Model=Gemma-2-9B-IT2025.0266.8
TELLMEBase Model=Gemma-2-9B-IT2025.0266.7
TELLME NT-XentBase Model=Gemma-2-9B-IT, Loss Function=NT-Xent2025.0266.6
SFTBase Model=Gemma-2-9B-IT, Training Strategy=Supervised Fine-Tuning2025.0264.3
BasePrecision=BF162026.031.501
AbsMaxPrecision=FP8, Quantization Granularity=channel2026.031.501
AbsMaxPrecision=FP8, Quantization Granularity=block2026.031.491
SmoothQuantPrecision=FP8, Quantization Granularity=channel2026.031.491
AWQ-W8A8Precision=FP8, Quantization Granularity=channel2026.031.479
Post-trainedPrecision=BF162026.031.438