General Language Understanding and Reasoning on Open LLM Leaderboard Population (Top-50)

60.08Accuracycalme-3.2-instruct-78b

Evaluation results

Method
calme-3.2-instruct-78b2026.02	60.08	50.48	71.01	73.95	39.04	56.83	36.36	48	53.18	54.15	73.61
CalmeRys-78B-Orpo-v0.12026.02	59.77	50.16	70.49	73.42	38.51	56.5	34.64	47.89	52.74	53.44	73.02
calme-3.1-instruct-78b2026.02	59.3	49.63	70.47	73.36	38.34	56.58	36.1	47.58	52.65	53.88	73.9
calme-2.4-rys-78b2026.02	59.3	49.42	70.3	73.09	37.79	55.73	34.25	46.83	52.46	52.68	72.64
FluentlyLM-Prinum2026.02	57.88	46.45	70.59	73.7	34.3	59.05	34.02	48.36	50.57	54.59	85.21
Homer-v1.0-Qwen2.5-72B2026.02	57.63	46.23	71.04	74.22	34.38	54.19	29.07	43.72	50.56	45.37	74.48
ultiima-72B2026.02	56.81	45.26	70.43	73.41	33.5	53.54	30.17	43.01	49.92	47.32	73.8
Gilgamesh-72B2026.02	56.71	46.13	69.14	71.37	35	54.25	30.55	43.93	50.74	48.13	74
shuttle-32026.02	56.36	44.43	70.77	72.49	32.77	53.08	28.57	42.33	50.71	46.56	73.56
T3Q-Qwen2.5-14B-Instruct-1M-e32026.02	56.03	45.89	67.19	71.6	33.65	52.05	28.69	42.77	47.22	44.63	71.58
T3Q-qwen2.5-14b-v1.0-e32026.02	56.03	45.89	67.19	71.6	33.65	52.05	28.69	42.77	47.22	44.63	71.58
test-2.5-72B2026.02	55.82	45.1	67.85	70.81	33.74	51.46	28.25	41.56	48.77	44.81	70.91
Qwen2.5-72B-Instruct-abliterated2026.02	55.1	43.65	68.81	71.22	32.86	51.7	28.74	40.85	49.11	44.62	72.7
RYS-XLarge2026.02	55	43.62	67.58	70.88	31.89	52.47	28.83	42.04	47.2	47	73
calme-2.1-rys-78b2026.02	54.96	43.53	67.98	70.11	33.23	54	32.6	43.06	48.85	50.11	74.27
sky-t1-coder-32b-flash2026.02	54.95	43.93	67.63	69.47	33.74	55.14	34.83	44.53	49.69	53.37	72.62
tempmotacilla-cinerea-03082026.02	54.86	43.04	67.16	72.24	29.9	52.76	30.19	42.04	45.29	50.72	72.9
ultiima-72B-v1.52026.02	54.62	42.9	69.53	71.13	32.19	51.37	28.63	40.52	49.54	44.9	72.52
Rombos-LLM-V2.5-Qwen-72b2026.02	54.59	43.29	67.69	70.38	32.68	52.3	29.32	41.85	48.19	45.9	72.54
li-14b-v0.42026.02	54.4	42.46	67.37	70.42	30.46	57.55	32	46.28	46.71	53.79	84.47
calme-2.2-rys-78b2026.02	54.38	42.95	67.41	69.71	32.67	50.61	29.66	39.57	48.43	46.85	71.16
Cheng-22026.02	54.37	42.29	67.77	70.46	30.66	52.41	29.87	41.21	47.4	50.13	72.69
calme-2.2-qwen2-72b2026.02	54.31	42.53	67.4	70.18	31.24	51.52	29.87	40.48	46.81	47.97	72.37
Qwentile2.5-32B-Instruct2026.02	54.25	42.86	67.11	69.49	31.8	54.99	33.73	44.24	47.75	55.74	82.04
calme-2.1-qwen2-72b2026.02	54.22	42.63	66.98	70.38	31.07	51.02	28.93	40.32	46.04	46.44	72.07
calme-2.3-rys-78b2026.02	54.22	42.84	67.34	69.29	33.22	52.52	34.41	41.74	48.47	50.2	71.36
ZYH-LLM-Qwen2.5-14B-V42026.02	54.07	42.34	67.13	69.47	30.48	57.78	31.77	46.67	47.03	53.98	84.42
EVA-Qwen2.5-72B-v0.22026.02	54.03	42.33	67.68	69.38	32.23	50.39	28.23	39.6	48.75	45.5	71.07
Cheng-2-v1.12026.02	54.02	41.91	67.45	70.16	30.56	52.3	29.38	41.09	47.17	48.75	72.55
Qwen2.5-14B-1M-YOYO-V32026.02	54	41.9	67.65	69.86	30.18	52.75	30.97	41.54	47.51	51.26	73.23
virtuoso-small-v2-tensopolis-v12026.02	53.97	42.33	66.2	71.37	29.26	52.56	27.97	41.38	43.68	47.04	74.6
miscii-14b-02182026.02	53.93	41.77	66.45	71.86	29.1	51.86	30.88	40.65	44.17	53.47	73.28
Lix-14B-v0.12026.02	53.92	41.86	66.51	71.2	28.77	52.65	29.95	41.57	44.67	49.79	73.99
QwentileSwap2026.02	53.92	42.55	66.71	70.16	30.94	51.82	29.3	41.09	46.17	46.7	73.2
Qwen2.5-14B-YOYO-V4-p12026.02	53.91	41.6	67.74	69.77	30.73	56.4	30.99	44.95	47.67	52.7	83.23
NQLSG-Qwen2.5-14B-MegaFusion-v9.12026.02	53.88	41.95	66.59	70.28	29.72	53.07	30.7	42.14	45.71	51.08	73.11
Set-70b2026.02	53.86	42.98	67.49	69.1	32.02	49.84	28.18	39.4	47.76	43.15	70.34
Rombos-LLM-V2.5-Qwen-32b2026.02	53.85	42.89	66.22	69.51	31.83	50.5	28.53	40.36	46.42	44.04	70.87
Arcee-Nova2026.02	53.85	42.1	67.25	69.55	31.21	50.98	29.31	39.96	47.19	47.28	71.75
li-14b-v0.4-slerp0.12026.02	53.85	41.87	66.53	70.73	29.12	52.75	30.82	41.67	45.3	51.17	73.74
Qwen2-72B-Orpo-v0.12026.02	53.84	42.39	66.38	69.93	30.94	50.7	28.63	40	45.9	46.24	71.88
NQLSG-Qwen2.5-14B-MegaFusion-v8.72026.02	53.78	41.8	66.47	70.07	29.76	52.35	29.42	41.29	45.76	49.1	72.52
MG-FinalMix-72B2026.02	53.73	42.14	65.86	69.75	30.3	50.69	28.37	40.11	44.71	46.05	71.33
ultiima-32B2026.02	53.68	42.39	67.14	70.51	31.12	51.39	29.03	41.05	46.31	44.73	72.36
NQLSG-Qwen2.5-14B-MegaFusion-v9.22026.02	53.67	41.83	66.22	70.24	29.12	52.65	29.65	41.99	45.28	49.87	72.39
Galactic-Qwen-14B-Exp22026.02	53.6	41.82	66.96	71.2	30.09	50.53	26.64	39.88	45.46	42.42	72.25
RYS-XLarge-base2026.02	53.57	42.36	65.95	69.08	31.49	50.9	29.81	40.56	46.54	47.15	71.64
Qwen2.5-14B-YOYO-V42026.02	53.56	41.53	67.13	69.01	30.43	57.01	33.04	45.78	47.23	54.78	83.47
EVA-abliterated-TIES-Qwen2.5-14B2026.02	53.54	41.63	66.48	70.07	29.57	51.32	29.78	40.35	45.65	49.48	71.62
tempesthenno-sft-0309-ckpt102026.02	53.49	41.33	66.51	71.75	28.79	51.24	30.04	40.09	43.95	52.3	73.06