List your company

LEGO Assembly Generation on Pun (test)

0.77Qwen-VL ScorePVPO
0.26040.39270.5250.6573May 29, 2026

Evaluation results

MethodLinks
PVPOBackbone=Qwen2.5-3B-Instruct2026.050.770.280.80.930.35146
High-Value VLM + DiversityBackbone=Llama-3.2-1B-Instruct2026.050.740.270.760.890.32181
High-Value VLM + DiversityBackbone=Qwen2.5-3B-Instruct2026.050.720.260.70.860.31184
High-Value VLMBackbone=Qwen2.5-3B-Instruct2026.050.70.270.720.860.3162
High-Value VLMBackbone=Llama-3.2-1B-Instruct2026.050.70.270.720.80.26205
Full datasetBackbone=Llama-3.2-1B-Instruct2026.050.670.270.740.960.35177
PVPOBackbone=Llama-3.2-1B-Instruct2026.050.670.270.740.970.35179
Lowest perplexityBackbone=Llama-3.2-1B-Instruct2026.050.640.270.740.970.3140
Full datasetBackbone=Qwen2.5-3B-Instruct2026.050.590.260.670.930.32196
Diversity-onlyBackbone=Qwen2.5-3B-Instruct2026.050.580.260.660.950.32163
Random subsetBackbone=Llama-3.2-1B-Instruct2026.050.580.250.670.950.32194
Random subsetBackbone=Qwen2.5-3B-Instruct2026.050.560.250.640.910.28176
Diversity-onlyBackbone=Llama-3.2-1B-Instruct2026.050.550.250.660.940.31199
Low-value VLMBackbone=Qwen2.5-3B-Instruct2026.050.510.220.640.850.25144
Shortest responsesBackbone=Qwen2.5-3B-Instruct2026.050.50.240.650.910.2233
Shortest responsesBackbone=Llama-3.2-1B-Instruct2026.050.490.240.620.890.2238
Longest responsesBackbone=Llama-3.2-1B-Instruct2026.050.480.250.620.910.26351
Lowest perplexityBackbone=Qwen2.5-3B-Instruct2026.050.450.250.560.880.22136
Longest responsesBackbone=Qwen2.5-3B-Instruct2026.050.440.230.570.860.26346
Low-value VLMBackbone=Llama-3.2-1B-Instruct2026.050.280.220.570.870.29334