List your company

Intent Classification on POWERPLAY11 HINT3 (test)

76.1AccuracyDynamic Label Name Refinement
58.139262.802167.46572.1279Dec 20, 2024

Evaluation results

MethodLinks
Dynamic Label Name RefinementBackbone=Llama3-8b-inst2024.1276.1
Dynamic Label Name RefinementBackbone=Qwen2.5-7b-inst2024.1274.76
RawBackbone=Qwen2.5-7b-inst2024.1271.2
RawBackbone=Llama3-8b-inst2024.1270.87
Chain-of-ThoughtBackbone=Qwen2.5-7b-inst2024.1270.06
Chain-of-ThoughtBackbone=Llama3-8b-inst2024.1267
Dynamic Label Name RefinementBackbone=Qwen2.5-1.5b-inst2024.1263.1
RawBackbone=Qwen2.5-1.5b-inst2024.1260.84
Chain-of-ThoughtBackbone=Qwen2.5-1.5b-inst2024.1258.83