List your company
ResearchFormerly WizWand

Zero-shot Task Evaluation on 11 Tasks zero-shot

68.660-shot AverageFine-tuned
28.30838.78449.2659.736Nov 11, 2025
Updated 7mo ago

Evaluation results

MethodLinks
Fine-tunedModel Backbone=Qwen2-7B, Precision=FP162025.1168.66
Fine-tunedModel Backbone=LLaMA3.1-8B, Precision=FP162025.1168.03
Pre-trainedModel Backbone=Qwen2-7B, Precision=FP162025.1167.82
Pre-trainedModel Backbone=LLaMA3.1-8B, Precision=FP162025.1167.24
OSTQuantModel Backbone=Qwen2-7B, Precision=W4A42025.1167.01
CAQModel Backbone=Qwen2-7B, Precision=W4A42025.1166.37
SpinQuantModel Backbone=Qwen2-7B, Precision=W4A42025.1165.94
QuaRotModel Backbone=Qwen2-7B, Precision=W4A42025.1165.69
CAQModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1165.54
OSTQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1165.32
SpinQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1164.57
QuaRotModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1163.02
Fine-tunedModel Backbone=LLaMA2-7B, Precision=FP162025.1162.32
DuQuantModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1162.31
OSTQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.1160.17
Pre-trainedModel Backbone=LLaMA2-7B, Precision=FP162025.1160.14
DuQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.1159.2
CAQModel Backbone=LLaMA2-7B, Precision=W4A42025.1159.05
SpinQuantModel Backbone=LLaMA2-7B, Precision=W4A42025.1158.61
QuaRotModel Backbone=LLaMA2-7B, Precision=W4A42025.1158.36
GPTQModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1136.45
RTNModel Backbone=LLaMA3.1-8B, Precision=W4A42025.1134.92
RTNModel Backbone=LLaMA2-7B, Precision=W4A42025.1132.56
GPTQModel Backbone=LLaMA2-7B, Precision=W4A42025.1132.56
RTNModel Backbone=Qwen2-7B, Precision=W4A42025.1130.28
GPTQModel Backbone=Qwen2-7B, Precision=W4A42025.1129.86