List your company
ResearchFormerly WizWand

Relational Reasoning on CLUTRR

0.69Empirical Generalization Error G(W)CoLA
0.4981.7943.094.386Jun 11, 2026
Updated 4mo ago

Evaluation results

MethodLinks
CoLABackbone=TinyLlama [71]2026.060.69
r-cLABackbone=Llama 3 [15]2026.060.94
FFTBackbone=Llama 3 [15]2026.060.95
cLABackbone=TinyLlama [71]2026.060.96
c3LABackbone=TinyLlama [71]2026.060.97
LoRABackbone=TinyLlama [71]2026.061
LoRABackbone=Llama 3 [15]2026.061
LoRA+Backbone=Llama 3 [15]2026.061
RACBackbone=TinyLlama [71]2026.061.01
cLABackbone=Llama 3 [15]2026.061.01
AsymmBackbone=TinyLlama [71]2026.061.04
AsymmBackbone=Llama 3 [15]2026.061.09
CoLABackbone=Llama 3 [15]2026.061.12
r-cLABackbone=TinyLlama [71]2026.061.15
CoLAModel=TinyLlama2026.061.55
CoLAModel (Backbone)=TinyLlama [71]2026.061.55
r-c3LABackbone=Llama 3 [15]2026.061.63
r-c3LABackbone=TinyLlama [71]2026.061.88
c3LABackbone=Llama 3 [15]2026.061.89
FFTBackbone=TinyLlama [71]2026.061.91
RACBackbone=Llama 3 [15]2026.062.06
cLAModel=TinyLlama2026.062.16
cLAModel (Backbone)=TinyLlama [71]2026.062.16
c3LAModel=TinyLlama2026.062.19
c3LAModel (Backbone)=TinyLlama [71]2026.062.19
LoRAModel=TinyLlama2026.062.25
LoRAModel (Backbone)=TinyLlama [71]2026.062.25
RACModel=TinyLlama2026.062.27
RACModel (Backbone)=TinyLlama [71]2026.062.27
AsymModel=TinyLlama2026.062.34
AsymmModel (Backbone)=TinyLlama [71]2026.062.34
LoRA+Backbone=TinyLlama [71]2026.062.44
r-cLAModel=Llama3-8B2026.062.51
r-cLAModel (Backbone)=Llama 3 [15]2026.062.51
FFTModel=Llama3-8B2026.062.53
FFTModel (Backbone)=Llama 3 [15]2026.062.53
r-cLAModel=TinyLlama2026.062.59
r-cLAModel (Backbone)=TinyLlama [71]2026.062.59
LoRA+Model=Llama3-8B2026.062.65
LoRA+Model (Backbone)=Llama 3 [15]2026.062.65
LoRAModel=Llama3-8B2026.062.66
LoRAModel (Backbone)=Llama 3 [15]2026.062.66
cLAModel=Llama3-8B2026.062.69
cLAModel (Backbone)=Llama 3 [15]2026.062.69
AsymModel=Llama3-8B2026.062.9
AsymmModel (Backbone)=Llama 3 [15]2026.062.9
CoLAModel=Llama3-8B2026.062.97
CoLAModel (Backbone)=Llama 3 [15]2026.062.97
r-c3LAModel=TinyLlama2026.064.23
r-c3LAModel (Backbone)=TinyLlama [71]2026.064.23
FFTModel=TinyLlama2026.064.29
FFTModel (Backbone)=TinyLlama [71]2026.064.29
r-c3LAModel=Llama3-8B2026.064.33
r-c3LAModel (Backbone)=Llama 3 [15]2026.064.33
c3LAModel=Llama3-8B2026.065.02
c3LAModel (Backbone)=Llama 3 [15]2026.065.02
LoRA+Model=TinyLlama2026.065.48
LoRA+Model (Backbone)=TinyLlama [71]2026.065.48
RACModel=Llama3-8B2026.065.49
RACModel (Backbone)=Llama 3 [15]2026.065.49