List your company
ResearchFormerly WizWand

Question Answering on OpenBookQA (Open)

88Open AccuracyLD-MoLE
80.7282.6184.586.39Sep 30, 2025
Updated 8mo ago

Evaluation results

MethodLinks
LD-MoLEModel=Llama3.1-8B, TP=2.33 %2025.0988
MoLA(2468)Model=Llama3.1-8B, TP=1.26 %2025.0987.6
ReMoLEModel=Llama3.1-8B, TP=2.17 %2025.0987.6
MoLA(8888)Model=Llama3.1-8B, TP=2.17 %2025.0986.4
LD-MoLEModel=Qwen3-1.7B, TP=4.23 %2025.0985
ReMoLEModel=Qwen3-1.7B, TP=4.12 %2025.0984.8
LD-MoLEModel=Llama3.2-3B, TP=3.28 %2025.0984
MoLA(2468)Model=Llama3.2-3B, TP=1.80 %2025.0983.6
ReMoLEModel=Llama3.2-3B, TP=3.11 %2025.0983.4
MoLA(2468)Model=Qwen3-1.7B, TP=2.39 %2025.0983
MoLA(8888)Model=Qwen3-1.7B, TP=4.12 %2025.0982.4
MoLA(8888)Model=Llama3.2-3B, TP=3.11 %2025.0981