List your company
ResearchFormerly WizWand

Model Merging on GLUE (CoLA, MRPC, RTE, SST-2)

75.9Absolute AccuracyTask arithmetic
36.58846.7945767.206Aug 2, 2025
Updated 8mo ago

Evaluation results

MethodLinks
Task arithmeticFine-tuning configuration=Original, Backbone=Llama2-7b2025.0875.991.7
TSVM + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0875.890.8
Task arithmeticFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.0875.795.1
Task arithmetic + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.087591.1
Consensus-mergingFine-tuning configuration=Original, Backbone=Llama2-7b2025.0874.589.7
TSVMFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0873.385.6
Task arithmetic + DisTaCFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.087395.9
Ties-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0872.586.4
TSVM + DisTaCFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.0872.497.1
TSVMFine-tuning configuration=Original, Backbone=RoBERTa-l2025.087287.8
Consensus-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.087294.9
Ties-mergingFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0871.884
Task arithmetic + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.087082.3
Consensus-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0869.882.3
TSVMFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0869.684.3
Consensus-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0868.482.3
Task arithmeticFine-tuning configuration=Original, Backbone=RoBERTa-l2025.0868.382.4
TSVMFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.0868.184.6
Consensus-mergingFine-tuning configuration=Original, Backbone=RoBERTa-l2025.0867.981.4
TSVM + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0867.582.4
TSVM + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0866.384.1
TSVMFine-tuning configuration=Original, Backbone=Llama2-7b2025.0866.178.5
TSVMFine-tuning configuration=Original, Backbone=RoBERTa-b2025.0865.880.8
Ties-mergingFine-tuning configuration=Original, Backbone=RoBERTa-l2025.0865.780.7
Ties-mergingFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0865.479.1
Consensus-mergingFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0865.275.5
TSVM + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0865.179.6
Consensus-mergingFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.086579.1
TSVM + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0864.677.4
Task arithmeticFine-tuning configuration=Low Confidence, Backbone=RoBERTa-l2025.0864.573.9
Task arithmetic + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0864.480.5
Ties-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0864.478
Consensus-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0863.479
Task arithmetic + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0862.574.6
Ties-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0862.476.4
Consensus-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0862.274.3
Task arithmeticFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0861.372.6
Consensus-mergingFine-tuning configuration=Original, Backbone=RoBERTa-b2025.0861.373.7
Consensus-mergingFine-tuning configuration=Low Confidence, Backbone=RoBERTa-b2025.0861.272.3
Task arithmeticFine-tuning configuration=Original, Backbone=RoBERTa-b2025.0860.973.5
Ties-mergingFine-tuning configuration=Original, Backbone=RoBERTa-b2025.0860.974.8
Consensus-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0860.572.5
Task arithmetic + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0859.971.7
Ties-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0859.475.9
Ties-merging + DisTaCFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.0858.978.4
TSVMFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0858.871.1
Ties-mergingFine-tuning configuration=Original, Backbone=Llama2-7b2025.0858.380.7
Consensus-mergingFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0858.368.6
Consensus-mergingFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0858.170
Task arithmeticFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0856.868.5
TSVMFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0855.565.5
Task arithmeticFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0855.364.7
TSVMFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.084860.7
Task arithmeticFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.084658.1
Ties-merging + DisTaCFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.084451.6
Ties-mergingFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0840.851.3
Ties-mergingFine-tuning configuration=Norm Mismatch, Backbone=Llama2-7b2025.0840.647.7
Ties-mergingFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-b2025.0839.946.1
Ties-mergingFine-tuning configuration=Low Confidence, Backbone=Llama2-7b2025.0838.347.5
Consensus-mergingFine-tuning configuration=Norm Mismatch, Backbone=RoBERTa-l2025.0838.147.3