List your company

Multilingual Factual Reasoning on mTruthfulQA

54.46Score (ar)LLaMA3.1-8B-AdaMCOT
40.47244.103547.73551.3665Jan 27, 2025

Evaluation results

MethodLinks
LLaMA3.1-8B-AdaMCOTBackbone=LLaMA3.1-8B, Method=AdaMCOT2025.0154.4649.6856.1150.757.4959.2457.4148.4558.8349.2552.7857.9468.0436.3559.6457.0949.1245.2450.3951.8157.8371.4557.2556.660.0356.6156.245.6345.8258.0561.5359.14
Qwen2.5-7BBackbone=Qwen2.5-7B2025.0152.7842.2551.8750.3251.2760.5954.8820.855.5326.8144.1145.2946.0418.4459.1356.0729.0625.0732.230.6257.261.1752.556.9846.0246.0856.3323.0122.5552.654.959.77
Qwen2.5-7B-AdaMCOTBackbone=Qwen2.5-7B, Method=AdaMCOT2025.0147.3544.8152.6451.3455.3362.5556.437.2158.8331.3350.0654.0669.9531.6552.4456.3236.4330.2637.9642.3855.876.9355.260.1556.0454.1754.1331.2232.7758.747.5258.5
LLaMA3.1-8BBackbone=LLaMA3.1-8B2025.0146.9636.1151.0948.7851.957.1654.3732.5653.6248.743.7349.9447.8632.0146.9254.1548.3844.8147.7743.4151.2157.8753.5344.1648.9748.7853.149.3942.8448.5752.4850.13
Qwen2.5-7B-QAlignBackbone=Qwen2.5-7B, Method=QAlign2025.0145.827.1446.0747.2552.6659.4952.0915.7652.8617.2433.5941.8835.1514.3152.3151.8516.9615.7122.3821.7352.7454.0647.3750.1340.4943.5748.3216.5518.8744.2947.3955.39
Qwen2.5-7B-AutoCAPBackbone=Qwen2.5-7B, Method=AutoCAP2025.0144.1833.9445.3243.7544.8353.4647.0216.8750.3422.1535.0942.1536.7219.9550.1350.8623.5721.1827.2525.0650.3452.6146.9250.8141.6743.2548.7125.921.4345.9346.6651.72
LLaMA3.1-8B-QAlignBackbone=LLaMA3.1-8B, Method=QAlign2025.0143.4740.4640.6736.6243.438.3138.5336.0542.4442.6842.338.8441.6337.0142.1639.3441.4546.5445.8136.8241.5340.6141.2140.8638.0537.7442.7642.6641.1338.9638.8537.39
LLaMA3.1-8B-AutoCAPBackbone=LLaMA3.1-8B, Method=AutoCAP2025.0141.0142.8950.9750.6653.0549.250.4427.2652.7343.6438.4248.6343.7154.7950.5149.5558.8543.6630.6337.7351.3452.5452.7645.348.248.2852.8448.3244.5445.0651.9744.04