List your company

Arithmetic on Basic Arithmetic

0.1921DC ScoreGPT-J
-0.006640.044930.09650.14807Apr 14, 2022

Evaluation results

MethodLinks
GPT-JParameters=6B, Few-shot settings=5-shot2022.040.1920.880.2820.8170.3570.4970.0580.0920.0090.021
GPT-NeoXParameters=20B, Few-shot settings=5-shot2022.040.1910.9920.4520.9420.5990.8190.1520.1510.0330.059
GPT-NeoXParameters=20B, Zero-shot=true2022.040.0980.570.1480.680.0990.3440.0070.02900.004
GPT-3 DaVinciZero-shot=true2022.040.0980.7690.1980.580.3420.4830.040.0750.0060.008
GPT-JParameters=6B, Zero-shot=true2022.040.0880.2380.1390.2160.0880.0460.0070.0050.0010
FairSeqModel Size=6.7B, Evaluation Protocol=5-shot2022.040.0460.0340.0490.0180.0010.0020000
FairSeqModel Size=13B, Evaluation Protocol=5-shot2022.040.0460.0510.0530.030.0030.0030000
FairSeqModel Size=2.7B, Evaluation Protocol=5-shot2022.040.0320.0290.0250.0130.0030.00300.00100
FairSeqModel Size=1.3B, Evaluation Protocol=5-shot2022.040.0290.0060.0250.0080.0010.0030000
GPT-3 AdaZero-shot=true2022.040.0290.0060.0220.0130.0010.0010.001000
FairSeqModel Size=355M, Evaluation Protocol=5-shot2022.040.0240.0040.0250.0110.0020.0040000
GPT-3 CurieZero-shot=true2022.040.0240.0250.0580.0760.0030.0040.001000
FairSeqModel Size=125M, Evaluation Protocol=5-shot2022.040.0190.0050.0010.0070.0020.00200.00100
GPT-3 BabbageZero-shot=true2022.040.0010.0090.0210.0130.0010.0010000