Citation Intent Classification on Scicite (test)
54.5Average AccuracyDATAMODELS
Evaluation results
| Method | Links | |||
|---|---|---|---|---|
| DATAMODELSBackbone=GPTJ-6B2022.12 | 54.5 | 3.8 | 43.9 | |
| UN-CONDACCBackbone=GPTJ-6B2022.12 | 54.2 | 3.4 | 45.9 | |
| CONDACCBackbone=GPTJ-6B2022.12 | 52.3 | 4.4 | 42 | |
| TOPPROMPTS-5Backbone=GPTJ-6B2022.12 | 50.4 | 6 | 36.9 | |
| TOPPROMPTS-10Backbone=GPTJ-6B2022.12 | 49.4 | 5.5 | 36.2 | |
| CONDACCBackbone=OPT-13B2022.12 | 49.4 | 3.3 | 41.1 | |
| UN-TOPPROMPTS-5Backbone=GPTJ-6B2022.12 | 48.7 | 6.9 | 33 | |
| UN-CONDACCBackbone=OPT-13B2022.12 | 48.1 | 4 | 39.2 | |
| RANDOMBackbone=GPTJ-6B2022.12 | 46.4 | 6.9 | 35.5 | |
| DATAMODELSBackbone=OPT-13B2022.12 | 46.3 | 3.9 | 37.4 | |
| TOPPROMPTS-5Backbone=OPT-13B2022.12 | 45.9 | 4.3 | 36 | |
| UN-TOPPROMPTS-5Backbone=OPT-13B2022.12 | 45.7 | 4.7 | 33.6 | |
| ONESHOTBackbone=GPTJ-6B2022.12 | 44.8 | 5.9 | 33.8 | |
| TOPPROMPTS-10Backbone=OPT-13B2022.12 | 44.6 | 3.9 | 36.7 | |
| ALLBackbone=GPTJ-6B2022.12 | 43.8 | 7.2 | 33.6 | |
| UN-ONESHOTBackbone=GPTJ-6B2022.12 | 43.5 | 6.7 | 33.4 | |
| ALLBackbone=OPT-13B2022.12 | 42.8 | 3.6 | 35 | |
| UN-ALLBackbone=GPTJ-6B2022.12 | 42 | 7 | 33.5 | |
| ONESHOTBackbone=OPT-13B2022.12 | 41.9 | 3.8 | 33.4 | |
| UN-ALLBackbone=OPT-13B2022.12 | 41.9 | 3.6 | 35.7 | |
| UN-ONESHOTBackbone=OPT-13B2022.12 | 41.5 | 4.1 | 33.7 | |
| RANDOMBackbone=OPT-13B2022.12 | 41.2 | 4.6 | 33.3 | |
| ALL + CALIBBackbone=OPT-13B2022.12 | 35.5 | 1.8 | 31.2 | |
| ALL + CALIBBackbone=GPTJ-6B2022.12 | 35.4 | 2.6 | 32.8 |