Field Metadata Extraction on Metadata (test)
0.9114Msr Accuracytext-davinci-003
Evaluation Results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| text-davinci-003few-shot setting=1-shot2022.09 | 0.9114 | 0.8247 | 0.448 | 0.573 | 0.4638 | 0.2932 | 0.5536 | 0.7566 | |
| text-davinci-003few-shot setting=5-shot2022.09 | 0.9071 | 0.7923 | 0.4482 | 0.5644 | 0.4048 | 0.2918 | 0.5696 | 0.8047 | |
| text-davinci-003few-shot setting=3-shot2022.09 | 0.9053 | 0.7881 | 0.4512 | 0.5414 | 0.4112 | 0.2843 | 0.5681 | 0.8037 | |
| text-davinci-003few-shot setting=0-shot2022.09 | 0.8718 | 0.8839 | 0.4151 | 0.5018 | 0.4611 | 0.351 | 0.5145 | 0.7746 | |
| text-davinci-002few-shot setting=1-shot2022.09 | 0.7941 | 0.7403 | 0.4081 | 0.5736 | 0.3594 | 0.1637 | 0.5563 | 0.5501 | |
| text-davinci-002few-shot setting=0-shot2022.09 | 0.6457 | 0.881 | 0.4423 | 0.4308 | 0.3185 | 0.1864 | 0.5841 | 0.6526 | |
| text-davinci-001few-shot setting=1-shot2022.09 | 0.5286 | 0.7801 | 0.3848 | 0.2285 | 0.0259 | 0.1092 | 0.5411 | 0.3584 | |
| text-davinci-001few-shot setting=0-shot2022.09 | 0.2828 | 0.7366 | 0.3879 | 0.2603 | 0.0443 | 0.131 | 0.5571 | 0.1949 |