Sentence Classification on Chart-To-Text (test)
92.38AccuracyCHATS-PI
Evaluation results
| Method | Links | ||||||||
|---|---|---|---|---|---|---|---|---|---|
| CHATS-PIAnnotation set=CHATS-PI (DePlot, PALM-2), Backbone=DePlot, PALM-2(L), Temperature=0.7, Candidates=102024.05 | 92.38 | 66.76 | 99.26 | 92.73 | 95.89 | 72.53 | 51.01 | 0 | |
| f(x)=1Annotation set=CHATS-PI (DePlot, PALM-2)2024.05 | 89.4 | 50 | 100 | 89.4 | 94.41 | 50 | — | — | |
| CHATS-PIAnnotation set=CHATS-PI (PALM-2), Backbone=PALM-2(L), Temperature=0.7, Candidates=102024.05 | 84.49 | 68.93 | 93.9 | 87.83 | 91.81 | 70.6 | 43.6 | 0 | |
| f(x)=1Annotation set=CHATS-PI (PALM-2)2024.05 | 83.33 | 50 | 100 | 83.33 | 90.91 | 50 | — | — | |
| CHATS-CRITICAnnotation set=Reference, Threshold=0.75, Temperature=0.3, Samples=82024.05 | 82 | 79.45 | 92.22 | 80.58 | 86.01 | 81.56 | 62.2 | 0 | |
| CHATS-PIAnnotation set=PALM-2, Backbone=PALM-2(S), Temperature=0.7, Candidates=102024.05 | 81.23 | 71.24 | 90.86 | 85.24 | 87.96 | 70.54 | 45.15 | 0 | |
| f(x)=1Annotation set=PALM-22024.05 | 75.48 | 50 | 100 | 75.48 | 86.03 | 50 | — | — | |
| f(x)=1Annotation set=Reference2024.05 | 60 | 50 | 100 | 60 | 75 | 50 | — | — |