Sentiment Analysis on NusaX Acehnese (ace) (test)
54.7AccuracyCT-SFT
Evaluation results
| Method | Links | |
|---|---|---|
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=100, Discovery Depth (d)=22026.01 | 54.7 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=1002026.01 | 53.7 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=752026.01 | 53.5 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=75, Discovery Depth (d)=22026.01 | 53 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=25, Discovery Depth (d)=22026.01 | 48.6 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=50, Discovery Depth (d)=22026.01 | 48.2 | |
| Comp. TuningTuning Protocol=Competence Tuning, Number of target samples (n)=0, Stage-1 Indonesian Samples=502026.01 | 47.1 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=752026.01 | 47 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=502026.01 | 45.3 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=252026.01 | 44.1 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=1002026.01 | 42.8 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=502026.01 | 36.8 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=252026.01 | 34.6 |