Sentiment Analysis on NusaX Javanese (jav) (test)
63.6Mean Test AccuracyCT-SFT
Evaluation Results
| Method | Links | |
|---|---|---|
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=100, Discovery Depth (d)=22026.01 | 63.6 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=75, Discovery Depth (d)=22026.01 | 62.9 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=25, Discovery Depth (d)=22026.01 | 59.2 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=50, Discovery Depth (d)=22026.01 | 59.1 | |
| Comp. TuningTuning Protocol=Competence Tuning, Number of target samples (n)=0, Stage-1 Indonesian Samples=502026.01 | 58.1 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=752026.01 | 56.2 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=1002026.01 | 55 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=1002026.01 | 47.5 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=752026.01 | 41.3 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=502026.01 | 40.5 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=252026.01 | 38.4 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=252026.01 | 37.7 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=502026.01 | 37.2 |