Sentiment Analysis on NusaX Minangkabau (test)
69.3Mean Test AccuracyDirect FT
Evaluation Results
| Method | Links | |
|---|---|---|
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=1002026.01 | 69.3 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=752026.01 | 63.7 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=100, Discovery Depth (d)=22026.01 | 61.2 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=75, Discovery Depth (d)=22026.01 | 60.1 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=50, Discovery Depth (d)=22026.01 | 58.2 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=25, Discovery Depth (d)=22026.01 | 56.8 | |
| Comp. TuningTuning Protocol=Competence Tuning, Number of target samples (n)=0, Stage-1 Indonesian Samples=502026.01 | 55.4 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=502026.01 | 53.3 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=1002026.01 | 51 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=752026.01 | 50.5 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=502026.01 | 44.8 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=252026.01 | 44 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=252026.01 | 39.4 |