Sentiment Analysis on NusaX Buginese (bug) (test)
51.6AccuracyDirect FT
Evaluation results
| Method | Links | |
|---|---|---|
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=1002026.01 | 51.6 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=100, Discovery Depth (d)=22026.01 | 49.3 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=752026.01 | 49.2 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=75, Discovery Depth (d)=22026.01 | 47.8 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=752026.01 | 46.4 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=1002026.01 | 45.4 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=50, Discovery Depth (d)=22026.01 | 42.1 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=252026.01 | 41.7 | |
| CT-SFTTuning Protocol=Circuit-Targeted SFT, Number of target samples (n)=25, Discovery Depth (d)=22026.01 | 40.2 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=252026.01 | 37.6 | |
| Direct FTTuning Protocol=Direct Fine-tuning, Number of target samples (n)=502026.01 | 37.2 | |
| Comp. TuningTuning Protocol=Competence Tuning, Number of target samples (n)=0, Stage-1 Indonesian Samples=502026.01 | 36.6 | |
| Full FTTuning Protocol=Full Model Tuning, Number of target samples (n)=502026.01 | 35.1 |