Synthetic Song Detection on SONICS (Accuracy %)
100Suno v2 AccuracySofia-G1(MERT)
Evaluation results
| Method | Links | |||||
|---|---|---|---|---|---|---|
| Sofia-G1(MERT)Encoder Configuration=MERT2026.06 | 100 | 100 | 100 | 100 | 98.7 | |
| SpecTTTra-γ2026.06 | 98 | 99 | 100 | 37 | 100 | |
| CLAM2026.06 | 97.8 | 97.8 | 97.9 | 97.8 | 97.3 | |
| Sofia-VAG (MoE)Fusion Strategy=MoE2026.06 | 97.4 | 99.8 | 100 | 99.8 | 98.8 | |
| Sofia-VAG (concat)Fusion Strategy=concat2026.06 | 93.3 | 100 | 100 | 100 | 92.3 | |
| SpecTTTra-β2026.06 | 87 | 99 | 100 | 62 | 99 | |
| ViT2026.06 | 82 | 99 | 100 | 53 | 99 | |
| Sofia-G2(MuQ+MERT)Encoder Configuration=MuQ+MERT2026.06 | 80.4 | 100 | 98.2 | 98.7 | 84.7 | |
| Sofia-G1(MuQ)Encoder Configuration=MuQ2026.06 | 78.7 | 100 | 96.5 | 98.2 | 52.1 | |
| SpecTTTra-α2026.06 | 78 | 99 | 100 | 96 | 100 | |
| ConvNeXt2026.06 | 77 | 99 | 99 | 95 | 100 | |
| Sofia-A1(FxPP)Encoder Configuration=FxPP2026.06 | 76.5 | 99.5 | 95.2 | 62.7 | 86.9 | |
| Sofia-V1(Wav2Vec2)Encoder Configuration=Wav2Vec22026.06 | 75.3 | 97.3 | 94.7 | 100 | 90.7 | |
| EfficientViT2026.06 | 73 | 98 | 100 | 95 | 100 | |
| Sofia-V1(RawNet2)Encoder Configuration=RawNet22026.06 | 40.7 | 90.7 | 97.3 | 60.1 | 40.6 | |
| RawNet22026.06 | 31.4 | 96.4 | 99.6 | 8.78 | 7.92 |