# Synthetic speech detection on SingFake (dev) Source: [Synthetic speech detection on SingFake (dev)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:32:42.867Z Evaluation of Synthetic speech detection performance on the development set of the SingFake dataset, reporting ACC, F1, and EER. A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Synthetic speech detection | | Dataset (including any stated split) | SingFake (dev) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. - [Equal Error Rate](): Lower is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | MAMBA-B | 92.28 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 89.29 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 87.34 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-B | 87.2 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 87.14 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-B | 86.79 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 86.61 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 86.12 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 85.52 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 85.17 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 84.11 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 80.89 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 80.38 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 78.85 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 78.22 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 78.22 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 77.45 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 76.65 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 76.54 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 76.39 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 75.51 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 74.57 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 73.89 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 73.45 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 72.42 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 71.77 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 70.27 | Not recorded | 6965d1af6343fa78c83238a0 | ### MAMBA-B Accuracy: 92.28. Result ID: 699a15e45698665ec49a1309. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 89.29. Result ID: 699a15e45698665ec49a1308. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### X-vector Accuracy: 87.34. Result ID: 699a15e45698665ec49a1303. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-B Accuracy: 87.2. Result ID: 699a15e45698665ec49a1300. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 87.14. Result ID: 699a15e45698665ec49a1307. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-B Accuracy: 86.79. Result ID: 699a15e45698665ec49a12f7. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 86.61. Result ID: 699a15e45698665ec49a1306. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 86.12. Result ID: 699a15e45698665ec49a12ff. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 85.52. Result ID: 699a15e45698665ec49a1301. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### wavLM Accuracy: 85.17. Result ID: 699a15e45698665ec49a1305. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 84.11. Result ID: 699a15e45698665ec49a12f6. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 80.89. Result ID: 699a15e45698665ec49a1304. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 80.38. Result ID: 699a15e45698665ec49a1302. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### X-vector Accuracy: 78.85. Result ID: 699a15e45698665ec49a12fa. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 78.22. Result ID: 699a15e45698665ec49a12fd. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 78.22. Result ID: 699a15e45698665ec49a12fe. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 77.45. Result ID: 699a15e45698665ec49a12f8. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 76.65. Result ID: 699a15e45698665ec49a12f5. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wavLM Accuracy: 76.54. Result ID: 699a15e45698665ec49a12fc. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### X-vector Accuracy: 76.39. Result ID: 699a15e45698665ec49a12f1. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 75.51. Result ID: 699a15e45698665ec49a12ef. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wavLM Accuracy: 74.57. Result ID: 699a15e45698665ec49a12f3. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 73.89. Result ID: 699a15e45698665ec49a12f4. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 73.45. Result ID: 699a15e45698665ec49a12fb. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 72.42. Result ID: 699a15e45698665ec49a12f9. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 71.77. Result ID: 699a15e45698665ec49a12f2. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 70.27. Result ID: 699a15e45698665ec49a12f0. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.