# Synthetic Speech Detection on SingFake (ID/OOD) Source: [Synthetic Speech Detection on SingFake (ID/OOD)]() Collection index: [llms.txt]() Data updated: 2026-02-26T05:32:42.885Z Evaluation of Synthetic Speech Detection performance on the SingFake (ID/OOD) dataset, reporting Accuracy, F1-score, and Equal Error Rate (EER). A research result applies to its stated dataset, split, metric and evaluation configuration. Compare like-for-like settings, preserve the metric's unit and direction, and distinguish paper-reported results from independent reproduction. The best result recorded here is not a claim of exhaustive, current global coverage. | Scope | Recorded value | | --- | --- | | Task | Synthetic speech detection | | Dataset (including any stated split) | SingFake (ID/OOD) | | Metric | Accuracy | | Unit | PERCENT | | Direction | Higher is better | | Results loaded | 27 of 27 | | Coverage | All results currently returned for this benchmark | Evaluation settings may differ between results. The original papers and recorded configurations are needed to establish comparability. A shared metric name alone does not establish an identical protocol. ## Metrics - [Accuracy](): Higher is better; unit: PERCENT. - [F1 Score](): Higher is better; unit: PERCENT. - [EER](): Lower is better; unit: PERCENT. ## Recorded results | Method | Accuracy | Result date | Report paper | | --- | --- | --- | --- | | MAMBA-B | 79.66 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 77.64 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 77.26 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 76.04 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 73.96 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-B | 73.47 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 72.41 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 71.77 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 71.42 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 70.46 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-B | 70.14 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 70.06 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 70.05 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 68.32 | Not recorded | 6965d1af6343fa78c83238a0 | | ECAPA | 68.28 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 67.97 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-S | 67.64 | Not recorded | 6965d1af6343fa78c83238a0 | | X-vector | 67.31 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 66.79 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 64.98 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 64.65 | Not recorded | 6965d1af6343fa78c83238a0 | | MAMBA-T | 64.15 | Not recorded | 6965d1af6343fa78c83238a0 | | wavLM | 63.44 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 63.01 | Not recorded | 6965d1af6343fa78c83238a0 | | Whisper | 62.97 | Not recorded | 6965d1af6343fa78c83238a0 | | wav2vec 2.0 | 61.72 | Not recorded | 6965d1af6343fa78c83238a0 | | Unispeech | 61.19 | Not recorded | 6965d1af6343fa78c83238a0 | ### MAMBA-B Accuracy: 79.66. Result ID: 699a15e45698665ec49a1324. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### X-vector Accuracy: 77.64. Result ID: 699a15e45698665ec49a131e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 77.26. Result ID: 699a15e45698665ec49a1323. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 76.04. Result ID: 699a15e45698665ec49a1321. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 73.96. Result ID: 699a15e45698665ec49a1322. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-B Accuracy: 73.47. Result ID: 699a15e45698665ec49a131b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### wavLM Accuracy: 72.41. Result ID: 699a15e45698665ec49a1320. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### X-vector Accuracy: 71.77. Result ID: 699a15e45698665ec49a1315. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 71.42. Result ID: 699a15e45698665ec49a131a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 70.46. Result ID: 699a15e45698665ec49a131c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### MAMBA-B Accuracy: 70.14. Result ID: 699a15e45698665ec49a1312. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 70.06. Result ID: 699a15e45698665ec49a131f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 70.05. Result ID: 699a15e45698665ec49a1318. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 68.32. Result ID: 699a15e45698665ec49a131d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"SIGNAL (KNN + GNN)"}. This record does not assert independent reproduction. ### ECAPA Accuracy: 68.28. Result ID: 699a15e45698665ec49a130f. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 67.97. Result ID: 699a15e45698665ec49a1319. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-S Accuracy: 67.64. Result ID: 699a15e45698665ec49a1311. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### X-vector Accuracy: 67.31. Result ID: 699a15e45698665ec49a130c. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wavLM Accuracy: 66.79. Result ID: 699a15e45698665ec49a1317. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 64.98. Result ID: 699a15e45698665ec49a1313. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 64.65. Result ID: 699a15e45698665ec49a1316. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### MAMBA-T Accuracy: 64.15. Result ID: 699a15e45698665ec49a1310. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wavLM Accuracy: 63.44. Result ID: 699a15e45698665ec49a130e. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 63.01. Result ID: 699a15e45698665ec49a1314. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"GNN"}. This record does not assert independent reproduction. ### Whisper Accuracy: 62.97. Result ID: 699a15e45698665ec49a130a. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### wav2vec 2.0 Accuracy: 61.72. Result ID: 699a15e45698665ec49a130d. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. ### Unispeech Accuracy: 61.19. Result ID: 699a15e45698665ec49a130b. [Reporting paper]() [Method origin paper]() Recorded evaluation configuration: {"Protocol":"KNN"}. This record does not assert independent reproduction. Page 1 of 1. This is an index page, not the full collection.