Brief Audio Artifact Characterization on QualiSpeech
77Noise F1Acc.+Sem. dim.-wise
Evaluation Results
| Method | Links | |||||||||
|---|---|---|---|---|---|---|---|---|---|---|
| Acc.+Sem. dim.-wiseReasoning strategy=Accuracy and Semantic Similarity dimension-wise rewards2026.03 | 77 | 0.68 | 61 | 63 | 0.7 | 80 | 54 | 0.42 | 46 | |
| LLM-judge dim.-wiseReasoning strategy=LLM-judge dimension-wise rewards2026.03 | 77 | 0.75 | 72 | 84 | 0.85 | 84 | 67 | 0.44 | 47 | |
| x (Calibration-only)Strategy=Calibration-only ablation2026.03 | 75 | 0.85 | 67 | 88 | 0.9 | 81 | 56 | 0.44 | 45 | |
| SQ-LLMType=Baseline2026.03 | 72 | 0.57 | 56 | 82 | 0.68 | 74 | 61 | 0.39 | 33 | |
| QualiSpeech-FTType=Baseline2026.03 | 56 | 0.52 | 44 | 73 | 0.71 | 81 | 56 | 0.4 | 25 | |
| QualiSpeech-FT-SALMONNType=Baseline2026.03 | 44 | 0.49 | 49 | 49 | 0.67 | 78 | 53 | 0.4 | 34 |