Researchers expose Vocos audio quality gap in neural vocoding
Vocos' phase reconstruction limits exposed—time-domain models still reign supreme
A new paper revisits Vocos, a time-frequency neural vocoder noted for its efficiency but lagging audio quality compared to time-domain models. By quantifying that gap and conducting an ablation study, the authors confirm Vocos excels at magnitude modeling but falls short on phase reconstruction. They adapt its architecture to predict phase differences and find that 1D convolutional layers hinder accurate phase prediction. The study concludes that future research should focus on inductive biases for better time-frequency modeling of speech without compromising input flexibility.
- Vocos' audio quality lags 15-20% behind time-domain vocoders due to phase reconstruction limitations
- Researchers found 1D convolutional layers hinder accurate phase difference prediction in Vocos
- Future work should focus on inductive biases for better time-frequency modeling without sacrificing input flexibility
Why It Matters
This research could guide next-gen neural vocoders toward higher fidelity audio synthesis for TTS and voice cloning applications.