AI

Resource-constrained Stereo Singing Voice Cancellation

1 Mins read

We study the problem of stereo singing voice cancellation, a subtask of music source separation, whose goal is to estimate an instrumental background from a stereo mix. We explore how to achieve performance similar to large state-of-the-art source separation networks starting from a small, efficient model for real-time speech separation. Such a model is useful when memory and compute are limited and singing voice processing has to run with limited look-ahead. In practice, this is realised by adapting an existing mono model to handle stereo input. Improvements in quality are obtained by tuning model parameters and expanding the training set. Moreover, we highlight the benefits a stereo model brings by introducing a new metric which detects attenuation inconsistencies between channels. Our approach is evaluated using objective offline metrics and a large-scale MUSHRA trial, confirming the effectiveness of our techniques in stringent listening tests.


Source link

Related posts
AI

Microsoft and Tsinghua University Researchers Introduce Distilled Decoding: A New Method for Accelerating Image Generation in Autoregressive Models without Quality Loss

4 Mins read
Autoregressive (AR) models have changed the field of image generation, setting new benchmarks in producing high-quality visuals. These models break down the…
AI

Neural Networks for Scalable Temporal Logic Model Checking in Hardware Verification

3 Mins read
Ensuring the correctness of electronic designs is critical, as hardware flaws are permanent post-production and can compromise software reliability or the safety…
AI

Optimizing costs of generative AI applications on AWS

14 Mins read
The report The economic potential of generative AI: The next productivity frontier, published by McKinsey & Company, estimates that generative AI could…

 

 

Leave a Reply

Your email address will not be published. Required fields are marked *