AI

Resource-constrained Stereo Singing Voice Cancellation

1 Mins read

We study the problem of stereo singing voice cancellation, a subtask of music source separation, whose goal is to estimate an instrumental background from a stereo mix. We explore how to achieve performance similar to large state-of-the-art source separation networks starting from a small, efficient model for real-time speech separation. Such a model is useful when memory and compute are limited and singing voice processing has to run with limited look-ahead. In practice, this is realised by adapting an existing mono model to handle stereo input. Improvements in quality are obtained by tuning model parameters and expanding the training set. Moreover, we highlight the benefits a stereo model brings by introducing a new metric which detects attenuation inconsistencies between channels. Our approach is evaluated using objective offline metrics and a large-scale MUSHRA trial, confirming the effectiveness of our techniques in stringent listening tests.


Source link

Related posts
AI

Google DeepMind Just Released PaliGemma 2: A New Family of Open-Weight Vision Language Models (3B, 10B and 28B)

3 Mins read
Vision-language models (VLMs) have come a long way, but they still face significant challenges when it comes to effectively generalizing across different…
AI

Advancing AI trust with new responsible AI tools, capabilities, and resources

7 Mins read
As generative AI continues to drive innovation across industries and our daily lives, the need for responsible AI has become increasingly important….
AI

Study: Browsing negative content online makes mental health struggles worse | MIT News

3 Mins read
People struggling with their mental health are more likely to browse negative content online, and in turn, that negative content makes their…

 

 

Leave a Reply

Your email address will not be published. Required fields are marked *