- Patent Title: Automatic isolation of multiple instruments from musical mixtures
-
Application No.: US17205296Application Date: 2021-03-18
-
Publication No.: US11568256B2Publication Date: 2023-01-31
- Inventor: Andreas Simon Thore Jansson , Angus William Sackfield , Ching Chuan Sung , Rachel M. Bittner
- Applicant: Spotify AB
- Applicant Address: SE Stockholm
- Assignee: Spotify AB
- Current Assignee: Spotify AB
- Current Assignee Address: SE Stockholm
- Agency: Merchant & Gould P.C.
- Main IPC: G06F15/00
- IPC: G06F15/00 ; G10L25/00 ; G06N3/08 ; G06K9/62 ; G06N3/04 ; G10H1/00 ; G10L21/0272 ; G10L21/028

Abstract:
A system, method and computer product for training a neural network system. The method comprises inputting an audio signal to the system to generate plural outputs f(X, Θ). The audio signal includes one or more of vocal content and/or musical instrument content, and each output f(X, Θ) corresponds to a respective one of the different content types. The method also comprises comparing individual outputs f(X, Θ) of the neural network system to corresponding target signals. For each compared output f(X, Θ), at least one parameter of the system is adjusted to reduce a result of the comparing performed for the output f(X, Θ), to train the system to estimate the different content types. In one example embodiment, the system comprises a U-Net architecture. After training, the system can estimate various different types of vocal and/or instrument components of an audio signal, depending on which type of component(s) the system is trained to estimate.
Public/Granted literature
- US20210279588A1 AUTOMATIC ISOLATION OF MULTIPLE INSTRUMENTS FROM MUSICAL MIXTURES Public/Granted day:2021-09-09
Information query