-
公开(公告)号:US20220345234A1
公开(公告)日:2022-10-27
申请号:US17236817
申请日:2021-04-21
发明人: Stephen Morris , Scott Levine , Nicolas Tsingos
摘要: Some implementations of the disclosure relate to using a model trained on mixing console data of sound mixes to automate the process of sound mix creation. In one implementation, a non-transitory computer-readable medium has executable instructions stored thereon that, when executed by a processor, causes the processor to perform operations comprising: obtaining a first version of a sound mix; extracting first audio features from the first version of the sound mix obtaining mixing metadata; automatically calculating with a trained model, using at least the mixing metadata and the first audio features, mixing console features; and deriving a second version of the sound mix using at least the mixing console features calculated by the trained model.
-
公开(公告)号:US11748406B2
公开(公告)日:2023-09-05
申请号:US17516369
申请日:2021-11-01
发明人: Nicolas Tsingos , Scott Levine , Stephen Morris
IPC分类号: G06F16/78 , G06F16/783 , G06F16/787 , G06V20/40 , G06F18/214 , G06N3/045
CPC分类号: G06F16/7834 , G06F16/787 , G06F16/7867 , G06F18/214 , G06N3/045 , G06V20/40
摘要: Some implementations of the disclosure relate to a method, comprising: obtaining, at a computing device, first video clip data including multiple sequential video frames, the multiple sequential video frames including at least a first video frame and a second video frame that occurs after the first video frame; inputting, at the computing device, the first video clip data into at least one trained model that automatically predicts, based on at least features of the first video frame and features of the second video frame, sound effect data corresponding to the second video frame; and determining, at the computing device, based on the sound effect data predicted for the second video frame, a first sound effect file corresponding to the second video frame.
-
公开(公告)号:US20230136632A1
公开(公告)日:2023-05-04
申请号:US17516369
申请日:2021-11-01
发明人: Nicolas Tsingos , Scott Levine , Stephen Morris
IPC分类号: G06F16/783 , G06K9/00 , G06K9/62 , G06N3/04 , G06F16/787 , G06F16/78
摘要: Some implementations of the disclosure relate to a method, comprising: obtaining, at a computing device, first video clip data including multiple sequential video frames, the multiple sequential video frames including at least a first video frame and a second video frame that occurs after the first video frame; inputting, at the computing device, the first video clip data into at least one trained model that automatically predicts, based on at least features of the first video frame and features of the second video frame, sound effect data corresponding to the second video frame; and determining, at the computing device, based on the sound effect data predicted for the second video frame, a first sound effect file corresponding to the second video frame.
-
公开(公告)号:US11581970B2
公开(公告)日:2023-02-14
申请号:US17236817
申请日:2021-04-21
发明人: Stephen Morris , Scott Levine , Nicolas Tsingos
摘要: Some implementations of the disclosure relate to using a model trained on mixing console data of sound mixes to automate the process of sound mix creation. In one implementation, a non-transitory computer-readable medium has executable instructions stored thereon that, when executed by a processor, causes the processor to perform operations comprising: obtaining a first version of a sound mix; extracting first audio features from the first version of the sound mix obtaining mixing metadata; automatically calculating with a trained model, using at least the mixing metadata and the first audio features, mixing console features; and deriving a second version of the sound mix using at least the mixing console features calculated by the trained model.
-
5.
公开(公告)号:US11087738B2
公开(公告)日:2021-08-10
申请号:US16438335
申请日:2019-06-11
发明人: Scott Levine , Stephen Morris
IPC分类号: G10L15/00 , G10H1/00 , G10L15/06 , G06F16/683 , G06F40/58
摘要: Implementations of the disclosure describe systems and methods that leverage machine learning to automate the process of creating music and effects mixes from original sound mixes including domestic dialogue. In some implementations, a method includes: receiving a sound mix including human dialogue; extracting metadata from the sound mix, where the extracted metadata categorizes the sound mix; extracting content feature data from the sound mix, the extracted content feature data including an identification of the human dialogue and instances or times the human dialogue occurs within the sound mix; automatically calculating, with a trained model, content feature data of a music and effects (M&E) sound mix using at least the extracted metadata and the extracted content feature data of the sound mix; and deriving the M&E sound mix using at least the calculated content feature data.
-
-
-
-