-
公开(公告)号:US20240428813A1
公开(公告)日:2024-12-26
申请号:US18689053
申请日:2022-10-10
Applicant: QUALCOMM Incorporated
Inventor: Guillaume Konrad SAUTIERE , Duminda DEWASURENDRA , Zisis Iason SKORDILIS , Vivek RAJENDRAN
Abstract: Systems and techniques are described for coding audio signals. For example, a voice decoder can generate, using a first neural network, an excitation signal for at least one sample of an audio signal at least in part by performing a non-linear operation based on one or more inputs to the first neural network, the excitation signal being configured to excite a learned linear filter. The voice decoder can further generate, using the learned linear filter and the excitation signal, at least one sample of a reconstructed audio signal. For example, a second neural network can be used to generate coefficients for one or more learned linear filters, which receive as input the excitation signal generated by the first neural network trained to perform the non-linear operation.
-
公开(公告)号:US20250090963A1
公开(公告)日:2025-03-20
申请号:US18294490
申请日:2022-09-08
Applicant: QUALCOMM Incorporated
Inventor: Zisis Iason SKORDILIS , Vivek RAJENDRAN , Guillaume Konrad SAUTIERE , Duminda DEWASURENDRA , Daniel Jared SINDER
Abstract: A device includes a memory and one or more processors coupled to the memory and configured to execute instructions from the memory. Execution of the instructions causes the one or more processors to combine two or more data portions to generate input data for a decoder network. A first data portion of the two or more data portions is based on a first encoding of a data sample by a multiple description coding network and content of a second data portion of the two or more data portions depends on whether data based on a second encoding of the data sample by the multiple description coding network is available. Execution of the instructions also causes the one or more processors to obtain, from the decoder network, output data based on the input data and to generate a representation of the data sample based on the output data.
-
公开(公告)号:US20240428814A1
公开(公告)日:2024-12-26
申请号:US18689054
申请日:2022-10-10
Applicant: QUALCOMM Incorporated
Inventor: Duminda DEWASURENDRA , Guillaume Konrad SAUTIERE , Zisis Iason SKORDILIS , Vivek RAJENDRAN
Abstract: Systems and techniques are described for coding audio signals. For example, a voice decoder can generate, using a neural network, an excitation signal for at least one sample of an audio signal based on one or more inputs to the neural network, the excitation signal being configured to excite a linear predictive coding (LPC) filter. The voice decoder can further generate, using the LPC filter based on the excitation signal, at least one sample of a reconstructed audio signal. For example, the neural network can generate coefficients for one or more linear time-varying filters (e.g., a linear time-varying harmonic filter and a linear time-varying noise filter). The voice decoder can use the one or more linear time-varying filters including the generated coefficients to generate the excitation signal.
-
公开(公告)号:US20240371384A1
公开(公告)日:2024-11-07
申请号:US18689052
申请日:2022-10-10
Applicant: QUALCOMM Incorporated
Inventor: Zisis Iason SKORDILIS , Vivek RAJENDRAN , Duminda DEWASURENDRA , Guillaume Konrad SAUTIERE
IPC: G10L19/26 , G10L19/087
Abstract: Systems and techniques are described for audio coding. An audio system receives feature(s) corresponding an audio signal, for example from an encoder and/or a speech synthesis engine. The audio system generates an excitation signal, such as a harmonic signal and/or a noise signal, based on the feature(s). The audio system uses a filterbank to generate band-specific signals from the excitation signal. The band-specific signals correspond to frequency bands. The audio system inputs the feature(s) into a machine learning (ML) filter estimator to generate parameter(s) associated with linear filter(s). The audio system inputs the feature(s) into a voicing estimator to generate gain value(s). The audio system generates an output audio signal based on modification of the band-specific signals, application of the linear filter(s) according to the parameter(s), and amplification using the gain amplifier(s) according to the gain value(s).
-
公开(公告)号:US20250104723A1
公开(公告)日:2025-03-27
申请号:US18728154
申请日:2023-01-23
Applicant: QUALCOMM Incorporated
Inventor: Guillaume Konrad SAUTIERE , Vivek RAJENDRAN , Zisis Iason SKORDILIS
IPC: G10L19/04
Abstract: A method includes generating an input data state for each data sample in a time series of data samples of a portion of an audio data stream. The method also includes providing at least one input data state to a first bottleneck and at least one other input data state to a second bottleneck. The first bottleneck is associated with a first bitrate and the second bottleneck is associated with a second bitrate. The method further includes generating a first encoded frame based on a first output data state from the first bottleneck and a second encoded frame based on a second output data state from the second bottleneck. The first encoded frame and the second encoded frame are bundled in a packet.
-
公开(公告)号:US20240378698A1
公开(公告)日:2024-11-14
申请号:US18362589
申请日:2023-07-31
Applicant: QUALCOMM Incorporated
Inventor: Jens PETERSEN , Michal Jakub STYPULKOWSKI , Noor Fathima Khanum MOHAMED GHOUSE , Auke Joris WIGGERS , Guillaume Konrad SAUTIERE
Abstract: Systems and techniques are provided for processing image data. According to some aspects, a computing device can determine an optical flow between a current frame having a first resolution and a first previous frame having the first resolution. The computing device can warp a second previous frame having a second resolution based on the determined optical flow to generate a warped previous frame having the second resolution, the second resolution being higher than the first resolution. The computing device can process, using a diffusion machine learning model, a noise frame, the current frame, and the warped previous frame to generate an output frame having the second resolution.
-
公开(公告)号:US20240121398A1
公开(公告)日:2024-04-11
申请号:US18458006
申请日:2023-08-29
Applicant: QUALCOMM Incorporated
Inventor: Noor Fathima Khanum MOHAMED GHOUSE , Jens PETERSEN , Tianlin XU , Guillaume Konrad SAUTIERE , Auke Joris WIGGERS
IPC: H04N19/137 , H04N19/147 , H04N19/162
CPC classification number: H04N19/137 , H04N19/147 , H04N19/162
Abstract: Systems and techniques are described for processing image data using a residual model that can be configured with an adjustable number of sampling steps. For example, a process can include obtaining a latent representation of an image and processing, using a decoder of a machine learning model, the latent representation of the image to generate an initial reconstructed image. The process can further include processing, using the residual model, the initial reconstructed image and noise data to predict a plurality of predictions of a residual over a number of sampling steps. The residual represents a difference between the image and the initial reconstructed image. The process can include obtaining, from the plurality of predictions of the residual, a final residual representing the difference between the image and the initial reconstructed image. The process can further include combining the initial reconstructed image and the residual to generate a final reconstructed image.
-
公开(公告)号:US20240364925A1
公开(公告)日:2024-10-31
申请号:US18636126
申请日:2024-04-15
Applicant: QUALCOMM Incorporated
Inventor: Hoang Cong Minh LE , Qiqi HOU , Farzad FARHADZADEH , Amir SAID , Auke Joris WIGGERS , Guillaume Konrad SAUTIERE , Reza POURREZA
IPC: H04N19/597 , H04N19/137 , H04N19/436
CPC classification number: H04N19/597 , H04N19/137 , H04N19/436
Abstract: Systems and techniques are described herein for processing video data. For example, a machine-learning based stereo video coding system can obtain video data including at least a right-view image of a right view of a scene and a left-view image of a left view of the scene. The machine-learning based stereo video coding system can compress the right-view image and the left-view image in parallel to generate a latent representation of the right-view image and the left-view image. The right-view image and the left-view image can be compressed in parallel based on inter-view information between the right-view image and the left-view image, determined using one or more parallel autoencoders.
-
公开(公告)号:US20240323415A1
公开(公告)日:2024-09-26
申请号:US18188070
申请日:2023-03-22
Applicant: QUALCOMM Incorporated
Inventor: David Wilson ROMERO GUZMAN , Gabriele CESA , Guillaume Konrad SAUTIERE , Yunfan ZHANG , Taco Sebastiaan COHEN , Auke Joris WIGGERS
IPC: H04N19/42 , G06T3/40 , H04N19/182
CPC classification number: H04N19/42 , G06T3/4046 , H04N19/182
Abstract: Certain aspects of the present disclosure provide techniques and apparatus for encoding content using a neural network. An example method generally includes encoding video content into a latent space representation through an encoder implemented by a first machine learning model. A code is generated by upsampling the latent space representation of the video content. A prior is calculated based on a conditional probability of obtaining the upsampled latent space representation conditioned by the latent space representation of the video content. A compressed version of the video content is generated based on a probabilistic model implemented by a second machine learning model, the generated code, and the calculated prior, and the compressed version of the video content is output for transmission.
-
公开(公告)号:US20210281867A1
公开(公告)日:2021-09-09
申请号:US17091570
申请日:2020-11-06
Applicant: QUALCOMM Incorporated
Inventor: Adam Waldemar GOLINSKI , Yang YANG , Reza POURREZA , Guillaume Konrad SAUTIERE , Ties Jehan VAN ROZENDAAL , Taco Sebastiaan COHEN
IPC: H04N19/42 , H04N19/137 , H04N19/172 , H04N19/85 , G06N3/08
Abstract: Techniques are described herein for coding video content using recurrent-based machine learning tools. A device can include a neural network system including encoder and decoder portions. The encoder portion can generate output data for the current time step of operation of the neural network system based on an input video frame for a current time step of operation of the neural network system, reconstructed motion estimation data from a previous time step of operation, reconstructed residual data from the previous time step of operation, and recurrent state data from at least one recurrent layer of a decoder portion of the neural network system from the previous time step of operation. A decoder portion of the neural network system can generate, based on the output data and recurrent state data from the previous time step of operation, a reconstructed video frame for the current time step of operation.
-
-
-
-
-
-
-
-
-