公开(公告)号：US20240371383A1

公开(公告)日：2024-11-07

申请号：US18653233

申请日：2024-05-02

Applicant: Electronics and Telecommunications Research Institute ,  UIF (University Industry Foundation), Yonsei University

Inventor： Inseon JANG ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Woo-taek LIM ,  Byeongho CHO ,  Hong-Goo KANG ,  Byeong Hyeon KIM ,  Jihyun LEE ,  Hyungseob LIM

IPC: G10L19/038 ,  G10L19/02

Abstract: A method and apparatus for encoding/decoding audio signal are provided. The encoding method includes transforming an input audio signal in a time domain into an audio signal in a frequency domain, quantizing energy of a frequency band of the audio signal in the frequency domain, generating a normal signal by normalizing the audio signal in the frequency domain according to quantized energy, obtaining a feature vector including information on the energy of the frequency band based on the normal signal and the input audio signal, quantizing the feature vector, obtaining a scale factor used to scale the normal signal based on the quantized feature vector, quantizing an adjustment signal into which the normal signal has been scaled based on the scale factor, and outputting bitstreams based on the quantized energy, the quantized feature vector, and the quantized adjustment signal.

公开(公告)号：US20240144943A1

公开(公告)日：2024-05-02

申请号：US18473791

申请日：2023-09-25

Applicant: Electronics and Telecommunications Research Institute ,  The Trustees of Indiana University

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Inseon JANG ,  Jongmo SUNG ,  Tae Jin LEE ,  Byeongho CHO ,  Minje KIM ,  Darius Petermann

IPC: G10L19/038 ,  G10L25/18

CPC classification number: G10L19/038 ,  G10L25/18

Abstract: An audio signal encoding/decoding method and an apparatus for performing the same are disclosed. The audio signal encoding method includes obtaining a full-band input signal, extracting a first feature vector corresponding to a first sub-band signal and a second feature vector corresponding to a second sub-band signal using an encoder neural network including a plurality of encoding layers, generating a first code vector corresponding to the first feature vector and a second code vector corresponding to the second feature vector by compressing the first feature vector and the second feature vector, and generating a bitstream by quantizing the first code vector and the second code vector.

公开(公告)号：US20240087577A1

公开(公告)日：2024-03-14

申请号：US18014924

申请日：2021-07-02

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Seung Kwon BEACK ,  Jongmo SUNG ,  Mi Suk LEE ,  Tae Jin LEE ,  Woo-taek LIM ,  Inseon JANG

IPC: G10L19/005 ,  G10L19/16

CPC classification number: G10L19/005 ,  G10L19/167

Abstract: Disclosed is an apparatus and method for audio encoding/decoding that is robust against coding distortion in a transition section. An audio encoding method includes outputting a frequency domain signal by time-to-frequency (T/F) transform of an input signal, outputting a frequency domain residual signal in which a frequency axis envelope is removed from the frequency domain signal by applying frequency domain noise shaping (FDNS) encoding to the frequency domain signal, outputting a time domain residual signal in which a time axis envelope is removed by performing linear prediction coefficient (LPC) analysis based on the frequency domain residual signal, and quantizing and transmitting the time domain residual signal.

公开(公告)号：US20240013796A1

公开(公告)日：2024-01-11

申请号：US18474997

申请日：2023-09-26

Applicant: Electronics and Telecommunications Research Institute ,  The Trustees of Indiana University

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Inseon JANG ,  Jongmo SUNG ,  Tae Jin LEE ,  Byeongho CHO ,  Minje KIM ,  Haici YANG

IPC: G10L19/038

CPC classification number: G10L19/038

Abstract: A method of encoding a speech signal includes predicting a feature vector of each of a plurality of frames included in the speech signal based on a ground-truth feature vector of a previous frame of each of the plurality of frames, calculating a residual signal corresponding to each of the plurality of frames based on a ground-truth feature vector of each of the plurality of frames and a predicted feature vector of each of the plurality of frames, and generating a bitstring corresponding to each of the plurality of frames by quantizing the residual signal.

公开(公告)号：US20230335145A1

公开(公告)日：2023-10-19

申请号：US18118604

申请日：2023-03-07

Applicant: Electronics and Telecommunications Research Institute ,  Kyungpook National University Industry-Academic Cooperation Foundation

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Inseon JANG ,  Min Han KIM ,  Seung Hyeon SHIN ,  Dae Ho LEE ,  Seok Jin LEE

IPC: G10L19/06 ,  G10L19/032

CPC classification number: G10L19/06 ,  G10L19/032

Abstract: A signal compression method and apparatus and a signal restoration method and apparatus are provided. The signal compression method includes outputting an input signal, obtained by processing an audio signal, which is input, based on a human auditory perception characteristic, using an auditory perception model, extracting a feature vector from the input signal using a feature extraction module, and outputting a code obtained by compressing the feature vector using a trained signal compression model.

公开(公告)号：US20230317089A1

公开(公告)日：2023-10-05

申请号：US18103993

申请日：2023-01-31

Applicant: Electronics and Telecommunications Research Institute

Inventor： Jongmo SUNG ,  Seung Kwon BEACK ,  Tae Jin LEE ,  Woo-taek LIM ,  Inseon JANG ,  Byeongho CHO

IPC: G10L19/13 ,  G10L19/038 ,  G10L25/30

CPC classification number: G10L19/13 ,  G10L19/038 ,  G10L25/30

Abstract: An encoding method, a decoding method, an encoder for performing the encoding method, and a decoder for performing the decoding method are provided. The encoding method includes outputting LP coefficients bitstream and a residual signal by performing an LP analysis on an input signal, outputting a first latent signal obtained by encoding a periodic component of the residual signal, a second latent signal obtained by encoding a non-periodic component of the residual signal, and a weight vector for each of the first latent signal and the second latent signal, using a first neural network module, and outputting a first bitstream obtained by quantizing the first latent signal, a second bitstream obtained by quantizing the second latent signal, and a weight bitstream obtained by quantizing the weight vector, using a quantization module.

公开(公告)号：US20230298599A1

公开(公告)日：2023-09-21

申请号：US18108431

申请日：2023-06-12

Applicant: Electronics and Telecommunications Research Institute

Inventor： Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Woo-taek LIM ,  Inseon JANG ,  Byeongho CHO

IPC: G10L19/008

CPC classification number: G10L19/008

Abstract: An encoding method and an encoding device using a complex signal and a decoding method and a decoding device using a complex signal are provided. The encoding method includes converting a first channel signal and a second channel signal constituting an audio signal corresponding to a stereo signal from a real domain to a complex domain, determining one of a sum operation, a difference operation, and a bypass operation to be performed on the second channel signal converted to the complex domain, determining a complex spatial cue according to the determined operation, converting a residual signal for the second channel signal to a real domain using the complex spatial cue, converting the first channel signal to a real domain, encoding the first channel signal converted to the real domain, and encoding the residual signal for the second channel signal converted to the real domain.

公开(公告)号：US20230038394A1

公开(公告)日：2023-02-09

申请号：US17390753

申请日：2021-07-30

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE ,  The Trustees of Indiana University

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Inseon JANG ,  Minje KIM

IPC: G10L19/008 ,  G10L19/032 ,  G06N3/04

Abstract: Disclosed are a method of encoding and decoding an audio signal and an encoder and a decoder performing the method. The method of encoding an audio signal includes identifying an input signal, and generating a bitstring of each encoding layer by applying, to the input signal, an encoding model including a plurality of successive encoding layers that encodes the input signal, in which a current encoding layer among the encoding layers is trained to generate a bitstring of the current encoding layer by encoding an encoded signal which is a signal encoded in a previous encoding layer and quantizing an encoded signal which is a signal encoded in the current encoding layer.

公开(公告)号：US20220375483A1

公开(公告)日：2022-11-24

申请号：US17520895

申请日：2021-11-08

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Inseon JANG ,  Jong-won SEOK ,  YUNSU KIM

IPC: G10L19/038 ,  G10L19/16 ,  G10L25/30

Abstract: Disclosed are methods of encoding and decoding an audio signal, and an encoder and a decoder for performing the methods. The method of encoding an audio signal includes identifying an input signal corresponding to a low frequency band of the audio signal, windowing the input signal, generating a first latent vector by inputting the windowed input signal to a first encoding model, transforming the windowed input signal into a frequency domain, generating a second latent vector by inputting the transformed input signal to a second encoding model, generating a final latent vector by combining the first latent vector and the second latent vector, and generating a bitstream corresponding to the final latent vector.

公开(公告)号：US20210366497A1

公开(公告)日：2021-11-25

申请号：US17326035

申请日：2021-05-20

Applicant: Electronics and Telecommunications Research Institute ,  The Trustees of Indiana University

Inventor： Woo-taek LIM ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Mi Suk LEE ,  Tae Jin LEE ,  Inseon JANG ,  Minje KIM ,  Haici YANG

IPC: G10L19/032

Abstract: Methods of encoding and decoding a speech signal using a neural network model that recognizes sound sources, and encoding and decoding apparatuses for performing the methods are provided. A method of encoding a speech signal includes identifying an input signal for a plurality of sound sources; generating a latent signal by encoding the input signal; obtaining a plurality of sound source signals by separating the latent signal for each of the plurality of sound sources; determining a number of bits used for quantization of each of the plurality of sound source signals according to a type of each of the plurality of sound sources; quantizing each of the plurality of sound source signals based on the determined number of bits; and generating a bitstream by combining the plurality of quantized sound source signals.