公开(公告)号：US20210233547A1

公开(公告)日：2021-07-29

申请号：US17156006

申请日：2021-01-22

Applicant: Electronics and Telecommunications Research Institute ,  The Trustees of Indiana University

Inventor： Mi Suk LEE ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Jin Soo CHOI ,  Minje KIM ,  Kai ZHEN

IPC: G10L19/038 ,  G10L25/18 ,  G10L25/30 ,  G10L25/21 ,  G10L19/028 ,  G06N3/08

Abstract: A method and apparatus for processing an audio signal are disclosed. According to an example embodiment, a method of processing an audio signal may include acquiring a final audio signal for an initial audio signal using a plurality of neural network models generating output audio signals by encoding and decoding input audio signals, calculating a difference between the initial audio signal and the final audio signal in a time domain, converting the initial audio signal and the final audio signal into Mel-spectra, calculating a difference between the Mel-spectra of the initial audio signal and the final audio signal in a frequency domain, training the plurality of neural network models based on results calculated in the time domain and the frequency domain, and generating a new final audio signal distinguished from the final audio signal from the initial audio signal using the trained neural network models.

公开(公告)号：US20210142812A1

公开(公告)日：2021-05-13

申请号：US17098090

申请日：2020-11-13

Applicant: Electronics and Telecommunications Research Institute ,  The Trustees of Indiana University

Inventor： Minje KIM ,  Kai ZHEN ,  Mi Suk LEE ,  Seung Kwon BEACK ,  Jongmo SUNG ,  Tae Jin LEE ,  Jin Soo CHOI

IPC: G10L19/08 ,  G10L19/032 ,  G10L19/26 ,  G10L21/0208 ,  G10L25/30 ,  G10L13/02 ,  G06N3/08

Abstract: Disclosed are a method for coding a residual signal of LPC coefficients based on collaborative quantization and a computing device for performing the method. The residual signal coding method includes: generating encoded LPC coefficients and LPC residual signals by performing LPC analysis and quantization on an input speech; Determining a predicted LPC residual signal by applying the LPC residual signal to cross module residual learning; Performing LPC synthesis using the coded LPC coefficients and the predicted LPC residual signal; It may include the step of determining an output speech that is a synthesized output according to a result of performing the LPC synthesis.

公开(公告)号：US20210005209A1

公开(公告)日：2021-01-07

申请号：US16814103

申请日：2020-03-10

Applicant: Electronics and Telecommunications Research Institute ,  Kwangwoon University Industry-Academic Collaboration Foundation

Inventor： Seung Kwon BEACK ,  Jongmo SUNG ,  Mi Suk LEE ,  Tae Jin LEE ,  Hochong PARK

IPC: G10L19/02 ,  G10L19/032 ,  G10L21/038 ,  G06N3/04

Abstract: Disclosed are a method of encoding a high band of an audio, a method of decoding a high band of an audio, and an encoder and a decoder for performing the methods. The method of decoding a high band of an audio, the method performed by a decoder, includes identifying a parameter extracted through a first neural network, identifying side information extracted through a second neural network, and restoring a high band of an audio by applying the parameter and the side information to a third neural network.

公开(公告)号：US20190035412A1

公开(公告)日：2019-01-31

申请号：US16081169

申请日：2017-03-21

Applicant: Electronics And Telecommunications Research Institute

Inventor： Seung Kwon BEACK ,  Tae Jin LEE ,  Jongmo SUNG ,  Mi Suk LEE ,  Dae Young JANG ,  Jin Soo CHOI

IPC: G10L19/022 ,  G10L19/02 ,  G10L19/032 ,  G10L19/04

Abstract: Provided is an apparatus and method for encoding/decoding audio based on a block. A method of encoding an audio signal may include dividing each of frame of input signal that constitute an audio signal into a plurality of subframes; transforming the subframes to a frequency domain; determining a two-dimensional (2D) intra block using the subframes transformed to the frequency domain; and encoding the 2D intra block. The 2D intra block may be a block that two-dimensionally displays frequency coefficients of the subframes transformed to the frequency domain using a time and a frequency.

公开(公告)号：US20140324417A1

公开(公告)日：2014-10-30

申请号：US14325475

申请日：2014-07-08

Applicant: ELECTRONICS AND TELECOMMUNICATIONS RESEARCH INSTITUTE

Inventor： Mi-Suk LEE ,  Heesik YANG ,  Hyun-Woo KIM ,  Jongmo SUNG ,  Hyun-Joo BAE ,  Byung-Sun LEE

IPC: G10L19/02

CPC classification number: G10L19/02 ,  G10L19/0212 ,  G10L19/24

Abstract: Provided are a method and an apparatus for encoding and decoding an audio signal. A method for encoding an audio signal includes receiving a transformed audio signal, dividing the transformed audio signal into a plurality of subbands, performing a first sinusoidal pulse coding operation on the subbands, determining a performance region of a second sinusoidal pulse coding operation among the subbands on the basis of coding information of the first sinusoidal pulse coding operation, and performing the second sinusoidal pulse coding operation on the determined performance region, wherein the first sinusoidal pulse coding operation is performed variably according to the coding information. Accordingly, it is possible to further improve the quality of a synthesized signal by considering the sinusoidal pulse coding of a lower layer when encoding or decoding an audio signal in an upper layer by a layered sinusoidal pulse coding scheme.

Abstract translation: 提供了一种用于对音频信号进行编码和解码的方法和装置。 一种对音频信号进行编码的方法包括接收经变换的音频信号，将变换的音频信号分成多个子带，对子带执行第一正弦脉冲编码操作，确定子带中的第二正弦脉冲编码操作的性能区域 基于第一正弦脉冲编码操作的编码信息，并对所确定的执行区域执行第二正弦脉冲编码操作，其中根据编码信息可变地执行第一正弦脉冲编码操作。 因此，通过考虑在通过分层正弦脉冲编码方案对上层中的音频信号进行编码或解码时下层的正弦脉冲编码，可以进一步提高合成信号的质量。