公开(公告)号：US10666922B2

公开(公告)日：2020-05-26

申请号：US16454540

申请日：2019-06-27

Applicant: LG ELECTRONICS INC.

Inventor： Soojin Hwang ,  Sejin Oh ,  Tung Chin Lee

IPC: H04N7/18 ,  H04N13/183 ,  H04N21/845 ,  H04N21/488 ,  H04N19/70 ,  H04N13/156 ,  H04N13/161 ,  H04N13/194 ,  H04N13/178 ,  H04N13/128 ,  H04N19/88 ,  H04N21/81

Abstract: The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.

公开(公告)号：US20200336728A1

公开(公告)日：2020-10-22

申请号：US16921722

申请日：2020-07-06

Applicant: LG ELECTRONICS INC.

Inventor： Soojin Hwang ,  Sejin Oh ,  Tung Chin Lee

IPC: H04N13/183 ,  H04N21/845 ,  H04N21/488 ,  H04N19/70 ,  H04N13/156 ,  H04N13/161 ,  H04N13/194 ,  H04N13/178 ,  H04N13/128 ,  H04N19/88 ,  H04N21/81

Abstract: The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.

公开(公告)号：US10555103B2

公开(公告)日：2020-02-04

申请号：US15860934

申请日：2018-01-03

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Sejin Oh

IPC: H04S7/00 ,  G06F3/01 ,  H04N21/439

Abstract: A method for outputting an audio signal corresponding to scene orientation information is disclosed. The method includes receiving an audio signal interacting with a video, generating a decoded audio signal, object metadata, and scene orientation information through decoding, receiving external control information, and generating modified object metadata suitable for a playback environment by modifying the object metadata based on the received external control information, rendering the decoded audio signal using the modified object metadata, and modifying the rendered audio signal according to the scene orientation information.

公开(公告)号：US11109013B2

公开(公告)日：2021-08-31

申请号：US16921722

申请日：2020-07-06

Applicant: LG ELECTRONICS INC.

Inventor： Soojin Hwang ,  Sejin Oh ,  Tung Chin Lee

IPC: H04N7/18 ,  H04N13/183 ,  H04N21/845 ,  H04N21/488 ,  H04N19/70 ,  H04N13/156 ,  H04N13/161 ,  H04N13/194 ,  H04N13/178 ,  H04N13/128 ,  H04N19/88 ,  H04N21/81

Abstract: The present invention suggests a method of providing subtitles for a 360 content, the method comprising: generating 360 video data captured by at least one camera; stitching the 360 video data; projecting the 360 video data to a 2D image; encoding the 2D image into a video stream; generating a 360 subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360 content; inserting the 360 subtitle SEI message into the video stream; and generating a broadcast signal including the video stream, and transmitting the broadcast signal.

公开(公告)号：US10986457B2

公开(公告)日：2021-04-20

申请号：US16628973

申请日：2017-11-14

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Sejin Oh

IPC: H04S7/00 ,  G10L19/008 ,  H04N21/434 ,  H04N21/439 ,  H04S1/00

Abstract: Disclosed are method and device for outputting audio linked with a video screen zoom. The method of the present invention comprises the steps of: receiving an audio signal linked with a video and generating a decoded audio signal and object metadata; linking with an execution of a video screen zoom so as to change respective object gain values for objects which are present in a zoom area; and rendering the decoded audio signal by using the changed object gain values. In addition, the method for outputting audio, of the present invention, further comprises a step for changing a channel signal-specific gain value which is linked with the video screen zoom. An audio can be linked, through the method and device for outputting audio, according to an embodiment of the present invention, in accordance with the video screen zoom such that the audio which is more realistic can be provided.

公开(公告)号：US10375375B2

公开(公告)日：2019-08-06

申请号：US15680901

申请日：2017-08-18

Applicant: LG ELECTRONICS INC.

Inventor： Soojin Hwang ,  Sejin Oh ,  Tung Chin Lee

IPC: H04N19/70 ,  H04N13/183 ,  H04N21/845 ,  H04N21/488 ,  H04N13/156 ,  H04N13/161 ,  H04N13/194 ,  H04N13/178 ,  H04N13/128

Abstract: A method and apparatus of/for providing subtitles for a 360-degree content, the method including generating 360-degree video data captured by at least one camera; stitching the 360-degree video data; projecting the 360-degree video data to a 2D image; encoding the 2D image into a video stream; generating a 360-degree subtitle Supplemental Enhancement Information (SEI) message for signaling a subtitle for the 360-degree content; inserting the 360-degree subtitle SEI message into the video stream; and generating a signal including the video stream, and transmitting the signal.

公开(公告)号：US11310616B2

公开(公告)日：2022-04-19

申请号：US16738522

申请日：2020-01-09

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Sejin Oh

IPC: H04S7/00 ,  H04N21/84 ,  H04N21/81 ,  H04N21/442 ,  H04N21/439 ,  G06F3/01 ,  H04N21/485 ,  H04N21/854

Abstract: A method for decoding a bitstream by an apparatus, includes obtaining a decoded audio signal and metadata from the bitstream, the metadata comprising scene orientation information; and rendering the decoded audio signal based on the scene orientation information, wherein the scene orientation information is information for a direction of a video scene related to the decoded audio signal.

公开(公告)号：US11089425B2

公开(公告)日：2021-08-10

申请号：US16626692

申请日：2017-11-14

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Sejin Oh

IPC: H04S7/00 ,  G10L19/008 ,  H04R5/02 ,  H04R5/04 ,  H04S1/00 ,  H04S3/00

Abstract: The present invention pertains to an audio playback method and an audio playback apparatus in a 6DoF environment. The audio playback method of the present invention is characterised by comprising: a decoding step of decoding a received audio signal, and outputting the decoded audio signal and metadata; a modelling step of receiving input of position information of a user, checking whether the position of the user has changed from a previous position, and if the position of the user has changed, modelling binaural rendering data so as to correspond to the changed position of the user; and a rendering step of binaural-rendering the decoded audio signal using the modelled rendering data, and outputting the same as a two-channel audio signal. The audio playback method and apparatus in a 6DoF environment according to an embodiment of the present invention uses position change information of a user, changes the volume and depth of a sound source together according to the position of a user, and can thereby facilitate playback of a stereoscopic and realistic audio signal.

公开(公告)号：US10327090B2

公开(公告)日：2019-06-18

申请号：US15703266

申请日：2017-09-13

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Jongyeul Suh

IPC: G01H7/00 ,  H04S7/00

Abstract: Disclosed are a distance rendering method used for audio signal output and an audio signal output apparatus using the same. The distance rendering method includes receiving a decoded audio signal, checking whether a distance between a user and a sound image is changed, if the distance is changed, calculating a gain parameter gnew and a period parameterτnew, applied to room response modeling, based on the changed distance, so as to maintain a space characteristic, and generating room response modeling for maintaining the space characteristic even when the distance is changed, using the calculated period parameter τnew and gain parameter gnew.

公开(公告)号：US11200906B2

公开(公告)日：2021-12-14

申请号：US16644416

申请日：2017-11-14

Applicant: LG ELECTRONICS INC.

Inventor： Tung Chin Lee ,  Sejin Oh

IPC: G10L19/008 ,  G10L19/16 ,  H04S3/00 ,  H04S7/00 ,  G10L25/03

Abstract: Disclosed are an audio encoding method, to which BRIR/RIR parameterization is applied, and a method and device for reproducing audio by using parameterized BRIR/RIR information. The audio encoding method according to the present invention comprises the steps of: when an input audio signal is a binaural room impulse response (BRIR), dividing the input audio signal into a room impulse response (RIR) and a head-related impulse response (HRIR); applying a mixing time to the divided RIR or an RIR, which is input without division when the audio signal is the RIR, and dividing the mixing time-applied RIR into a direct/early reflection part and a late reverberation part; parameterizing a direct part characteristic on the basis of the divided direct/early reflection part; parameterizing an early reflection part characteristic on the basis of the divided direct/early reflection part; parameterizing a late reverberation part characteristic on the basis of the divided late reverberation part; and when the input audio signal is the BRIR, adding the divided HRIR and information of the parameterized RIR characteristic to an audio bitstream, and transmitting the same.