公开(公告)号：US20240430430A1

公开(公告)日：2024-12-26

申请号：US18823515

申请日：2024-09-03

Applicant: Beijing Bytedance Network Technology Co., Ltd. ,  Bytedance Inc.

Inventor： Semih ESENLIK ,  Zhaobin ZHANG ,  Yaojun WU ,  Kai ZHANG ,  Yue LI ,  Li ZHANG

IPC: H04N19/132 ,  H04N19/124

Abstract: Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: obtaining, for a conversion between visual data and a bitstream of the visual data, statistical information associated with a first representation of the visual data, the first representation being generated based on applying a first neural network to the visual data; determining at least one sample from a second representation of the visual data based on the statistical information, a value of the at least one sample being absent from the bitstream, the second representation being obtained by quantizing the first representation; and performing the conversion based on the determining.

公开(公告)号：US20240380904A1

公开(公告)日：2024-11-14

申请号：US18778813

申请日：2024-07-19

Applicant: Beijing Bytedance Network Technology Co., Ltd. ,  Bytedance Inc.

Inventor： Semih ESENLIK ,  Yaojun WU ,  Zhaobin ZHANG ,  Yue LI ,  Kai ZHANG ,  Li ZHANG

IPC: H04N19/189 ,  H04N19/119 ,  H04N19/124 ,  H04N19/132 ,  H04N19/436

Abstract: Embodiments of the present disclosure provide a solution for data processing. A method for data processing is proposed. The method comprises: processing, during a conversion between data and a bitstream of the data, a first set of samples of a reconstructed latent representation of the data and a second set of samples of the reconstructed latent representation by using a model, the first set of samples being associated with a first sample of the reconstructed latent representation and the second set of samples being associated with a second sample of the reconstructed latent representation; and performing the conversion based on a result of the processing.

公开(公告)号：US20240430428A1

公开(公告)日：2024-12-26

申请号：US18823527

申请日：2024-09-03

Applicant: Beijing Bytedance Network Technology Co., Ltd. ,  Bytedance Inc.

Inventor： Semih ESENLIK ,  Zhaobin ZHANG ,  Yaojun WU ,  Kai ZHANG ,  Yue LI ,  Li ZHANG

IPC: H04N19/124 ,  H04N19/119 ,  H04N19/132 ,  H04N19/42 ,  H04N19/463 ,  H04N19/60 ,  H04N19/91

Abstract: Embodiments of the present disclosure provide a solution for visual data processing. A method for visual data processing is proposed. The method comprises: obtaining, for a conversion between visual data and a bitstream of the visual data, a first representation of the visual data, the first representation being obtained by quantizing a second representation of the visual data, the second representation being generated based on applying a first neural network to the visual data; adjusting a plurality of sets of first samples of the first representation with different parameters; and performing the conversion based on the plurality of sets of adjusted first samples.

公开(公告)号：US20240414381A1

公开(公告)日：2024-12-12

申请号：US18807764

申请日：2024-08-16

Applicant: Beijing Bytedance Network Technology Co., Ltd. ,  Bytedance Inc.

Inventor： Yaojun WU ,  Yue Li ,  Zhaobin Zhang ,  Semih Esenlik ,  Kai Zhang ,  Li Zhang

IPC: H04N19/91 ,  H04N7/01 ,  H04N19/60

Abstract: Embodiments of the present disclosure provide a solution for data processing. A method for data processing is proposed. The method comprises: determining, by using a first model with an attention mechanism during a conversion between data and a bitstream of the data, a probability distribution for entropy coding associated with the bitstream; and performing the conversion based on the probability distribution.

公开(公告)号：US20240373048A1

公开(公告)日：2024-11-07

申请号：US18778818

申请日：2024-07-19

Applicant: Beijing Bytedance Network Technology Co., Ltd. ,  Bytedance Inc.

Inventor： Semih ESENLIK ,  Yaojun WU ,  Zhaobin ZHANG ,  Yue LI ,  Kai ZHANG ,  Li ZHANG

IPC: H04N19/42 ,  H04N19/124 ,  H04N19/132 ,  H04N19/136 ,  H04N19/184 ,  H04N19/192

Abstract: Embodiments of the present disclosure provide a solution for data processing. A method for data processing is proposed. The method comprises: determining, during a conversion between data and a bitstream of the data, a first part of a first sample of a reconstructed latent representation of the data, the first part indicating a prediction of the first sample; determining a second part of the first sample, the second part indicating a difference between the first sample and the first part; and performing the conversion based on the second part.