公开(公告)号：US20220295088A1

公开(公告)日：2022-09-15

申请号：US17200628

申请日：2021-03-12

Applicant: Lemon Inc.

Inventor： Na ZHANG ,  Kai ZHANG ,  Hongbin LIU ,  Li ZHANG ,  Yue WANG

IPC: H04N19/513 ,  H04N19/137 ,  H04N19/105 ,  H04N19/159 ,  H04N19/176

Abstract: Embodiments of the present disclosure provide methods, apparatuses and computer storage media for video processing. One example method comprises determining, during a conversion between a current video block of a video and a bitstream of the video, a set of motion candidates for the current video block; determining, for each motion candidate in the set of motion candidates, a refined motion candidate by performing a local search around the each motion candidate based on a template matching cost rule; determining, from a set of refined motion candidates generated for the set of motion candidates, a target motion candidate for the current video block; and performing the conversion based on the target motion candidate.

公开(公告)号：US20220286666A1

公开(公告)日：2022-09-08

申请号：US17187674

申请日：2021-02-26

Applicant: Lemon Inc.

Inventor： Weijia ZHU ,  Jizheng XU ,  Li ZHANG ,  Yue WANG

IPC: H04N19/105 ,  H04N19/176 ,  H04N19/513

Abstract: Example implementations include a method, apparatus and computer-readable medium of video coding, comprising performing a conversion between a video comprising a plurality of pictures and a bitstream of the video, wherein each picture comprises an alpha layer and a base layer, and wherein the bitstream comprises a current block in the alpha layer of a current picture that is predicted from one or more reference blocks in the base layer.

公开(公告)号：US20220284590A1

公开(公告)日：2022-09-08

申请号：US17192599

申请日：2021-03-04

Applicant: Lemon Inc.

Inventor： Linjie Yang ,  Ziyu Jiang ,  Ding Liu ,  Longyin Wen

IPC: G06T7/174 ,  G06K9/62 ,  G06K9/00

Abstract: Systems and method directed to performing video object segmentation are provided. In examples, video data representing a sequence of image frames and video data representing an object mask may be received at a video object segmentation server. Image features may be generated based on a first image frame of the sequence of image frames, image features may be generated based on a second image frame of the sequence of image frames; and object features may be generated based on the object mask. A transform matrix may be computed based on the image features of the first image frame and image features of the second image frame; the transform matrix may be applied to the object features resulting in transformed object features. A predicted object mask associated with the second image frame may be obtained by decoding the transformed object features.

公开(公告)号：US20220279185A1

公开(公告)日：2022-09-01

申请号：US17187670

申请日：2021-02-26

Applicant: Lemon Inc.

Inventor： Weijia ZHU ,  Jizheng XU ,  Li ZHANG ,  Yue WANG

IPC: H04N19/13 ,  H04N19/176 ,  H04N19/169 ,  H04N19/132 ,  H04N19/105 ,  H04N19/82 ,  H04N19/117 ,  H04N19/186

Abstract: Example implementations include a method, apparatus and computer-readable medium of video coding, comprising determining, for a conversion between a video comprising a plurality of pictures and a bitstream of the video, first layer information which is utilized in a first process performed on a first layer of each picture. The implementations further include determining, second layer information which is utilized in a second process performed on a second layer of each picture. Additionally, the implementations further include performing the conversion for the second layer based on the first layer information and the second layer information.

公开(公告)号：US20220191483A1

公开(公告)日：2022-06-16

申请号：US17544638

申请日：2021-12-07

Applicant: Lemon Inc.

Inventor： Yue Li ,  Li Zhang ,  Kai Zhang

IPC: H04N19/117 ,  H04N19/436 ,  H04N19/82 ,  H04N19/186 ,  H04N19/169 ,  H04N19/70 ,  H04N19/124 ,  H04N19/176 ,  H04N19/132 ,  G06N3/08

Abstract: A method implemented by a video coding apparatus. The method includes selecting a neural network (NN) filter model from a plurality of NN filter model candidates for each video unit. The NN filter model selected for a first video unit is different than the NN filter model selected for a second video unit. The method also includes converting between a video media file and a bitstream based on the one or more NN filter models selected for the video unit. A corresponding video coding apparatus and non-transitory computer readable medium are also disclosed.

公开(公告)号：US20220132103A1

公开(公告)日：2022-04-28

申请号：US17512162

申请日：2021-10-27

Applicant: Lemon Inc.

Inventor： Yue Li ,  Li Zhang ,  Jizheng Xu

IPC: H04N19/105 ,  H04N19/119 ,  H04N19/96 ,  G06T9/00 ,  G06T9/40 ,  G06K9/00 ,  H04N19/176 ,  H04N19/159

Abstract: A method implemented by a coding apparatus. The method includes obtaining probabilities of split types being implemented when partitioning a picture, and skipping one or more of the split types based on the probabilities obtained when a coding block is partitioned during a conversion between a video media file and a bitstream. A corresponding apparatus and non-transitory computer readable medium are also provided.

公开(公告)号：US20220103781A1

公开(公告)日：2022-03-31

申请号：US17484919

申请日：2021-09-24

Applicant: Lemon Inc.

Inventor： Ye-Kui WANG

IPC: H04N7/01 ,  H04N19/172 ,  H04N19/70

Abstract: Systems, methods and apparatus for encoding, decoding or transcoding visual media data are described. One example method of processing visual media data includes performing a conversion between visual media data and a bitstream of the visual media data according to a format rule, wherein the format rule specifies that a supplemental enhancement information (SEI) message that refers to a dependent random access point (DRAP) picture is included in the bitstream, and wherein the format rule further specifies that the SEI message includes a syntax element indicating a number of intra random access point (IRAP) pictures or dependent random access point (DRAP) pictures that are within a same coded layer video sequence (CLVS) as the DRAP picture.

公开(公告)号：US20220101095A1

公开(公告)日：2022-03-31

申请号：US17487852

申请日：2021-09-28

Applicant: Lemon Inc.

Inventor： Yue LI ,  Li ZHANG ,  Kai ZHANG

IPC: G06N3/04 ,  H04N19/117 ,  H04N19/184 ,  H04N19/157

Abstract: Methods, systems, apparatus for media processing are described. One example method of digital media processing includes performing a conversion between visual media data and a bitstream of the visual media data, wherein the performing of the conversion includes selectively applying a convolutional neural network filter during the conversion based on a rule, and wherein the rule specifies whether and/or how the convolutional neural network filter is applied.

公开(公告)号：US20220086496A1

公开(公告)日：2022-03-17

申请号：US17473554

申请日：2021-09-13

Applicant: Lemon Inc.

Inventor： Ye-Kui WANG

IPC: H04N19/70 ,  H04N19/169 ,  H04N19/30

Abstract: Systems, methods and apparatus for generating or parsing a visual media file according to a file format include performing a conversion between a visual media data and a visual media file that stores a bitstream of the visual media data according to a format rule. The visual media file stores multiple tracks that belong to an entity group of a specific type. The format rule specifies that, responsive to the multiple tracks having a track reference to a particular type to a group identifier, the multiple tracks (A) omit carrying a sample group of a specific type or (B) carry the sample group of the specific type such that information in the sample group of the specific type is consistent with that in the entity group of the specific type.

公开(公告)号：US20220070496A1

公开(公告)日：2022-03-03

申请号：US17464311

申请日：2021-09-01

Applicant: Lemon Inc.

Inventor： Ye-Kui WANG ,  Li ZHANG

IPC: H04N19/70 ,  H04N19/172 ,  H04N19/593 ,  H04N19/30 ,  H04N19/169

Abstract: Systems, methods and apparatus for processing image data are described. One example method includes performing a conversion between a visual media file and a bitstream. The visual media file comprises image items each comprising a sequence of one or more pictures according to a media file format, and the bitstream comprises access units each comprising one or more pictures each belonging to a layer according to a video coding format. The video coding format defines multiple profiles. The media file format specifies that the bitstream is represented in a file having a specific brand, and that one or more profiles used for representing the video in the bitstream are agnostic of the specific brand.