公开(公告)号：US20220337878A1

公开(公告)日：2022-10-20

申请号：US17719201

申请日：2022-04-12

Applicant: Lemon Inc.

Inventor： Ye-kui Wang

IPC: H04N19/70 ,  H04N19/46 ,  H04N19/169 ,  H04N19/172

Abstract: A mechanism for processing video data is disclosed. Information in a Decoding Capability Information (DCI) network abstraction layer (NAL) unit is determined. A rule specifies a value of a DCI number of profile, tier, and level (PTL) minus one (dci_num_ptls_minus1) in a Versatile Video Coding (VVC) Common Media Application Format (CMAF) track shall be zero.

公开(公告)号：US20220295090A1

公开(公告)日：2022-09-15

申请号：US17200632

申请日：2021-03-12

Applicant: Lemon Inc.

Inventor： Na ZHANG ,  Kai ZHANG ,  Hongbin LIU ,  Li ZHANG ,  Yue WANG

IPC: H04N19/513 ,  H04N19/137 ,  H04N19/105 ,  H04N19/132 ,  H04N19/186 ,  H04N19/176

Abstract: Embodiments of the present disclosure provide methods, apparatuses and computer storage media for video processing. One example method comprises determining, during a conversion between a current video block of a video and a bitstream of the video, a motion candidate for the current video block; refining the motion candidate by performing a local search around the motion candidate based on a template matching cost rule; and performing the conversion based on the refined motion candidate, wherein a search order of the local search is related to a coding mode of the current video block.

公开(公告)号：US20220286695A1

公开(公告)日：2022-09-08

申请号：US17681427

申请日：2022-02-25

Applicant: Lemon Inc.

Inventor： Yue Li ,  Li Zhang ,  Kai Zhang

IPC: H04N19/42 ,  H04N19/82 ,  H04N19/186 ,  H04N19/124 ,  H04N19/176 ,  H04N19/30 ,  H04N19/70

Abstract: A method implemented by a video coding apparatus. The method includes applying an output of a neural network (NN) filter to an unfiltered sample of a video unit to generate a residual, applying a scaling function to the residual to generate a scaled residual, adding another unfiltered sample to the scaled residual to generate a filtered sample, and converting between a video media file and a bitstream based on the filtered sample that was generated. A corresponding video coding apparatus and non-transitory computer readable medium are also disclosed.

公开(公告)号：US20220284552A1

公开(公告)日：2022-09-08

申请号：US17192549

申请日：2021-03-04

Applicant: Lemon Inc.

Inventor： Linjie Yang ,  Ding Liu ,  Xueyan Zou

IPC: G06T5/00 ,  G06N3/08 ,  G06T3/00

Abstract: Systems and methods are directed to inpainting video. More specifically, initial video data including a sequence of image frames containing missing or corrupted pixel information may be received. Optical flow displacement values and optical flow validity masks may be generated for neighboring image frames of initial video data. Image features from image feature maps of one or more neighboring image frames may be warp-shifted to image feature maps of a current image frame using the optical flow displacement values and warp-shifted image features from the feature maps of the one or more neighboring image frames may be selected based on one or more of the optical flow validity masks. A sequence of complete image frames may be generated based on the selected warp-shifted image features from the feature maps of the one or more neighboring image frames and image features from the image feature maps of the current image frame.

公开(公告)号：US20220253184A1

公开(公告)日：2022-08-11

申请号：US17169923

申请日：2021-02-08

Applicant: LEMON INC.

Inventor： Fernando WANG ,  Michael Buzinover ,  Jialiang Zhang ,  Ning Li

IPC: G06F3/0484 ,  G06F3/0482 ,  G06F3/16 ,  G11B27/031 ,  G06F16/638

Abstract: A plurality of music samples and a plurality of images corresponding to the music samples may be stored in a database. The plurality of music samples may be sorted in an order of priority. Information associated with the plurality music samples may be sent to a user device. The user device may display the plurality of images corresponding to the plurality of music samples in the order of priority. The user device may receive information indicative of at least one video associated with a music sample in response to receiving user input indicative of a selection of an image among the plurality of images. The user device may display at least one sample video image corresponding to the at least one video associated with the music sample.

公开(公告)号：US20220237741A1

公开(公告)日：2022-07-28

申请号：US17157694

申请日：2021-01-25

Applicant: Lemon Inc.

Inventor： Wenbin YIN ,  Haibin YIN ,  Li ZHANG ,  Huade SHI

IPC: G06T3/40 ,  G06T9/00 ,  G06T5/00 ,  G06T5/50 ,  H04N19/33 ,  H04N19/117 ,  H04N19/46 ,  H04N19/176

Abstract: Implementations of the present disclosure provide a solution for image/video processing. In this solution, an intermediate image can be obtained from an LR image. Then, a smooth value associated with an image block in the intermediate image could be determined based on a gradient of a target pixel in the image block. Further, an HR image can be generated from the intermediate image based on the smooth value. In this way, the filtering process can be performed based on a smooth value of an image block, thereby improving the efficiency of image/video processing and lowering down the computational and memory costs.

公开(公告)号：US20220224913A1

公开(公告)日：2022-07-14

申请号：US17148533

申请日：2021-01-13

Applicant: Lemon Inc.

Inventor： Yang WANG ,  Kai ZHANG ,  Li ZHANG ,  Yuwen HE ,  Hongbin LIU

IPC: H04N19/146 ,  H04N19/11 ,  H04N19/159 ,  H04N19/132 ,  H04N19/176

Abstract: Aspects of the present disclosure provide techniques for derive one or more intra prediction modes (IPMs) from a subset of IPM candidates in order to determine a predictor to use for decoding a block of an image. In some aspects, the subset of IPM candidates may include IPMs that are less than the number of IPMs in a full set of all available IPM candidates (e.g., 67 IPMs in VVC or 35 in HEVC). In some aspects, the subset of IPM candidates may be based on a most probable mode (MPM) list that can be used to determine or signal an IPM based on IPMs previously used in decoding other blocks.

公开(公告)号：US11388421B1

公开(公告)日：2022-07-12

申请号：US17148383

申请日：2021-01-13

Applicant: Lemon Inc.

Inventor： Yang Wang ,  Kai Zhang ,  Li Zhang ,  Yuwen He ,  Hongbin Liu

IPC: H04N19/159 ,  H04N19/70 ,  H04N19/176 ,  H04N19/147

Abstract: Example implementations include a method, apparatus and computer-readable medium of video processing, including constructing, during a conversion between a current video block of a video and a bitstream of the video, at least one template set for the current video block from a plurality of sub-templates. The one or more sub-templates may be selected from a plurality of sub-templates including: a left sub-template, an above sub-template, a right-above sub-template, a left-below sub-template, and a left-above sub-template. The implementations further include deriving at least one intra-prediction mode (IPM) based on cost calculations. The implementations include determining, based on the at least one IPM, a final predictor of the current video block. The implementations include performing the conversion based on the final predictor.

公开(公告)号：US20220109848A1

公开(公告)日：2022-04-07

申请号：US17475826

申请日：2021-09-15

Applicant: Lemon Inc.

Inventor： Ye-Kui WANG

IPC: H04N19/132 ,  H04N19/117 ,  H04N19/30 ,  H04N19/169

Abstract: Systems, methods and apparatus for encoding or decoding a file format that stores one or more images are described. One example method includes performing a conversion between a visual media file and a bitstream of a visual media data according to a format rule, where the format rule specifies that first adaptation parameter set network abstraction layer units are disallowed from being simultaneously stored in in the visual media file in (1) any one or both of samples of video coding layer tracks or sample entries of the video coding layer tracks, and (2) samples of non-video coding layer tracks, where the video coding layer tracks are tracks containing video coding layer network abstraction layer units, and where the first adaptation parameter set network abstraction layer units includes luma mapping with chroma scaling parameters for a video stream and scaling list parameters for the video stream.

公开(公告)号：US20220103865A1

公开(公告)日：2022-03-31

申请号：US17476809

申请日：2021-09-16

Applicant: Lemon Inc.

Inventor： Ye-Kui WANG

IPC: H04N19/70 ,  H04N19/132 ,  H04N19/105 ,  H04N19/186 ,  H04N19/169

Abstract: Systems, methods and apparatus for processing visual media data are described. One example method includes performing a conversion between visual media data and a visual media file including one or more tracks storing one or more bitstreams of the visual media data according to a format rule; wherein the format rule specifies whether a first element indicative of whether a track contains a bitstream corresponding to a specific output layer set controls whether a second element indicative of a chroma format of the track and/or a third element indictive of a bit depth information of the track is included in a configuration record of the track.