Methods and apparatuses for performing artificial intelligence encoding and artificial intelligence decoding on image

    公开(公告)号:US11170534B2

    公开(公告)日:2021-11-09

    申请号:US17082848

    申请日:2020-10-28

    IPC分类号: G06T9/00 G06T3/40 H04N19/85

    摘要: Provided is an artificial intelligence (AI) decoding apparatus includes: a memory storing one or more instructions; and a processor configured to execute the one or more instructions stored in the memory, the processor is configured to: obtain AI data related to AI down-scaling an original image to a first image; obtain image data corresponding to an encoding result on the first image; obtain a second image corresponding to the first image by performing a decoding on the image data; obtain deep neural network (DNN) setting information among a plurality of DNN setting information from the AI data; and obtain, by an up-scaling DNN, a third image by performing the AI up-scaling on the second image, the up-scaling DNN being configured with the obtained DNN setting information, wherein the plurality of DNN setting information comprises a parameter used in the up-scaling DNN, the parameter being obtained through joint training of the up-scaling DNN and a down-scaling DNN, and wherein the down-scaling DNN is used to obtain the first image from the original image.

    Method and device for evaluating subjective quality of video

    公开(公告)号:US11616988B2

    公开(公告)日:2023-03-28

    申请号:US17286743

    申请日:2019-09-26

    摘要: Proposed are a method and apparatus for evaluating the quality of an image, the method including obtaining blocks each having a predetermined size by splitting a target image for evaluating a quality and a reference image that is to be compared with the target image, determining sensitivity information and quality assessment information of each of the blocks by inputting the blocks to a video quality assessment network, and determining a final image quality assessment score of the target image by combining the pieces of quality assessment information of the blocks with each other, based on the pieces of sensitivity information of the blocks.

    DEVICE AND METHOD FOR ENCODING MOTION VECTOR, AND DEVICE AND METHOD FOR DECODING MOTION VECTOR

    公开(公告)号:US20220174288A1

    公开(公告)日:2022-06-02

    申请号:US17675410

    申请日:2022-02-18

    摘要: A method, performed by an image decoding apparatus, of decoding a motion vector, including obtaining information indicating a motion vector resolution of a current block from a bitstream; selecting a first neighboring block from among neighboring blocks adjacent to the current block, by using the obtained information indicating the motion vector resolution of the current block; based on the current block referring to a reference picture in a list 0, and the first neighboring block referring to the reference picture in the list 0, determining a prediction motion vector of the current block using a motion vector of the first neighboring block; based on the current block referring to the reference picture in the list 0 and the first neighboring block referring to a reference picture in a list 1, selecting a motion vector of a second neighboring block among the neighboring blocks as a basic motion vector, and determining the prediction motion vector of the current block using the determined basic motion vector; and determining a motion vector of the current block using the prediction motion vector of the current block.

    Method and apparatus for streaming data

    公开(公告)号:US11170473B2

    公开(公告)日:2021-11-09

    申请号:US17080543

    申请日:2020-10-26

    IPC分类号: G06T3/40 H04L29/06 H04N19/85

    摘要: A terminal for receiving streaming data may receive information of a plurality of different quality versions of an image content; request, based on the information, a server for a version of the image content from among the plurality of different quality versions of the image content; when the requested version of the image content and artificial intelligence (AI) data corresponding to the requested version of the image content are received, determines whether to perform AI upscaling on the received version of the image content, based on the AI data; and based on a result of the determining whether to perform AI upscaling, performs AI upscaling on the received version of the image content through a upscaling deep neural network (DNN) that is trained jointly with a downscaling DNN of the server.