Method and apparatus for generating video intermediate frame

    公开(公告)号:US12185023B2

    公开(公告)日:2024-12-31

    申请号:US18206459

    申请日:2023-06-06

    Abstract: A method for generating a video intermediate frame, including obtaining a target video frame pair; constructing an image pyramid for each video frame in the target video frame pair; and generating an intermediate frame of the target video frame pair by using a bidirectional optical flow estimation model and a pixel synthesis model in a layer-by-layer recursive calling manner according to an order of the image pyramid from a high layer to a low layer based on the image pyramid, wherein the generating of the intermediate frame of the target video frame pair comprising: repairing a bidirectional optical flow corresponding to a previous layer using the bidirectional optical flow estimation model, and repairing a previous intermediate frame corresponding to the previous layer using the pixel synthesis model.

    Cross-device voiceprint recognition

    公开(公告)号:US12142271B2

    公开(公告)日:2024-11-12

    申请号:US17417720

    申请日:2019-12-30

    Abstract: According to an embodiment, an electronic device is provided. The electronic device includes: at least one processor; and a memory comprising instructions, which when executed, control the at least one processor to: receive a voice instruction of a user at the electronic device; transmit information regarding the voice instruction to a control device for identifying the user by mapping to a first voiceprint which is registered by another electronic device, a second voiceprint of the voice instruction of the user based on a voiceprint mapping model; and perform an operation corresponding to the voice instruction upon the identification of the user.

    Method and apparatus for determining ambient illumination in AR scene

    公开(公告)号:US11544897B2

    公开(公告)日:2023-01-03

    申请号:US17192041

    申请日:2021-03-04

    Abstract: An apparatus for determining ambient illumination in an AR scene includes: setting virtual light source points in an AR scene, predicting reference illumination parameters of all of the virtual light source points for a current image frame according to a neural network, configuring a reference space confidence and a reference time confidence for the virtual light source points, acquiring a reference comprehensive confidence by fusing the reference space confidence and the reference time confidence, acquiring a fused current comprehensive confidence by comparing the reference comprehensive confidence with a comprehensive confidence of a previous image frame, acquiring illumination parameters of the current frame by correcting the illumination parameters of the current image frame according to the current comprehensive confidence, the previous frame comprehensive confidence and the previous frame illumination parameters, and performing illumination rendering of a virtual object in the AR scene according to the illumination parameters of current frame.

    Image retargeting method and device

    公开(公告)号:US11508035B2

    公开(公告)日:2022-11-22

    申请号:US17333900

    申请日:2021-05-28

    Abstract: A method for controlling an electronic device is provided. The method includes obtaining an intermediate image by preprocessing an original image, obtaining a saliency feature map of the intermediate image by performing semantic saliency analysis on the intermediate image, performing adaptability calculation according to the saliency feature map and a retargeted target equipment condition, and determining a retargeting mode of the original image according to the result of the adaptability calculation, and performing retargeting processing on the original image according to the determined mode.

    METHOD AND APPARATUS FOR DETERMINING AMBIENT ILLUMINATION IN AR SCENE

    公开(公告)号:US20210398344A1

    公开(公告)日:2021-12-23

    申请号:US17192041

    申请日:2021-03-04

    Abstract: An apparatus for determining ambient illumination in an AR scene includes: setting virtual light source points in an AR scene, predicting reference illumination parameters of all of the virtual light source points for a current image frame according to a neural network, configuring a reference space confidence and a reference time confidence for the virtual light source points, acquiring a reference comprehensive confidence by fusing the reference space confidence and the reference time confidence, acquiring a fused current comprehensive confidence by comparing the reference comprehensive confidence with a comprehensive confidence of a previous image frame, acquiring illumination parameters of the current frame by correcting the illumination parameters of the current image frame according to the current comprehensive confidence, the previous frame comprehensive confidence and the previous frame illumination parameters, and performing illumination rendering of a virtual object in the AR scene according to the illumination parameters of current frame.

    Method and device for indicating pixel, and method and device for processing pixel indication

    公开(公告)号:US10904520B2

    公开(公告)日:2021-01-26

    申请号:US15301845

    申请日:2015-04-02

    Inventor: Jie Chen Sunil Lee

    Abstract: Disclosed are a method and a device for indicating a pixel, and a method and a device for processing a pixel indication, in video encoding and decoding. A process of indicating a pixel by an encoder includes the steps of: determining at least one processing sub-interval, determining at least one processing sub-interval to be indicated, and indicating the at least one processing sub-interval to be indicated. A process of processing a pixel indication by a decoder includes the steps of: acquiring processing sub-interval indication information, determining at least one indicated processing sub-interval, and determining all of the at least one processing sub-interval. Under the premise that flexible selection of at least one processing sub-interval is guaranteed by applying the above-mentioned technical solutions according to embodiments of the present invention, indication information of the at least one processing sub-interval to be indicated, which is transmitted, is reduced. As a result, video compression performance is improved.

    Method for obtaining motion information with motion vector differences

    公开(公告)号:US10051282B2

    公开(公告)日:2018-08-14

    申请号:US14898291

    申请日:2014-06-13

    Inventor: Jie Chen Il-koo Kim

    Abstract: Provided is a method for obtaining motion information in video encoding/decoding, which includes calculating a first predictor of a motion vector of a current block/sub-block according to a motion vector of each reference block in a first reference block set of the current block/sub-block; determining a first motion vector difference between a motion vector of each reference block in a second reference block set of the current block/sub-block and a first predictor of the motion vector of the reference block in the second reference block set of the current block/sub-block; predicting a first motion vector difference between the motion vector of the current block/sub-block and the first predictor of the motion vector of the current block/sub-block according to the first motion vector difference of each reference block in the second reference block set to obtain a predictor of the first motion vector difference of the current block/sub-block; and determining a second predictor of the motion vector of the current block/sub-block according to the predictor of the first motion vector difference of the current block/sub-block and the first predictor of the motion vector of the current block/sub-block. The method makes it possible to improve encoding/decoding performance.

Patent Agency Ranking