Method and device for light estimation

    公开(公告)号:US12260496B2

    公开(公告)日:2025-03-25

    申请号:US17971049

    申请日:2022-10-21

    Abstract: A method and device with light estimation are provided. A method performed by an electronic device includes generating a reference image based on image data acquired by capturing a reference object and based on a first image signal processing (ISP) setting, generating a background image based on raw image data acquired by capturing a real background in which the reference object is positioned and based on a second ISP setting, estimating light information corresponding to the background image using a light estimation model, rendering a virtual object image corresponding to the light information and the reference object, and training the light estimation model based on a difference between the reference image and the virtual object image.

    Method of playing back image on display device and display device

    公开(公告)号:US11436698B2

    公开(公告)日:2022-09-06

    申请号:US17021196

    申请日:2020-09-15

    Inventor: Inwoo Ha

    Abstract: A method of playing back an image in a display device obtains a stereo image corresponding to both eyes of a user including a left eye and a right eye, obtains positions of the eyes determines warping transform information corresponding to the positions of the eyes based on a database (DB) provided in advance based on a curvature of an display plane of the display device, warps the stereo image by applying the warping transform information to the stereo image, determines pixel values of a display panel included in the display device from the warped stereo image by performing light field rendering based on the positions of the eyes, and reproduces the determined pixel values on the display panel.

    Method and apparatus with ego motion information estimation

    公开(公告)号:US11320832B2

    公开(公告)日:2022-05-03

    申请号:US16547859

    申请日:2019-08-22

    Abstract: A processor-implemented method includes: estimating, from frame images of consecutive frames acquired from one or more sensors, short-term ego-motion information of the one or more sensors; estimating long-term ego-motion information of the one or more sensors from the frame images; determining attention information from the short-term ego-motion information and the long-term ego-motion information; and determining final long-term ego-motion information of a current frame, of the consecutive frames, based on the long-term ego-motion information and the attention information.

    Localization method and apparatus based on 3D color map

    公开(公告)号:US10891795B2

    公开(公告)日:2021-01-12

    申请号:US16508513

    申请日:2019-07-11

    Abstract: A localization method and apparatus are provided. The method comprises generating a synthetic image corresponding to a current time period based on a three-dimensional (3D) color map corresponding to an image captured at a time period prior to the current time period, and position information at the current time period time, and determining final position information at the current time period based on the synthetic image corresponding to the current time period and an image captured at the current time period.

    Method and apparatus for light estimation

    公开(公告)号:US12249026B2

    公开(公告)日:2025-03-11

    申请号:US17699629

    申请日:2022-03-21

    Inventor: Inwoo Ha

    Abstract: A processor-implemented method for light estimation includes: estimating light information corresponding to an input image using a light estimation model; detecting a reference object in the input image; determining object information of the reference object and plane information of a reference plane supporting the reference object; rendering a virtual object corresponding to the reference object based on the light information, the object information, and the plane information; and training the light estimation model by updating the light estimation model based on a result of comparing the reference object and the rendered virtual object.

    NEURAL SUPERSAMPLING METHOD AND DEVICE

    公开(公告)号:US20250054100A1

    公开(公告)日:2025-02-13

    申请号:US18404438

    申请日:2024-01-04

    Abstract: A supersampling method includes generating a current rendered image frame by performing jittered sampling on a three-dimensional (3D) scene, based on sub-pixels of low-resolution pixels for the current rendered image frame; generating a current warped image frame by warping a previous output image frame, based on a motion vector map corresponding to a difference between the current rendered image frame and a previous rendered image frame; generating a current shifted image frame by shifting pixels of the current warped image frame, based on a change in sampling positions based on the jittered sampling; and generating a current output image frame, based on the current rendered image frame and the current shifted image frame.

Patent Agency Ranking