公开(公告)号：WO2023083466A1

公开(公告)日：2023-05-19

申请号：PCT/EP2021/081609

申请日：2021-11-15

Applicant: HUAWEI TECHNOLOGIES CO., LTD. ,  UNIVERSITY OF ZURICH

Inventor： GEORGOULIS, Stamatios ,  MESSIKOMMER, Nico ,  TULYAKOV, Stepan ,  ERBACH, Julius ,  BOCCHICCHIO, Alfredo ,  GEHRIG, Daniel ,  LI, Yuanyou ,  SCARAMUZZA, Davide

IPC: G06T5/50

Abstract: A HDR imaging device comprising: an image sensor configured to capture a plurality of LDR images; an aligned event sensor with pixels configured to capture a plurality of events between the plurality of LDR images; an image encoder module configured to generate an image feature representation based on each of the LDR images; an event encoder module configured to generate an event feature representation based on a subset of the plurality of events. A feature alignment module configured to: estimate per-pixel offsets between the image feature representation of a specified LDR image and each other LDR image and generate a plurality of aligned feature representations by applying deformable convolutions or warping to the image feature representations based on the estimated offsets. A fusion module configured to generate fused feature representation; and an image decoder module configured to generate a HDR image based on the fused feature representation.