Video super resolution method
    4.
    发明授权

    公开(公告)号:US11727541B2

    公开(公告)日:2023-08-15

    申请号:US17643984

    申请日:2021-12-13

    摘要: A video super resolution method comprises successively executing instances of a first plurality of layers (SISR) of a neural network for generating a first image (St) at a higher resolution than an input image frame (Xt); successively executing a second plurality of layers (VSR) of the neural network for generating a second image (Vt) at the higher resolution, at least one of the second plurality of layers generating intermediate output information (Ht), the second plurality of layers taking into account an output image (Yt−1) at the higher resolution generated by a previous instance of the network from a previous input image frame (Xt−1) and intermediate output information (Ht−1) generated by the second plurality of layers of the previous instance, and executing a third plurality of layers for combining the first (St) and second (Vt) images to produce an output image (Yt) for the instance of the network.

    Gaze repositioning during a video conference

    公开(公告)号:US11722329B2

    公开(公告)日:2023-08-08

    申请号:US17495800

    申请日:2021-10-06

    IPC分类号: H04L12/18 G06V20/40 G06V40/18

    摘要: A method at a first participant's client conferencing system in a videoconference comprises receiving, from a second client conferencing system, at least one first video frame of a first video signal including an image of the second participant looking at a third participant, and first metadata associated with the first video frame and including an identity of the third participant. The image of the second participant is modified in the first video frame so that the first video frame is displayed on a first area of the client conferencing system with the second participant looking at a second area of the first display configured for displaying a second video signal of the third participant identified by the first metadata.

    IMAGE PROCESSING SYSTEM
    6.
    发明公开

    公开(公告)号:US20230169771A1

    公开(公告)日:2023-06-01

    申请号:US17540011

    申请日:2021-12-01

    摘要: An image processing system comprising a processer configured to receive a sequence of images frames from an image acquisition device and configured to: analyze at least a currently acquired image frame to determine if activity is occurring in an environment with a field of view of the image acquisition device; responsive to analyzing a subsequent image frame acquired after the currently acquired image frame and determining that no activity is occurring in the environment, retrieve an image frame acquired before the currently acquired image frame which has been analyzed and where it has been determined that no activity is occurring in the environment; analyze the subsequent image frame and the retrieved image frame to identify a state of one or more objects within the field of view of the image acquisition device; and responsive to a change in state of the one or more objects, notify a user accordingly.

    Method For Calibrating A Vehicle Cabin Camera

    公开(公告)号:US20230127692A1

    公开(公告)日:2023-04-27

    申请号:US18087938

    申请日:2022-12-23

    摘要: A method for calibrating a vehicle cabin camera having: a pitch, yaw and roll angle; and a field of view capturing vehicle cabin features which are symmetric about a vehicle longitudinal axis comprises: selecting points from within an image of the vehicle cabin and projecting the points onto a 3D unit circle in accordance with a camera projection model. For each of one or more rotations of a set of candidate yaw and roll rotations, the method comprises: rotating the projected points with the rotation; flipping the rotated points about a pitch axis; counter-rotating the projected points with an inverse of the rotation; and mapping the counter-rotated points back into an image plane to provide a set of transformed points. A candidate rotation which provides a best match between the set of transformed points and the locations of the selected points in the image plane is selected.

    Method and system for correcting a distorted input image

    公开(公告)号:US11593913B2

    公开(公告)日:2023-02-28

    申请号:US17833812

    申请日:2022-06-06

    IPC分类号: G06T3/40 G06T5/00

    摘要: A method for correcting an image divides an output image into a grid with vertical sections of width smaller than the image width but wide enough to allow efficient bursts when writing distortion corrected line sections into memory. A distortion correction engine includes a relatively small amount of memory for an input image buffer but without requiring unduly complex control. The input image buffer accommodates enough lines of an input image to cover the distortion of a single most vertically distorted line section of the input image. The memory required for the input image buffer can be significantly less than would be required to store all the lines of a distorted input image spanning a maximal distortion of a complete line within the input image.

    Method for calibrating a vehicle cabin camera

    公开(公告)号:US11538192B1

    公开(公告)日:2022-12-27

    申请号:US17398965

    申请日:2021-08-10

    摘要: A method for calibrating a vehicle cabin camera having: a pitch, yaw and roll angle; and a field of view capturing vehicle cabin features which are symmetric about a vehicle longitudinal axis comprises: selecting points from within an image of the vehicle cabin and projecting the points onto a 3D unit circle in accordance with a camera projection model. For each of one or more rotations of a set of candidate yaw and roll rotations, the method comprises: rotating the projected points with the rotation; flipping the rotated points about a pitch axis; counter-rotating the projected points with an inverse of the rotation; and mapping the counter-rotated points back into an image plane to provide a set of transformed points. A candidate rotation which provides a best match between the set of transformed points and the locations of the selected points in the image plane is selected.

    Systems and Methods for 3D Facial Modeling

    公开(公告)号:US20220254105A1

    公开(公告)日:2022-08-11

    申请号:US17652078

    申请日:2022-02-22

    摘要: In an embodiment, a 3D facial modeling system includes a plurality of cameras configured to capture images from different viewpoints, a processor, and a memory containing a 3D facial modeling application and parameters defining a face detector, wherein the 3D facial modeling application directs the processor to obtain a plurality of images of a face captured from different viewpoints using the plurality of cameras, locate a face within each of the plurality of images using the face detector, wherein the face detector labels key feature points on the located face within each of the plurality of images, determine disparity between corresponding key feature points of located faces within the plurality of images, and generate a 3D model of the face using the depth of the key feature points.