Systems and methods of image processing based on gaze detection

    公开(公告)号:US11798204B2

    公开(公告)日:2023-10-24

    申请号:US17685278

    申请日:2022-03-02

    CPC classification number: G06T11/00 G06F3/013 G06V40/174 G06V40/18

    Abstract: Imaging systems and techniques are described. An imaging system receives image data representing at least a portion (e.g., a face) of a first user as captured by a first image sensor. The imaging system identifies that a gaze of the first user as represented in the image data is directed toward a displayed representation of at least a portion (e.g., a face) of a second user. The imaging system identifies an arrangement of representations of users for output. The imaging system generates modified image data based on the gaze and the arrangement at least in part by modifying the image data to modify at least the portion of the first user in the image data to be visually directed toward a direction corresponding to the second user based on the gaze and the arrangement. The imaging system outputs the modified image data arranged according to the arrangement.

    Task agnostic open-set prototypes for few-shot open-set recognition

    公开(公告)号:US12019641B2

    公开(公告)日:2024-06-25

    申请号:US18153899

    申请日:2023-01-12

    CPC classification number: G06F16/2462 G06F16/285

    Abstract: Systems and techniques are provided for processing one or more data samples. For example, a neural network classifier can be trained to perform few-shot open-set recognition (FSOSR) based on a task-agnostic open-set prototype. A process can include determining one or more prototype representations for each class included in a plurality of support samples. A task-agnostic open-set prototype representation can be determined, in a same learned metric space as the one or more prototype representations. One or more distance metrics can be determined for each query sample of one or more query samples, based on the one or more prototype representations and the task-agnostic open-set prototype representation. Based on the one or more distance metrics, each query sample can be classified into one of classes associated with the one or more prototype representations or an open-set class associated with the task-agnostic open-set prototype representation.

    Efficient video processing via dynamic knowledge propagation

    公开(公告)号:US12067777B2

    公开(公告)日:2024-08-20

    申请号:US17654986

    申请日:2022-03-15

    CPC classification number: G06V20/46 G06V10/82 H04L67/04

    Abstract: Certain aspects of the present disclosure provide a method of processing video data. In one example, the method includes receiving input video data; sampling a first subset of clips from the input video data; providing the first subset of clips to a first component of a machine learning model to generate first output; sampling a second subset of clips from the input video data, wherein the second subset of clips comprises fewer clips than the first subset of clips; providing the second subset of clips to a second component of the machine learning model to generate a second output; aggregating the first output from the first component of the machine learning model with the second output from the second component of the machine learning model to generate aggregated output; and determining a characteristic of the input video data based on the aggregated output.

    EFFICIENT VIDEO PROCESSING VIA DYNAMIC KNOWLEDGE PROPAGATION

    公开(公告)号:US20220301310A1

    公开(公告)日:2022-09-22

    申请号:US17654986

    申请日:2022-03-15

    Abstract: Certain aspects of the present disclosure provide a method of processing video data. In one example, the method includes receiving input video data; sampling a first subset of clips from the input video data; providing the first subset of clips to a first component of a machine learning model to generate first output; sampling a second subset of clips from the input video data, wherein the second subset of clips comprises fewer clips than the first subset of clips; providing the second subset of clips to a second component of the machine learning model to generate a second output; aggregating the first output from the first component of the machine learning model with the second output from the second component of the machine learning model to generate aggregated output; and determining a characteristic of the input video data based on the aggregated output.

Patent Agency Ranking