System using multimodal decorrelated embedding model

    公开(公告)号:US11688198B1

    公开(公告)日:2023-06-27

    申请号:US17457551

    申请日:2021-12-03

    CPC classification number: G06V40/1318 G06F18/213 G06F18/2148 G06V10/95

    Abstract: A biometric identification system uses inputs acquired using different modalities. A model having an intersection branch and an XOR branch is trained to determine an embedding using features present in all modalities (an intersection of modalities), and features that are distinctive to each modality (an XOR of that modality relative to the other modality(s)). During training, a first loss function is used to determine a first loss value with respect to the branches. Probability distributions are determined for the output from the branches, corresponding to the intersection and XORs of each modality. A second loss function uses these probability distributions to determine a second loss value. A total loss function for training the model may be a sum of the first loss and the second loss. Once trained, the model may process query inputs to determine embedding data for comparison with embedding data of a previously enrolled user.

    Generating tracklets from digital imagery

    公开(公告)号:US11232294B1

    公开(公告)日:2022-01-25

    申请号:US15717792

    申请日:2017-09-27

    Abstract: Actors may be detected and tracked within a scene using multiple imaging devices provided in a network that are aligned with fields of view that overlap at least in part. Processors operating on the imaging devices may evaluate the images using one or more classifiers to recognize body parts within the images, and to associate the body parts with a common actor within the scene. Each of the imaging devices may generate records of the positions of the body parts and provide such records to a central server, that may correlate body parts appearing within images captured by two or more of the imaging devices and generate a three-dimensional model of an actor based on positions of the body parts. Motion of the body parts may be tracked in subsequent images, and the model of the actor may be updated based on the motion.

    System to search three-dimensional object data

    公开(公告)号:US10902280B1

    公开(公告)日:2021-01-26

    申请号:US16460948

    申请日:2019-07-02

    Abstract: The presence of an object in a query image may be searched for using a feature of the query image. A local descriptor value for the feature is first determined. Previously stored object data for various 3D objects is then retrieved, with each set of stored object data including a probability distribution that describes a feature of a 3D object as obtained from images at different camera poses. A probability value is then determined using the local descriptor value for the feature in the query image and the available distribution data from the stored object data. The distribution data is then ranked based on the resulting probability values and the highest ranked distribution data is associated with the feature in the query image. Output data may also be generated to identify the 3D object in the query image based on an object identifier of the highest ranked distribution data.

Patent Agency Ranking