公开(公告)号：US20240160896A1

公开(公告)日：2024-05-16

申请号：US18335685

申请日：2023-06-15

Applicant: QUALCOMM Incorporated

Inventor： Shashanka VENKATARAMANAN ,  Amir GHODRATI ,  Amirhossein HABIBIAN

IPC: G06N3/0455

CPC classification number: G06N3/0455

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for improved attention-based machine learning. A first attention propagation output is generated using a first transformer block of a plurality of transformer blocks, this generation including processing input data for the first transformer block using a first self-attention sub-block of the first transformer block. The first attention propagation output is propagated to a second transformer block of the plurality of transformer blocks. An output for the second transformer block is generated, this generation including generating output features for the second transformer block based on the first attention propagation output.

公开(公告)号：US20230154157A1

公开(公告)日：2023-05-18

申请号：US17973370

申请日：2022-10-25

Applicant: QUALCOMM Incorporated

Inventor： Babak EHTESHAMI BEJNORDI ,  Amir GHODRATI ,  Fatih Murat PORIKLI ,  Amirhossein HABIBIAN

IPC: G06V10/77 ,  G06V10/82 ,  G06V10/46 ,  G06V10/22

CPC classification number: G06V10/7715 ,  G06V10/82 ,  G06V10/462 ,  G06V10/225

Abstract: A processor-implemented method of video processing using includes receiving, via an artificial neural network (ANN), a video including a first frame and a second frame. A saliency map is generated based on the first frame of the video. The second frame of the video is sampled based on the saliency map. A first portion of the second frame is sampled at a first resolution and a second portion of the second frame is sampled at a second resolution. The first resolution is different than the second resolution. A resampled second frame is generated based on the sampling of the second frame. The resampled second frame is processed to determine an inference associated with the video.

公开(公告)号：US20220318553A1

公开(公告)日：2022-10-06

申请号：US17219460

申请日：2021-03-31

Applicant: QUALCOMM Incorporated

Inventor： Haitam BEN YAHIA ,  Amir GHODRATI ,  Mihir JAIN ,  Amirhossein HABIBIAN

IPC: G06K9/00 ,  G06K9/62 ,  G10L25/57 ,  G06N3/08 ,  G06K9/46 ,  G06N3/04

Abstract: Systems and techniques are provided for performing holistic video understanding. For example a process can include obtaining a first video and determining, using a machine learning model decision engine, a first machine learning model from a set of machine learning models to use for processing at least a portion of the first video. The first machine learning model can be determined based on one or more characteristics of at least the portion of the first video. The process can include processing at least the portion of the first video using the first machine learning model.

公开(公告)号：US20240330662A1

公开(公告)日：2024-10-03

申请号：US18193234

申请日：2023-03-30

Applicant: QUALCOMM Incorporated

Inventor： Amir GHODRATI ,  Amirhossein HABIBIAN

IPC: G06N3/0499

CPC classification number: G06N3/0499

Abstract: Certain aspects of the present disclosure provide techniques and apparatus for processing multidimensional content using neural networks. An example method generally includes decomposing a multidimensional input into a plurality of two-dimensional subspaces, wherein the plurality of two-dimensional subspaces share a common dimension. A first attention matrix is generated based on a projection of tokens in a first two-dimensional subspace of the plurality of two-dimensional subspaces via an attention block of a transformer neural network, and a second attention matrix is generated based on a projection of tokens in a second two-dimensional subspace of the plurality of two-dimensional subspaces via the attention block of the transformer neural network. An output of the transformer neural network is generated based on a combination of the first attention matrix and the second attention matrix.

公开(公告)号：US20220301311A1

公开(公告)日：2022-09-22

申请号：US17696797

申请日：2022-03-16

Applicant: QUALCOMM Incorporated

Inventor： Davide ABATI ,  Amirhossein HABIBIAN ,  Amir GHODRATI

IPC: G06V20/40 ,  G06V10/74 ,  G06V10/82 ,  G06T3/40

Abstract: A processor-implemented method for processing a video includes receiving the video as an input at an artificial neural network (ANN). The video includes a sequence of frames. A set of features of a current frame of the video and a prior frame of the video are extracted. The set of features including a set of support features for a set of pixels of the prior frame to be aligned with a set of reference features of the current frame. A similarity between a support feature for each pixel in the set of pixels of the set of support features of the prior frame and a corresponding reference feature of the current frame is computed. An attention map is generated based on the similarity. An output including a reconstruction of the current frame is generated based on the attention map.

公开(公告)号：US20220157045A1

公开(公告)日：2022-05-19

申请号：US17527076

申请日：2021-11-15

Applicant: QUALCOMM Incorporated

Inventor： Babak EHTESHAMI BEJNORDI ,  Amirhossein HABIBIAN ,  Fatih Murat PORIKLI ,  Amir GHODRATI

IPC: G06V10/764 ,  G06V10/80 ,  G06V10/82

Abstract: Certain aspects of the present disclosure provide techniques for processing with an auto exiting machine learning model architecture, including processing input data in a first portion of a classification model to generate first intermediate activation data; providing the first intermediate activation data to a first gate; making a determination by the first gate whether or not to exit processing by the classification model; and generating a classification result from one of a plurality of classifiers of the classification model.