公开(公告)号：US11620725B2

公开(公告)日：2023-04-04

申请号：US17354792

申请日：2021-06-22

Applicant: QUALCOMM Incorporated

Inventor： Martin Renschler ,  Cullum James Baldwin ,  Michael Mager ,  Gautham Mayyuri ,  Bijan Forutanpour

IPC: G06T1/60 ,  G06T3/00 ,  H04N5/235 ,  G06T11/00 ,  G06T5/00

Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

公开(公告)号：US20180329465A1

公开(公告)日：2018-11-15

申请号：US15592664

申请日：2017-05-11

Applicant: QUALCOMM INCORPORATED

Inventor： MEHRAD TAVAKOLI ,  Idreas Mir ,  Moinul Khan ,  Ronald Alton ,  Gheorghe Cascaval ,  Rajiv Vijayakumar ,  Mriganka Mondal ,  Maurice Ribble ,  Martin Renschler

IPC: G06F1/20 ,  G06F1/32 ,  G06F1/26 ,  G06F11/34

CPC classification number: G06F1/206 ,  G06F1/163 ,  G06F1/266 ,  G06F1/3215 ,  G06F1/3218 ,  G06F1/3234 ,  G06F3/012 ,  G06F11/3495

Abstract: Disclosed are methods and systems for intelligent adjustment of an immersive multimedia workload in a portable computing device (“PCD”), such as a virtual reality (“VR”) or augmented reality (“AR”) workload. An exemplary embodiment monitors one or more performance indicators comprising a motion to photon latency associated with the immersive multimedia workload. Performance parameters associated with thermally aggressive processing components are adjusted to reduce demand for power while ensuring that the motion to photon latency is and/or remains optimized. Performance parameters that may be adjusted include, but are not limited to including, eye buffer resolution, eye buffer MSAA, timewarp CAC, eye buffer FPS, display FPS, timewarp output resolution, textures LOD, 6DOF camera FPS, and fovea size.

公开(公告)号：US20240267421A1

公开(公告)日：2024-08-08

申请号：US18163622

申请日：2023-02-02

Applicant: QUALCOMM Incorporated

Inventor： Liangping Ma ,  Prashanth Haridas Hande ,  Thomas Stockhammer ,  Imed Bouazizi ,  Martin Renschler ,  Anantharaman Balasubramanian

IPC: H04L65/70 ,  H04L65/65 ,  H04L65/80

CPC classification number: H04L65/70 ,  H04L65/65 ,  H04L65/80

Abstract: An example device for exchanging media data via a network includes a memory configured to store media data; and one or more processors implemented in circuitry and configured to: retrieve data representative of an expected time between a first frame of media data and a second frame of the media data from a media application; receive the first frame of the media data at a first time; wait to process the second frame of the media data until a second time that is equal to or greater than the first time plus the expected time; and process the second frame of the media data at the second time.

公开(公告)号：US12014445B2

公开(公告)日：2024-06-18

申请号：US18172999

申请日：2023-02-22

Applicant: QUALCOMM Incorporated

Inventor： Martin Renschler ,  Cullum James Baldwin ,  Michael Mager ,  Gautham Mayyuri ,  Bijan Forutanpour

IPC: G06T1/60 ,  G06T3/18 ,  G06T5/80 ,  G06T11/00 ,  H04N23/73

CPC classification number: G06T1/60 ,  G06T3/18 ,  G06T5/80 ,  G06T11/00 ,  H04N23/73

Abstract: Examples are described of marking specified regions of stored image frame buffer data in an image frame buffer. An imaging system can read the specified regions of the image frame buffer to identify whether the marking has been overwritten or not. The imaging system can thus efficiently identify how much of the image frame buffer has been overwritten with data from a new image frame. Based on this, the imaging system can retrieve partial image frame data from the image frame buffer and can process the partial image frame data, for instance to composite the partial image frame data with virtual content and/or to perform distortion compensation. The processed partial image frame data can be uploaded to a display buffer and displayed by a display, either as-is or once more of the frame is captured and processed. The imaging system can also perform auto-exposure using the partial image frame data.

公开(公告)号：US10043318B2

公开(公告)日：2018-08-07

申请号：US15374165

申请日：2016-12-09

Applicant: QUALCOMM Incorporated

Inventor： Moinul Khan ,  Nhon Quach ,  Martin Renschler ,  Ramesh Chandrasekhar ,  Assaf Menachem ,  Ning Bi ,  Maurice Ribble

IPC: G09G5/10 ,  G06T19/00 ,  G06T7/20 ,  G06F3/01 ,  G06T3/00 ,  G06T5/00 ,  G06T11/60 ,  G06T1/60

Abstract: Certain aspects of the present disclosure provide methods and apparatus for operating a wearable display device. Certain aspects of the present disclosure provide a method for operating a wearable display device. The method includes determining a position of the wearable display device based on a motion sensor. The method includes rendering, by a graphics processing unit, an image based on the determined position. The method includes determining a first updated position of the wearable display device based on the motion sensor. The method includes warping, by a warp engine, a first portion of the rendered image based on the first updated position. The method includes displaying the warped first portion of the rendered image on a display of the wearable display device.

公开(公告)号：US12106488B2

公开(公告)日：2024-10-01

申请号：US17739820

申请日：2022-05-09

Applicant: QUALCOMM Incorporated

Inventor： Samuel Benjamin Holmes ,  Jonathan Wicks ,  Arjun Chopra ,  Martin Renschler

IPC: G06T7/20 ,  G06T19/00

CPC classification number: G06T7/20 ,  G06T19/006

Abstract: Systems and techniques are provided for synchronizing a frame rate of pass-through content from a camera and a display refresh rate. An example method can include obtaining first and second frames captured by an image capture device (which may be part of a device, such as an extended reality (XR) device). A display refresh rate of a display is greater than a camera frame rate of the image capture device. The method may determine motion between the first frame and the second frame. The method can include predicting, based on the second frame and the determined motion, a third frame corresponding to a time after the second frame. The method can include displaying content (e.g., mixed reality content) including the predicted third frame and virtual content rendered for the XR device.

公开(公告)号：US11068531B2

公开(公告)日：2021-07-20

申请号：US16414667

申请日：2019-05-16

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur Rahman ,  Kexi Liu ,  Martin Renschler

IPC: G06F16/532 ,  G06T19/00 ,  G06F16/332 ,  G06F16/583 ,  G06F16/951 ,  G06F16/955 ,  G02B27/01 ,  G06F3/01

Abstract: A method, an apparatus, and a computer program product conduct online visual searches through an augmented reality (AR) device having an optical see-through head mounted display (HMD). An apparatus identifies a portion of an object in a field of view of the HMD based on user interaction with the HMD. The portion includes searchable content, such as a barcode. The user interaction may be an eye gaze or a gesture. A user interaction point in relation to the HMD screen is tracked to locate a region of the object that includes the portion and the portion is detected within the region. The apparatus captures an image of the portion. The identified portion of the object does not encompass the entirety of the object. Accordingly, the size of the image is less than the size of the object in the field of view. The apparatus transmits the image to a visual search engine.

公开(公告)号：US10957093B2

公开(公告)日：2021-03-23

申请号：US16674669

申请日：2019-11-05

Applicant: QUALCOMM Incorporated

Inventor： Mehrad Tavakoli ,  Moinul Khan ,  Martin Renschler ,  Mriganka Mondal

IPC: G06T15/00 ,  G06F3/01 ,  G06T3/00 ,  G06K9/00

Abstract: An apparatus is configured to render graphics content to reduce latency of the graphics content. The apparatus includes a display configured to present graphics content including a first portion corresponding to an area of interest and further including a second portion. The apparatus further includes a fovea estimation engine configured to generate an indication of the area of interest based on scene information related to the graphics content. The apparatus further includes a rendering engine responsive to the fovea estimation engine. The rendering engine is configured to perform a comparison of a first result of an evaluation metric on part of the area of interest with a second result of the evaluation metric with another part of the area of interest. The rendering engine is further configured to render the graphics content using predictive adjustment to reduce latency based on the comparison.

公开(公告)号：US12019796B2

公开(公告)日：2024-06-25

申请号：US17816228

申请日：2022-07-29

Applicant: QUALCOMM Incorporated

Inventor： Danlu Zhang ,  Paul Holdaway ,  Jiaying Pan ,  Ajinkya Shyam Ambre ,  Vinayak Muralidharan ,  Martin Renschler ,  Michael Mager ,  Brian Momeyer ,  Rashmi Kulkarni ,  Damir Didjusto

IPC: G06T19/00 ,  G06F3/01 ,  G06V10/25

CPC classification number: G06F3/013 ,  G06F3/015 ,  G06T19/006 ,  G06V10/25

Abstract: Attention evaluation by an extended reality system, the system determining one or more regions of interest (ROI) for an image displayed to a user. The system may also receive eye tracking information indicating an area of the image that the user is looking at. The system may further generate focus statistics based on the area of the image at which the user is looking at and the one or more ROI; and output the generated focus statistics.

公开(公告)号：US11734336B2

公开(公告)日：2023-08-22

申请号：US17304739

申请日：2021-06-24

Applicant: QUALCOMM Incorporated

Inventor： Md Sazzadur Rahman ,  Kexi Liu ,  Martin Renschler

IPC: G06F16/532 ,  G06T19/00 ,  G06F3/01 ,  G02B27/01 ,  G06F16/332 ,  G06F16/583 ,  G06F16/951 ,  G06F16/955

CPC classification number: G06F16/532 ,  G02B27/017 ,  G06F3/013 ,  G06F3/017 ,  G06F16/332 ,  G06F16/583 ,  G06F16/951 ,  G06F16/9554 ,  G06T19/006 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0187

Abstract: Aspects of the disclosed technology relate to an apparatus including a memory and at least one processor. The at least one processor can obtain at least one image of a scene and determine a portion of interest within the scene based on a first input. The first input can include a non-touch input. The at least one processor can output, in response to the first input, content associated with the portion of interest and receive a second input from the user. The second input can include a non-eye gaze input and be associated with the content. An action can be initiated by the one or more processor based on the second input.