-
公开(公告)号:US11373271B1
公开(公告)日:2022-06-28
申请号:US17203069
申请日:2021-03-16
Applicant: Apple Inc.
Inventor: Pedro Manuel Da Silva Quelhas , Moinul Khan , Raffi A. Bedikian , Katharina Buckl , Mohamed Selim Ben Himane
Abstract: A method includes obtaining an image via an image sensor, and identifying, within the image, a physical object represented by a portion of the image. The method includes determining, based on the image, a visual feature characterizing the physical object. The method includes warping, based on the visual feature satisfying a first feature criterion, the portion of the image according to a first warping function that is based on the first feature criterion and a distance between the electronic device and a reference point. The method includes warping, based on the visual feature satisfying a second feature criterion that is different from the first feature criterion, the portion of the image according to a second warping function that is based on the second feature criterion and the distance between the electronic device and the reference point.
-
公开(公告)号:US11010982B1
公开(公告)日:2021-05-18
申请号:US16859850
申请日:2020-04-27
Applicant: Apple Inc.
Inventor: Gutemberg B. Guerra Filho , Ian M. Richter , Raffi A. Bedikian
Abstract: In some implementations, a method includes: identifying, within first image data that corresponds to a first pose of a physical environment, a target physical object associated with a set of physical features that satisfies a mapping criterion for a computer-generated reality (CGR) object; assigning a secondary semantic label to the target physical object, wherein the secondary semantic label links the target physical object to the CGR object; and generating a CGR overlay associated with the CGR object based on one or more characteristics of the target physical object.
-
公开(公告)号:US12100109B2
公开(公告)日:2024-09-24
申请号:US17484996
申请日:2021-09-24
Applicant: Apple Inc.
Inventor: Gutemberg B. Guerra Filho , Raffi A. Bedikian , Ian M. Richter
IPC: G06F3/01 , G06F3/0481 , G06F3/0488 , G06T7/246 , G06T19/00 , G06T19/20
CPC classification number: G06T19/006 , G06F3/011 , G06T7/246 , G06T19/003 , G06T2207/30242 , G06T2207/30244
Abstract: In some implementations, a method includes: identifying a plurality of subsets associated with a physical environment; determining a set of spatial characteristics for each of the plurality of subsets, wherein a first set of spatial characteristics characterizes dimensions of a first subset and a second set of spatial characteristics characterizes dimensions of a second subset; generating an adapted first extended reality (XR) content portion for the first subset based at least in part on the first set of spatial characteristics; generating an adapted second XR content portion for the second subset based at least in part on the second set of spatial characteristics; and generating one or more navigation options that allow a user to traverse between the first and second subsets based on the first and second sets of spatial characteristics.
-
公开(公告)号:US11783444B1
公开(公告)日:2023-10-10
申请号:US17028004
申请日:2020-09-22
Applicant: Apple Inc.
Inventor: Tobias Eble , Pedro Manuel Da Silva Quelhas , Raffi A. Bedikian
CPC classification number: G06T3/0093 , G06T7/50 , G06T11/00 , G06T2207/20084
Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.
-
公开(公告)号:US11474348B2
公开(公告)日:2022-10-18
申请号:US17481272
申请日:2021-09-21
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US20200278539A1
公开(公告)日:2020-09-03
申请号:US16651228
申请日:2017-09-28
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints and determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US12289559B2
公开(公告)日:2025-04-29
申请号:US17590036
申请日:2022-02-01
Applicant: APPLE INC.
Inventor: Sai Harsha Jandhyala , Raffi A. Bedikian
IPC: G06T7/246 , G06T7/73 , G06T7/90 , G06V10/143 , G06V10/20 , G06V10/70 , G06V10/80 , G06V40/20 , H04N5/33
Abstract: Various implementations disclosed herein include devices, systems, and methods that identify a gesture based on event camera data and frame-based camera data (e.g., for a CGR environment). In some implementations at an electronic device having a processor, event camera data is obtained corresponding to light (e.g., IR light) reflected from a physical environment and received at an event camera. In some implementations, frame-based camera data is obtained corresponding to light (e.g., visible light) reflected from the physical environment and received at a frame-based camera. In some implementations, a subset of the event camera data is identified based on the frame-based camera data, and a gesture (e.g., of a person in the physical environment) is identified based on the subset of event camera data. In some implementations, a path (e.g., of a hand) by tracking a grouping of blocks of event camera events in the subset of event camera data.
-
公开(公告)号:US20230314798A1
公开(公告)日:2023-10-05
申请号:US17961963
申请日:2022-10-07
Applicant: Apple Inc.
Inventor: Branko Petljanski , Raffi A. Bedikian , Daniel Kurz , Thomas Gebauer , Li Jia
CPC classification number: G02B27/0093 , G02B27/0101 , G02B27/0172 , G02B27/0179 , G06F3/013 , G02B2027/0138 , G02B2027/014 , G02B2027/0187
Abstract: In one implementation, a method includes emitting light with modulating intensity from a plurality of light sources towards an eye of a user. The method includes receiving light intensity data indicative of an intensity of the plurality of glints reflected by the eye of the user in the form of a plurality of glints. The method includes determining an eye tracking characteristic of the user based on the light intensity data. In one implementation, a method includes generating, using an event camera comprising a plurality of light sensors at a plurality of respective locations, a plurality of event messages, each of the plurality of event messages being generated in response to a particular light sensor detecting a change in intensity of light and indicating a particular location of the particular light sensor. The method includes determining an eye tracking characteristic of a user based on the plurality of event messages.
-
公开(公告)号:US11307650B1
公开(公告)日:2022-04-19
申请号:US16859879
申请日:2020-04-27
Applicant: Apple Inc.
Inventor: Gutemberg B. Guerra Filho , Ian M. Richter , Raffi A. Bedikian
Abstract: In one implementation, a method for generating computer-generated reality content (CGR) content in order to invoke a target state of a user based on a user model is performed at an electronic device. The method includes: while presenting reference CGR content via the one or more displays, obtaining a request from a user to invoke a target state for the user; generating, based on a user model associated with the user and the reference CGR content, modified CGR content to invoke the target state for the user, wherein the user model provides projected reactions to CGR content; and presenting, via the one or more displays, the modified CGR content. In some implementations, obtaining the request from the user to invoke the target state for the user includes determining whether the user provided informed consent to store user information in the user model associated with the user of the device.
-
公开(公告)号:US11270409B1
公开(公告)日:2022-03-08
申请号:US17029396
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Raffi A. Bedikian , Mohamed Selim Ben Himane , Pedro Manuel Da Silva Quelhas , Moinul Khan , Katharina Buckl , Jim C. Chou , Julien Monat Rodier
IPC: G06T3/00 , G02B27/01 , G02B27/00 , H04N13/117
Abstract: A method includes obtaining an image via an image sensor. The method includes determining a first perceptual quality value that is associated with a first portion of the image. The method includes determining a first image perceptual quality warping function that is based on the first perceptual quality value and an image warping map. The first image perceptual quality warping function is characterized by a first warping granularity level that is a function of the first perceptual quality value. The method includes warping the first portion of the image according to the first image perceptual quality warping function.
-
-
-
-
-
-
-
-
-