-
公开(公告)号:US11836885B2
公开(公告)日:2023-12-05
申请号:US17053181
申请日:2019-05-06
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US10521881B1
公开(公告)日:2019-12-31
申请号:US16015788
申请日:2018-06-22
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US20240062413A1
公开(公告)日:2024-02-22
申请号:US18384352
申请日:2023-10-26
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V20/20 , G06V10/462 , G06V10/245 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US20230290321A1
公开(公告)日:2023-09-14
申请号:US18101779
申请日:2023-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
CPC classification number: G09G5/10 , G02B27/017 , G06T19/006
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US20200082498A1
公开(公告)日:2020-03-12
申请号:US16681631
申请日:2019-11-12
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US20250014143A1
公开(公告)日:2025-01-09
申请号:US18898295
申请日:2024-09-26
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US12131437B2
公开(公告)日:2024-10-29
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US12057089B2
公开(公告)日:2024-08-06
申请号:US18101779
申请日:2023-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
CPC classification number: G09G5/10 , G02B27/017 , G06T19/006 , G01J1/4204 , G02B2027/0118 , G02B27/0172 , G09G3/22 , G09G2360/14
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US11270409B1
公开(公告)日:2022-03-08
申请号:US17029396
申请日:2020-09-23
Applicant: Apple Inc.
Inventor: Raffi A. Bedikian , Mohamed Selim Ben Himane , Pedro Manuel Da Silva Quelhas , Moinul Khan , Katharina Buckl , Jim C. Chou , Julien Monat Rodier
IPC: G06T3/00 , G02B27/01 , G02B27/00 , H04N13/117
Abstract: A method includes obtaining an image via an image sensor. The method includes determining a first perceptual quality value that is associated with a first portion of the image. The method includes determining a first image perceptual quality warping function that is based on the first perceptual quality value and an image warping map. The first image perceptual quality warping function is characterized by a first warping granularity level that is a function of the first perceptual quality value. The method includes warping the first portion of the image according to the first image perceptual quality warping function.
-
公开(公告)号:US20210241676A1
公开(公告)日:2021-08-05
申请号:US17158402
申请日:2021-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
-
-
-
-
-
-
-
-