-
公开(公告)号:US20240087080A1
公开(公告)日:2024-03-14
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11830214B2
公开(公告)日:2023-11-28
申请号:US16424937
申请日:2019-05-29
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V10/245 , G06V10/462 , G06V20/20 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US11545108B2
公开(公告)日:2023-01-03
申请号:US17158402
申请日:2021-01-26
Applicant: Apple Inc.
Inventor: Siddharth Shankar Hazra , Ralf Habel , Anselm Grundhoefer , Aleksandr M. Movshovich , Moinul Khan , Marwan Hussein
Abstract: A method includes obtaining rendered image data that includes a representation of an object for display using a see-through display. The see-through display permits ambient light from a physical environment through the see-through display. The method includes sensing a plurality of light superposition characteristic values associated with the ambient light that quantifies the ambient light. The method includes determining a plurality of display correction values associated with the electronic device based on the plurality of light superposition characteristic values and predetermined display characteristics of the representation of the object. The method includes generating, from the rendered image data, display data for the see-through display in accordance with the plurality of display correction values in order to satisfy the predetermined display characteristics of the representation of the object within a performance threshold.
-
公开(公告)号:US11373271B1
公开(公告)日:2022-06-28
申请号:US17203069
申请日:2021-03-16
Applicant: Apple Inc.
Inventor: Pedro Manuel Da Silva Quelhas , Moinul Khan , Raffi A. Bedikian , Katharina Buckl , Mohamed Selim Ben Himane
Abstract: A method includes obtaining an image via an image sensor, and identifying, within the image, a physical object represented by a portion of the image. The method includes determining, based on the image, a visual feature characterizing the physical object. The method includes warping, based on the visual feature satisfying a first feature criterion, the portion of the image according to a first warping function that is based on the first feature criterion and a distance between the electronic device and a reference point. The method includes warping, based on the visual feature satisfying a second feature criterion that is different from the first feature criterion, the portion of the image according to a second warping function that is based on the second feature criterion and the distance between the electronic device and the reference point.
-
公开(公告)号:US11301969B1
公开(公告)日:2022-04-12
申请号:US16575994
申请日:2019-09-19
Applicant: Apple Inc.
Inventor: Moinul Khan , Simon Fortin-Deschenes , Yanli Zhang , Bennett S. Wilburn , Sterling G. Orsten , Nan Zhu , James Zhou
Abstract: Some implementations provide improved user experiences on head mounted devices (HMDs) that provide near eye viewing, e.g., HMDs that display distorted images and provide lenses that undistort the images for the user. The images are produced using distortion that is corrected dynamically based on context to conserve device resources. To do so, a context associated with a state of the user, the HMD, or content being viewed on the HMD is tracked during the user experience. For example, the device may predict pupil position, eye state, eye gaze direction, or eye fixation, content type, connection mode, and other context. The device uses the tracked context to determine how to correct distortion for the images at different points during the user experience. For example, new distortion corrections may be computed and used while the user's gaze is moving and previously-determined distortion corrections may be used while the user's gaze is fixed.
-
公开(公告)号:US20210142443A1
公开(公告)日:2021-05-13
申请号:US17053181
申请日:2019-05-06
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11276143B2
公开(公告)日:2022-03-15
申请号:US17114796
申请日:2020-12-08
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US20210118090A1
公开(公告)日:2021-04-22
申请号:US17114796
申请日:2020-12-08
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US10891714B2
公开(公告)日:2021-01-12
申请号:US16681631
申请日:2019-11-12
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
-
-
-
-
-
-
-