-
公开(公告)号:US10997741B2
公开(公告)日:2021-05-04
申请号:US17031669
申请日:2020-09-24
Applicant: Apple Inc.
Inventor: Tobias Eble , Thomas Post
Abstract: In one implementation, a method of scene camera retargeting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, a depth of the scene. The method further includes transforming, using the one or more processors, the image of the scene based on the depth and a difference between a point-of-view of the scene camera and a point-of-view of a user. The method further includes displaying, on the display, the transformed image.
-
公开(公告)号:US20210019898A1
公开(公告)日:2021-01-21
申请号:US17031669
申请日:2020-09-24
Applicant: Apple Inc.
Inventor: Tobias Eble , Thomas Post
Abstract: In one implementation, a method of scene camera retargeting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, a depth of the scene. The method further includes transforming, using the one or more processors, the image of the scene based on the depth and a difference between a point-of-view of the scene camera and a point-of-view of a user. The method further includes displaying, on the display, the transformed image.
-
公开(公告)号:US10521881B1
公开(公告)日:2019-12-31
申请号:US16015788
申请日:2018-06-22
Applicant: Apple Inc.
Inventor: Tobias Eble , Jim C. Chou , Jian Zhou , Moinul Khan , Hariprasad Puthukkootil Rajagopal
Abstract: In various implementations, a method includes obtaining a first frame that is characterized by a first resolution associated with a first memory allocation. In some implementations, the method includes down-converting the first frame from the first resolution to a second resolution that is lower than the first resolution initially defining the first frame in order to produce a reference frame. In some implementations, the second resolution is associated with a second memory allocation that is less than a target memory allocation derived from the first memory allocation. In some implementations, the method includes storing the reference frame in a non-transitory memory. In some implementations, the method includes obtaining a second frame that is characterized by the first resolution. In some implementations, the method includes performing an error correction operation on the second frame based on the reference frame stored in the non-transitory memory.
-
公开(公告)号:US12093451B2
公开(公告)日:2024-09-17
申请号:US18014848
申请日:2021-06-24
Applicant: APPLE INC.
Inventor: Tobias Eble , Tom Sengelaub
CPC classification number: G06F3/013 , G06T7/70 , G06T2207/30244
Abstract: Various implementations disclosed herein include devices, systems, and methods that assess calibration between eye tracking and other components of a head-mounted device (HMD) using another device, such as a mobile device. For example, an example process may include obtaining first sensor data captured by a first sensor of a first device, the first sensor data including a representation of a portion of a second device, obtaining second sensor data captured by a second sensor of the second device, detecting a position of the first sensor of the first device based on the second sensor data, and assessing a calibration between the portion of the second device and the sensor of the second device based on the first sensor data and the detected position of the first sensor.
-
公开(公告)号:US20240267503A1
公开(公告)日:2024-08-08
申请号:US18437143
申请日:2024-02-08
Applicant: Apple Inc.
Inventor: Yashas Rai Kurlethimar , Seyedkoosha Mirhosseini , Tobias Eble
IPC: H04N13/296 , G06T3/40 , G06T15/00 , H04N13/344
CPC classification number: H04N13/296 , G06T3/40 , G06T15/00 , H04N13/344
Abstract: In one implementation, a method of generating an image is performed by a device including one or more processors and non-transitory memory. The method includes generating a first resolution function based on a formula with a set of variables having a first set of values. The method includes generating a first image based on first content and the first resolution function. The method includes detecting a resolution constraint. The method includes generating a second resolution function based on the formula with the set of variables having a second set of values, wherein the second resolution function has a summation value that satisfies the resolution constraint. The method includes generating a second image based on second content and the second resolution function.
-
公开(公告)号:US20240087080A1
公开(公告)日:2024-03-14
申请号:US18510916
申请日:2023-11-16
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
CPC classification number: G06T3/0093 , G06T3/40 , G06T9/001
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US11830214B2
公开(公告)日:2023-11-28
申请号:US16424937
申请日:2019-05-29
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V10/245 , G06V10/462 , G06V20/20 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US11823343B1
公开(公告)日:2023-11-21
申请号:US17208673
申请日:2021-03-22
Applicant: Apple Inc.
Inventor: Dhruv Aditya Govil , Sabine Webel , Olivier Denis Roger Gutknecht , Shruti Singhal , Tobias Eble , Pal Kristian Engstad , Ivan Gavrenkov
CPC classification number: G06T19/20 , G02B27/0101 , G06T19/003 , G06T19/006 , G06T2219/2012
Abstract: A method and device for modifying virtual content according to various simulation characteristics includes obtaining first virtual content; obtaining one or more simulation characteristics; and generating second virtual content by modifying the first virtual content according to the one or more simulation characteristics; and presenting the second virtual content.
-
公开(公告)号:US11706383B1
公开(公告)日:2023-07-18
申请号:US16015803
申请日:2018-06-22
Applicant: Apple Inc.
Inventor: Tobias Eble , Sabine Webel
IPC: H04N7/01 , H04N5/46 , G06F3/14 , H04N13/20 , H04N13/344 , G01S7/06 , G06F1/3234 , H04N13/139 , H04N13/194 , H04N21/44 , H04N13/341 , G06F3/01 , G09G3/00 , H04N13/161
CPC classification number: H04N7/0127 , G06F3/1446 , H04N5/46 , H04N21/44 , G01S7/068 , G06F1/3265 , G06F3/011 , G09G3/003 , G09G2330/021 , G09G2340/0435 , H04N13/139 , H04N13/161 , H04N13/194 , H04N13/20 , H04N13/341 , H04N13/344
Abstract: In various implementations, a method of presenting video streams at a head-mountable device (HMD) includes generating a first video stream at a first frame rate for a first display portion. In some implementations, the first frame rate indicates a rate at which frames are presented by the first display portion. In various implementations, the method includes generating a second video stream at a second frame rate for a second display portion. In some implementations, the second frame rate indicates a rate at which frames are presented by the second display portion. In some implementations, the second frame rate is within a threshold relative to the first frame rate. In various implementations, the method includes temporally shifting the second video stream relative to the first video stream so that a majority of refresh times of the first display portion are different from refresh times of the second display portion.
-
公开(公告)号:US11216920B2
公开(公告)日:2022-01-04
申请号:US16860212
申请日:2020-04-28
Applicant: Apple Inc.
Inventor: Tobias Eble
Abstract: Various implementations provided herein provide content on an optical see-through display using enhanced local contrast. In some implementations, the enhanced local contrast may be used to provide an apparent reduction in brightness (e.g., a shadow) or other visual effect. For example, the appearance of a virtual shadow of a virtual cup on a real table of a physical environment can be provided even though the brightness of the table cannot be reduced. The appearance of the shadow may be provided by selectively enhancing contrast that the user cognitively interprets to see a relatively “darker” area where the shadow should be (e.g., via an optical illusion/effect).
-
-
-
-
-
-
-
-
-