-
公开(公告)号:US20210312694A1
公开(公告)日:2021-10-07
申请号:US17352080
申请日:2021-06-18
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US20210142443A1
公开(公告)日:2021-05-13
申请号:US17053181
申请日:2019-05-06
Applicant: Apple Inc.
Inventor: Tobias Eble , Ye Cong , Cody J. White , Arthur Yasheng Zhang , Randall Rauwendaal , Moinul Khan , Jim C. Chou , Hao Pan , Nicolas Bonnier
Abstract: In one implementation, a method includes receiving a warped image representing simulated reality (SR) content (e.g., to be displayed in a display space), the warped image having a plurality of pixels at respective locations uniformly spaced in a grid pattern in a warped space, wherein the plurality of pixels are respectively associated with a plurality of respective pixel values and a plurality of respective scaling factors indicating a plurality of respective resolutions at a plurality of respective locations of the SR content (e.g., in the display space). The method includes processing the warped image in the warped space based on the plurality of respective scaling factors to generate a processed warped image and transmitting the processed warped image.
-
公开(公告)号:US20200380647A1
公开(公告)日:2020-12-03
申请号:US16860212
申请日:2020-04-28
Applicant: Apple Inc.
Inventor: Tobias Eble
Abstract: Various implementations provided herein provide content on an optical see-through display using enhanced local contrast. In some implementations, the enhanced local contrast may be used to provide an apparent reduction in brightness (e.g., a shadow) or other visual effect. For example, the appearance of a virtual shadow of a virtual cup on a real table of a physical environment can be provided even though the brightness of the table cannot be reduced. The appearance of the shadow may be provided by selectively enhancing contrast that the user cognitively interprets to see a relatively “darker” area where the shadow should be (e.g., via an optical illusion/effect).
-
公开(公告)号:US20240394952A1
公开(公告)日:2024-11-28
申请号:US18797340
申请日:2024-08-07
Applicant: Apple Inc.
Inventor: Arthur Y Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user's environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US20240062413A1
公开(公告)日:2024-02-22
申请号:US18384352
申请日:2023-10-26
Applicant: Apple Inc.
Inventor: Jeffrey S. Norris , Alexandre Da Veiga , Bruno M. Sommer , Ye Cong , Tobias Eble , Moinul Khan , Nicolas Bonnier , Hao Pan
CPC classification number: G06T7/73 , G02B27/017 , G06V20/20 , G06V10/462 , G06V10/245 , G06T2207/30204
Abstract: A method includes obtaining first pass-through image data characterized by a first pose. The method includes obtaining respective pixel characterization vectors for pixels in the first pass-through image data. The method includes identifying a feature of an object within the first pass-through image data in accordance with a determination that pixel characterization vectors for the feature satisfy a feature confidence threshold. The method includes displaying the first pass-through image data and an AR display marker that corresponds to the feature. The method includes obtaining second pass-through image data characterized by a second pose. The method includes transforming the AR display marker to a position associated with the second pose in order to track the feature. The method includes displaying the second pass-through image data and maintaining display of the AR display marker that corresponds to the feature of the object based on the transformation.
-
公开(公告)号:US20230351672A1
公开(公告)日:2023-11-02
申请号:US18344294
申请日:2023-06-29
Applicant: Apple Inc.
Inventor: Arthur Y. Zhang , Ray L. Chang , Timothy R. Oriol , Ling Su , Gurjeet S. Saund , Guy Cote , Jim C. Chou , Hao Pan , Tobias Eble , Avi Bar-Zeev , Sheng Zhang , Justin A. Hensley , Geoffrey Stahl
CPC classification number: G06T15/005 , G06F3/012 , G06T3/0093 , G06T9/00 , H04W76/10 , H04W88/08
Abstract: A mixed reality system that includes a device and a base station that communicate via a wireless connection The device may include sensors that collect information about the user’s environment and about the user. The information collected by the sensors may be transmitted to the base station via the wireless connection. The base station renders frames or slices based at least in part on the sensor information received from the device, encodes the frames or slices, and transmits the compressed frames or slices to the device for decoding and display. The base station may provide more computing power than conventional stand-alone systems, and the wireless connection does not tether the device to the base station as in conventional tethered systems. The system may implement methods and apparatus to maintain a target frame rate through the wireless link and to minimize latency in frame rendering, transmittal, and display.
-
公开(公告)号:US20230334684A1
公开(公告)日:2023-10-19
申请号:US18212452
申请日:2023-06-21
Applicant: Apple Inc.
Inventor: Tobias Eble , Thomas Post
CPC classification number: G06T7/536 , G02B27/0172 , G02B27/0093 , G06T19/006 , G06F3/013 , G06F3/017 , G06F17/16 , G06T2207/10028 , G02B2027/0138
Abstract: In one implementation, a method of scene camera retargeting is performed by a head-mounted device (HMD) including one or more processors, non-transitory memory, a scene camera, and a display. The method includes capturing, using the scene camera, an image of a scene. The method includes determining, using the one or more processors, a depth of the scene. The method further includes transforming, using the one or more processors, the image of the scene based on the depth and a difference between a point-of-view of the scene camera and a point-of-view of a user. The method further includes displaying, on the display, the transformed image.
-
公开(公告)号:US11783444B1
公开(公告)日:2023-10-10
申请号:US17028004
申请日:2020-09-22
Applicant: Apple Inc.
Inventor: Tobias Eble , Pedro Manuel Da Silva Quelhas , Raffi A. Bedikian
CPC classification number: G06T3/0093 , G06T7/50 , G06T11/00 , G06T2207/20084
Abstract: Various implementations disclosed herein include a method performed at an electronic device including one or more processors, a non-transitory memory, an image sensor, and a display device. The method includes obtaining, via the image sensor, an input image that includes an object. The method includes obtaining depth information characterizing the object, wherein the depth information characterizes a first distance between the image sensor and a portion of the object. The method includes determining a distance warp map for the input image based on a function of the depth information and a first offset value characterizing an estimated distance between eyes of a user and the display device. The method includes setting an operational parameter for the electronic device based on the distance warp map and generating, by the electronic device set to the operational parameter, a warped image from the input image.
-
公开(公告)号:US11694379B1
公开(公告)日:2023-07-04
申请号:US17160789
申请日:2021-01-28
Applicant: Apple Inc.
Inventor: Sabine Webel , Olivier Denis Roger Gutknecht , Pal Kristian Engstad , Ivan Gavrenkov , Tobias Eble , Shruti Singhal
CPC classification number: G06T13/00 , G02B27/0172 , G06T19/006 , G06T19/20
Abstract: In one implementation, a method of displaying an animation is performed at a device including an optical see-through display, one or more processors, and a non-transitory memory. The method includes receiving a request to display a first animation of an object exhibiting a response characteristic. The method includes determining a metric characterizing an amount of processing power for the device to display the first animation on the optical see-through display. The method includes, in response to a determination that the metric exceeds a threshold associated with the device, selecting a second animation of the object exhibiting the response characteristic. The method includes displaying the second animation.
-
公开(公告)号:US11468627B1
公开(公告)日:2022-10-11
申请号:US17081198
申请日:2020-10-27
Applicant: Apple Inc.
Inventor: Geoffrey Stahl , Thomas Post , Tobias Eble
Abstract: Various implementations disclosed herein include devices, systems, and methods that enable improved display of virtual content in computer generated reality (CGR) environments. In some implementations, the virtual content is viewed by an observer and includes multiple content elements, each of which may be rendered at an independent rate based on a change of view of the observer.
-
-
-
-
-
-
-
-
-