-
公开(公告)号:US20240098243A1
公开(公告)日:2024-03-21
申请号:US18369607
申请日:2023-09-18
Applicant: Apple Inc.
Inventor: Hermannus J. Damveld , Julien Monat Rodier , Marc-Andre Chenier
IPC: H04N13/344 , G06T3/00 , G06T7/70
CPC classification number: H04N13/344 , G06T3/0093 , G06T7/70 , G06T2207/30244
Abstract: In one implementation, a method of warping an image is performed by a device including an image sensor, a display, one or more processors, and non-transitory memory. The method includes predicting a capture pose of the device in a physical environment at a capture time and a display pose of the device in the physical environment at a display time. The method includes capturing, using the image sensor, an image of the physical environment during a capture time period including the capture time. The method includes generating a warp definition based on the predicted capture pose and the predicted display pose. The method includes warping, using the one or more processors, the image of the physical environment based on the warp definition. The method includes displaying, on the display, the warped image of the physical environment during a display time period including the display time.
-
公开(公告)号:US11704766B2
公开(公告)日:2023-07-18
申请号:US17979630
申请日:2022-11-02
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T5/003 , G06T5/007 , G06T7/73 , G06T15/005 , G06T15/20 , G06T19/006
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US11778154B2
公开(公告)日:2023-10-03
申请号:US16637087
申请日:2018-08-08
Applicant: Apple Inc.
Inventor: Vincent Chapdelaine-Couture , Anthony Ghannoum , Yan Cote , Irving Lustigman , Marc-Andre Chenier , Simon Fortin-Deschenes , Bertrand Nepveu
IPC: G06T19/00 , H04N9/75 , H04N13/344 , H04N5/265
CPC classification number: H04N9/75 , G06T19/006 , H04N5/265 , H04N13/344
Abstract: A Head-Mounted Display with camera sensors to perform chroma keying in a mixed reality context is presented. Low latency is achieved by embedding the processing in the HMD itself, specifically, format camera images, detect the selected color range and make a composite with the virtual content.
-
公开(公告)号:US20230053205A1
公开(公告)日:2023-02-16
申请号:US17979630
申请日:2022-11-02
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US11521291B1
公开(公告)日:2022-12-06
申请号:US17215151
申请日:2021-03-29
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
Abstract: In some implementations, a method of reducing latency associated with an image read-out operation is performed at a device including one or more processors, non-transitory memory, an image processing architecture, and an image capture device. The method includes: obtaining first image data corresponding to a physical environment; reading a first slice of the first image data into an input buffer; performing processing operations on the first slice of the first image data to obtain a first portion of second image data; reading a second slice of the first image data into the input buffer; performing the image processing operations on the second slice of the first image data to obtain a second portion of the second image data; and generating an image frame of the physical environment based at least in part on the first and second portions of the second image data.
-
公开(公告)号:US12125123B2
公开(公告)日:2024-10-22
申请号:US18209643
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T5/73 , G06T5/90 , G06T7/73 , G06T15/005 , G06T15/20 , G06T19/006
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
公开(公告)号:US12094069B2
公开(公告)日:2024-09-17
申请号:US18233653
申请日:2023-08-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T19/00 , G06F3/01 , G06F3/16 , G06T5/00 , G06T11/00 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F7/32
CPC classification number: G06T19/006 , G06F3/011 , G06F3/165 , G06T5/00 , G06T11/00 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138 , G02B27/0179 , G06F7/32
Abstract: The present disclosure relates to techniques for presenting a combined view of a virtual environment and a real environment in response to detecting a transition event associated with an object in the real environment. While presenting the combined view, if an input of a first type is detected, the combined view is adjusted by increasing the visibility of imagery of the virtual environment and decreasing the visibility of imagery of the real environment. If an input of a second type is detected, the combined view is adjusted by decreasing the visibility of the imagery of the virtual environment and increasing the visibility of the imagery of the real environment.
-
公开(公告)号:US11880911B2
公开(公告)日:2024-01-23
申请号:US17272025
申请日:2019-09-06
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T11/00 , G06F3/16 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F3/01
CPC classification number: G06T11/00 , G02B27/0179 , G06F3/011 , G06F3/165 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138
Abstract: The present disclosure relates to techniques for transitioning between imagery and sounds of two different environments, such as a virtual environment and a real environment. A view of a first environment and audio associated with the first environment are provided. In response to detecting a transition event, a view of the first environment combined with a second environment is provided. The combined view includes imagery of the first environment at a first visibility value and imagery of the second environment at a second visibility value. In addition, in response to detecting a transition event, the first environment audio is mixed with audio associated with the second environment.
-
公开(公告)号:US11790569B2
公开(公告)日:2023-10-17
申请号:US17272251
申请日:2019-09-06
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Sandy J. Carter , Vincent Chapdelaine-Couture , Marc-Andre Chenier , Yan Cote , Simon Fortin-Deschênes , Anthony Ghannoum , Tomlinson Holman , Marc-Olivier Lepage , Yves Millette
IPC: G06T11/00 , G06F3/16 , H04N13/117 , H04N13/156 , H04N13/194 , G02B27/01 , G06F3/01
CPC classification number: G06T11/00 , G02B27/0179 , G06F3/011 , G06F3/165 , H04N13/117 , H04N13/156 , H04N13/194 , G02B2027/0138
Abstract: The present disclosure relates to techniques for inserting imagery from a real environment into a virtual environment. While presenting (e.g., displaying) the virtual environment at an electronic device, a proximity of the electronic device to a physical object located in a real environment is detected. In response to detecting that the proximity of the electronic device to the physical object is less than a first threshold distance, imagery of the physical object is isolated from other imagery of the real environment. The isolated imagery of the physical object is inserted into the virtual environment at a location corresponding to the location of the physical object in the real environment. The imagery of the physical object has a first visibility value associated with the proximity of the electronic device to the physical object.
-
公开(公告)号:US20230325965A1
公开(公告)日:2023-10-12
申请号:US18209643
申请日:2023-06-14
Applicant: Apple Inc.
Inventor: Bertrand Nepveu , Marc-Andre Chenier , Yan Cote , Yves Millette
CPC classification number: G06T1/20 , G06T19/006 , G06T7/73 , G06T15/20 , G06T5/003 , G06T15/005 , G06T5/007
Abstract: In some implementations, a method includes: determining a complexity value for first image data associated with of a physical environment that corresponds to a first time period; determining an estimated composite setup time based on the complexity value for the first image data and virtual content for compositing with the first image data; in accordance with a determination that the estimated composite setup time exceeds the threshold time: forgoing rendering the virtual content from the perspective that corresponds to the camera pose of the device relative to the physical environment during the first time period; and compositing a previous render of the virtual content for a previous time period with the first image data to generate the graphical environment for the first time period.
-
-
-
-
-
-
-
-
-