-
公开(公告)号：US11887267B2
公开(公告)日：2024-01-30
申请号：US17369354
申请日：2021-07-07
Applicant: Meta Platforms Technologies, LLC
Inventor： Christopher James Goodman , Gregory Mayo Daly
CPC classification number: G06T19/20 , G06T7/75 , G06T15/04 , G06T15/506 , G06T2200/08 , G06T2207/30196 , G06T2210/12 , G06T2210/62 , G06T2219/2004
Abstract: A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.
-
公开(公告)号：US11562529B2
公开(公告)日：2023-01-24
申请号：US17356427
申请日：2021-06-23
Applicant: Meta Platforms Technologies, LLC
Inventor： Gregory Mayo Daly , Nicholas McGee
Abstract: A method includes generating a depth map of a real environment as seen from a viewpoint that comprises pixels having corresponding depth values of one or more physical objects. Based on the depth map a two-dimensional occlusion surface is generated representing at least a visible portion of the one or more physical objects that are located within a predetermined depth range defined relative to the viewpoint. The two-dimensional occlusion surface is posed in a three-dimensional coordinate system such that the two-dimensional occlusion surface is located at a predetermined distance from the viewpoint. The visibility of a virtual object is determined relative to the one or more physical objects by comparing a model of the virtual object with the two-dimensional occlusion surface, and an output image is generated based on the visibility of the virtual object.
-
Patent Agency Ranking
公开(公告)号：US20230009367A1
公开(公告)日：2023-01-12
申请号：US17369354
申请日：2021-07-07
Applicant: Meta Platforms Technologies, LLC
Inventor： Christopher James Goodman , Gregory Mayo Daly
Abstract: A method includes receiving an image of a real environment captured using a camera worn by a user, the image comprising a hand of the user and determining a pose of the hand based on the image. Based on a three-dimensional model of the hand having the determined pose, generating a two-dimensional surface representing the hand as viewed from a first viewpoint of the user and positioning the two-dimensional surface representing the hand and one or more virtual-object representations in a three-dimensional space. The method further includes determining that a portion of the two-dimensional surface representing the hand is visible from a second viewpoint in the three-dimensional space, and generating an output image, wherein a set of image pixels of the output image corresponding to the portion of the two-dimensional surface that is visible is configured to cause a display to tur off a set of corresponding display pixels.
-
公开(公告)号：US12169894B1
公开(公告)日：2024-12-17
申请号：US17938222
申请日：2022-10-05
Applicant: Meta Platforms Technologies, LLC
Inventor： Gregory Mayo Daly , Jack Thomas Lavier
Abstract: A method includes accessing a scene graph defining a spatial relationship of a plurality of first bounding boxes associated with a plurality of virtual objects in a field of view of a user of an artificial reality (AR) device; accessing a second bounding box associated with a first bounding box of the plurality of first bounding boxes; determining, based on the second bounding box, a subregion within a sensing region of a depth sensor; obtaining first depth data within the subregion; generating, based on the first depth data, a three-dimensional model for one or more real objects; determining a visibility of a first virtual object in the AR environment associated with the first bounding box based on the three-dimensional model for the one or more real objects; and generating an output image of an AR environment based on the determined visibility of the first virtual object.
-
5.发明公开公开(公告)号：US20230162436A1
公开(公告)日：2023-05-25
申请号：US18157003
申请日：2023-01-19
Applicant: Meta Platforms Technologies, LLC
Inventor： Gregory Mayo Daly , Nicholas McGee
CPC classification number: G06T15/205 , G06T7/50 , G06T19/006 , G06F3/012
Abstract: A method includes generating a depth map of a real environment as seen from a viewpoint that comprises pixels having corresponding depth values of one or more physical objects. A first two-dimensional occlusion surface is generated representing at least a visible portion of the one or more physical objects located within a first predetermined depth range defined relative to the viewpoint. A second two-dimensional occlusion surface is generated such that a minimum depth of a second predetermined depth range is greater than a maximum depth of the first predetermined depth range. The first and second occlusion surfaces are posed in a three-dimensional coordinate system. The visibility of a virtual object is determined relative to the one or more physical objects by comparing a model of the virtual object with the first and second occlusion surfaces, and an output image is generated based on the visibility of the virtual object.
-
公开(公告)号：US20230136064A1
公开(公告)日：2023-05-04
申请号：US17519437
申请日：2021-11-04
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Gregory Mayo Daly , Eugene Gorbatov
Abstract: In an embodiment, a method involves receiving a viewpoint from a headset, receiving, from applications, assets to be rendered using the viewpoint, determining, for each of the assets, a priority score, identifying, based on the determined priority scores, a first subset and a second subset of the assets, instructing a GPU to render, within a first GPU frame, a first superframe using the first subset, enqueuing the first superframe for transmission to the headset with a first priority and at a first pre-scheduled time, instructing the GPU to render, within a second GPU frame, a second superframe using the second subset, and enqueuing the second superframe for transmission to the headset with a second priority lower than the first priority and at a second pre-scheduled time, wherein the GPU has a GPU framerate faster than a pre-scheduled timing interval for transmitting data from the computing system to the headset.
-
公开(公告)号：US20220414973A1
公开(公告)日：2022-12-29
申请号：US17356427
申请日：2021-06-23
Applicant: Meta Platforms Technologies, LLC
Inventor： Gregory Mayo Daly , Nicholas McGee
Abstract: A method includes generating a depth map of a real environment as seen from a viewpoint that comprises pixels having corresponding depth values of one or more physical objects. Based on the depth map a two-dimensional occlusion surface is generated representing at least a visible portion of the one or more physical objects that are located within a predetermined depth range defined relative to the viewpoint. The two-dimensional occlusion surface is posed in a three-dimensional coordinate system such that the two-dimensional occlusion surface is located at a predetermined distance from the viewpoint. The visibility of a virtual object is determined relative to the one or more physical objects by comparing a model of the virtual object with the two-dimensional occlusion surface, and an output image is generated based on the visibility of the virtual object.
-
-
-
-
-
-
Search Results
7
records
(took 0.014 seconds)
