-
Patent Agency Ranking
公开(公告)号：US11062502B2
公开(公告)日：2021-07-13
申请号：US16379615
申请日：2019-04-09
Applicant: Facebook Technologies, LLC
Abstract: In one embodiment, a method includes accessing a number of pictures of an object, constructing a modeling volume for three-dimensional modeling of the object by processing the number of pictures using a machine-learning framework, where the modeling volume is associated with a number of color and opacity information that are associated with a number of regions in the modeling volume, and rendering an image of the object from a view-point using the modeling volume, where each pixel of the image is rendered by projecting a virtual ray from the view-point and through the modeling volume, determining one or more of the number of regions in the modeling volume intersected by the virtual ray, and determining a color and an opacity of the pixel based on an accumulation of the color and opacity information associated with the one or more of the number of regions intersected by the virtual ray.
-
公开(公告)号：US20200327718A1
公开(公告)日：2020-10-15
申请号：US16379615
申请日：2019-04-09
Applicant: Facebook Technologies, LLC
Abstract: In one embodiment, a method includes accessing a number of pictures of an object, constructing a modeling volume for three-dimensional modeling of the object by processing the number of pictures using a machine-learning framework, where the modeling volume is associated with a number of color and opacity information that are associated with a number of regions in the modeling volume, and rendering an image of the object from a view-point using the modeling volume, where each pixel of the image is rendered by projecting a virtual ray from the view-point and through the modeling volume, determining one or more of the number of regions in the modeling volume intersected by the virtual ray, and determining a color and an opacity of the pixel based on an accumulation of the color and opacity information associated with the one or more of the number of regions intersected by the virtual ray.
-
公开(公告)号：US11423616B1
公开(公告)日：2022-08-23
申请号：US16833360
申请日：2020-03-27
Applicant: Facebook Technologies, LLC
Inventor： Tomas Simon Kreuz , Jason Saragih , Stephen Anthony Lombardi , Shugao Ma , Gabriel Bailowitz Schwartz
Abstract: In one embodiment, a system may access an input image of an object captured by cameras, and the input image depicts appearance information associated with an object. The system may generate a first mesh of the object based on features identified from the input image of the object. The system may generate, by processing the first mesh using a machine-learning model, a position map that defines a contour of the object. Each pixel in the position map corresponds to a three-dimensional coordinate. The system may further generate a second mesh based on the position map, wherein the second mesh has a higher resolution than the first mesh. The system may render an output image of the object based on the second mesh. The system disclosed in the present application can render a dense mesh which has a higher resolution to provide details which cannot be compensated by texture information.
-
公开(公告)号：US20220245910A1
公开(公告)日：2022-08-04
申请号：US17554992
申请日：2021-12-17
Applicant: Facebook Technologies, LLC
Inventor： Stephen Anthony Lombardi , Tomas Simon Kreuz , Jason Saragih , Gabriel Bailowitz Schwartz , Michael Zollhoefer , Yaser Sheikh
Abstract: A method for training a real-time, modeling for animating an avatar for a subject is provided. The method includes collecting multiple images of a subject. The method also includes selecting a plurality of vertex positions in a guide mesh, indicative of a volumetric primitive enveloping the subject, determining a geometric attribute for the volumetric primitive including a position, a rotation, and a scale factor of the volumetric primitive, determining a payload attribute for each of the volumetric primitive, the payload attribute including a color value and an opacity value for each voxel in a voxel grid defining the volumetric primitive, determining a loss factor for each point in the volumetric primitive based on the geometric attribute, the payload attribute and a ground truth value, and updating a three-dimensional model for the subject. A system and a non-transitory, computer-readable medium storing instructions to perform the above method are also provided.
-
公开(公告)号：US11010951B1
公开(公告)日：2021-05-18
申请号：US16739040
申请日：2020-01-09
Applicant: Facebook Technologies, LLC
Inventor： Gabriel Bailowitz Schwartz , Jason Saragih , Tomas Simon Kreuz , Shih-En Wei , Stephen Anthony Lombardi
Abstract: In one embodiment, a system may capture one or more images of a user using one or more cameras, the one or more images depicting at least an eye and a face of the user. The system may determine a direction of a gaze of the user based on the eye depicted in the one or more images. The system may generate a facial mesh based on depth measurements of one or more features of the face depicted in the one or more images. The system may generate an eyeball texture for an eyeball mesh by processing the direction of the gaze and the facial mesh using a machine-learning model. The system may render an avatar of the user based on the eyeball mesh, the eyeball texture, the facial mesh, and a facial texture.
-
-
-
-
Search Results
5
records
(took 0.028 seconds)
