-
公开(公告)号：US11587210B1
公开(公告)日：2023-02-21
申请号：US16816023
申请日：2020-03-11
Applicant: Meta Platforms Technologies, LLC
Inventor： Yu Fan Chen , Kiran Kumar Somasundaram , Steven John Lovegrove , Yujun Shen
Abstract: In one embodiment, a method includes a computer system accessing a curvilinear image captured using a camera lens, generating multiple rectilinear images from the curvilinear image based at least in part on one or more calibration parameters associated with the camera lens, identifying semantic information in one or more of the rectilinear images by processing each of the multiple rectilinear images using a machine-learning model configured to identify semantic information in rectilinear images, and identifying semantic information in the curvilinear image based on the identified semantic information in the one or more rectilinear images.
-
公开(公告)号：US11804010B2
公开(公告)日：2023-10-31
申请号：US18069896
申请日：2022-12-21
Applicant: Meta Platforms Technologies, LLC
Inventor： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
CPC classification number: G06T17/10 , G06T7/97 , G06T17/20 , G06T19/006
Abstract: In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.
-
公开(公告)号：US11587254B2
公开(公告)日：2023-02-21
申请号：US16904327
申请日：2020-06-17
Applicant: Meta Platforms Technologies, LLC
Inventor： Huixuan Tang , Hauke Malte Strasdat , Qi Guo , Steven John Lovegrove
Abstract: Raycast-based calibration techniques are described for determining calibration parameters associated with components of a head mounted display (HMD) of an augmented reality (AR) system having one or more off-axis reflective combiners. In an example, a system comprises an image capture device and a processor executing a calibration engine. The calibration engine is configured to determine correspondences between target points and camera pixels based on images of the target acquired through an optical system, the optical system including optical surfaces and an optical combiner. Each optical surface is defined by a difference of optical index on opposing sides of the surface. At least one calibration parameter for the optical system is determined by mapping rays from each camera pixel to each target point via raytracing through the optical system, the raytracing being based on the index differences, shapes, and positions of the optical surfaces relative to the one or more cameras.
-
公开(公告)号：US11562534B2
公开(公告)日：2023-01-24
申请号：US17541907
申请日：2021-12-03
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
Abstract: In one embodiment, a method includes instructing, at a first time, a camera having a plurality of pixel sensors to capture a first image of an environment comprising an object to determine a first object pose; determining, based on the first object pose, a predicted object pose of the object at a second time; generating pixel-activation instructions based on a buffer region around a projection of a 3D model of the object having the predicted object pose onto a virtual image plane associated with a predicted camera pose, where the size of the buffer region may be dependent on predicted dynamics for the object; instructing, at the second time, the camera to use a subset of the plurality of pixel sensors to capture a second image of the environment according to the pixel-activation instructions, and; determining, based on the second image, a second object pose of the object.
-
公开(公告)号：US11488324B2
公开(公告)日：2022-11-01
申请号：US16518862
申请日：2019-07-22
Applicant: Meta Platforms Technologies, LLC
Inventor： Steven John Lovegrove , Yuheng Ren
Abstract: In one embodiment, a method includes accessing a calibration model for a camera rig. The method includes accessing multiple observations of an environment captured by the camera rig from multiple poses in the environment. The method includes generating an environmental model including geometry of the environment based on at least the observations, the poses, and the calibration model. The method includes determining, for one or more of the poses, one or more predicted observations of the environment based on the environmental model and the poses. The method includes comparing the predicted observations to the observations corresponding to the poses from which the predicted observations were determined. The method includes revising the calibration model based on the comparison. The method includes revising the environmental model based on at least a set of observations of the environment and the revised calibration model.
-
Patent Agency Ranking
公开(公告)号：US12243273B2
公开(公告)日：2025-03-04
申请号：US17571285
申请日：2022-01-07
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： Zhaoyang Lv , Miroslava Slavcheva , Tianye Li , Michael Zollhoefer , Simon Gareth Green , Tanner Schmidt , Michael Goesele , Steven John Lovegrove , Christoph Lassner , Changil Kim
IPC: G06T7/00
Abstract: In one embodiment, a method includes initializing latent codes respectively associated with times associated with frames in a training video of a scene captured by a camera. For each of the frames, a system (1) generates rendered pixel values for a set of pixels in the frame by querying NeRF using the latent code associated with the frame, a camera viewpoint associated with the frame, and ray directions associated with the set of pixels, and (2) updates the latent code associated with the frame and the NeRF based on comparisons between the rendered pixel values and original pixel values for the set of pixels. Once trained, the system renders output frames for an output video of the scene, wherein each output frame is rendered by querying the updated NeRF using one of the updated latent codes corresponding to a desired time associated with the output frame.
-
公开(公告)号：US20230119703A1
公开(公告)日：2023-04-20
申请号：US18069896
申请日：2022-12-21
Applicant: Meta Platforms Technologies, LLC
Inventor： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
Abstract: In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.
-
公开(公告)号：US11762080B2
公开(公告)日：2023-09-19
申请号：US17109724
申请日：2020-12-02
Applicant: Meta Platforms Technologies, LLC
Inventor： Minh Phuoc Vo , Kiran Kumar Somasundaram , Steven John Lovegrove
CPC classification number: G01S13/52 , G01S7/415 , G01S13/003 , G01S13/04 , H04W56/0055 , H04W84/12 , G01S2013/462
Abstract: A method includes receiving a first wireless signal detected by a first device in an environment, the first wireless signal including a first distortion pattern caused by an object moving in the environment, receiving a second wireless signal detected by a second device in the environment, the second wireless signal including a second distortion pattern caused by the object moving in the environment, determining, by comparing the first distortion pattern to the second distortion pattern, that the first distortion pattern and the second distortion pattern correspond to a same movement event associated with the object moving in the environment, determining a timing offset between the first device and the second device based on information associated with the first distortion pattern and the second distortion pattern, and determining, based on the timing offset, temporal correspondences between data generated by the first device and data generated by the second device.
-
公开(公告)号：US11676293B2
公开(公告)日：2023-06-13
申请号：US17122609
申请日：2020-12-15
Applicant: META PLATFORMS TECHNOLOGIES, LLC
Inventor： James Steven Hegarty , Zijian Wang , Steven John Lovegrove , Yongjun Kim , Rajesh Lachhmandas Chhabria
Abstract: A method for depth sensing from an image of a projected pattern is performed at an electronic device with one or more processors and memory. The method includes receiving an image of a projection of an illumination pattern; for a portion of the image, selecting a candidate image of a plurality of candidate images by comparing the portion of the image with a plurality of candidate images; and determining a depth for the portion of the image based on depth information associated with the selected candidate image. Related electronic devices and computer readable storage medium are also disclosed.
-
公开(公告)号：US20230169686A1
公开(公告)日：2023-06-01
申请号：US18051370
申请日：2022-10-31
Applicant: Meta Platforms Technologies, LLC
Inventor： Steven John Lovegrove , Yuheng Ren
CPC classification number: G06T7/80 , G06T7/521 , G06T2207/30244
Abstract: In one embodiment, a method includes accessing a calibration model for a camera rig. The method includes accessing multiple observations of an environment captured by the camera rig from multiple poses in the environment. The method includes generating an environmental model including geometry of the environment based on at least the observations, the poses, and the calibration model. The method includes determining, for one or more of the poses, one or more predicted observations of the environment based on the environmental model and the poses. The method includes comparing the predicted observations to the observations corresponding to the poses from which the predicted observations were determined. The method includes revising the calibration model based on the comparison. The method includes revising the environmental model based on at least a set of observations of the environment and the revised calibration model.
-
-
-
-
-
-
-
-
-
Search Results
11
records
(took 0.018 seconds)
