-
公开(公告)号：US20240144431A1
公开(公告)日：2024-05-02
申请号：US18497862
申请日：2023-10-30
发明人： Zheng Shi , Grace Elizabeth Kuo , Yujia Chen , Daniel Andersen , Chao Li , Richard Andrew Newcombe , Michael Goesele
CPC分类号： G06T3/4053 , G02B27/4205 , G06T5/20 , G06T5/50 , G06T7/11 , H04N23/88 , H04N23/90 , H04N23/951 , G06T2207/20021 , G06T2207/20081 , G06T2207/20084 , G06T2207/20221
摘要： In particular embodiments, a computing system may capture a first image of a scene using a first camera of an artificial reality device. The system may capture a second image of the scene using a second camera and one or more optical elements of the artificial reality device. The second image may include an overlapping portion of multiple shifted copies of the scene. The system may generate an upsampled first image by applying a particular sampling technique to the first image. The system may generate a tiled image comprising a plurality of repeated second images by applying a tiling process to the second image. The system may generate an initial output image by processing the upsampled first image and the tiled image using a machine learning model. The system may generate a final output image by normalizing the initial output image using the upsampled first image.
-
公开(公告)号：US20240119609A1
公开(公告)日：2024-04-11
申请号：US18484195
申请日：2023-10-10
发明人： Michael Goesele , Richard Andrew Newcombe , Yujia Chen , Florian Eddy Robert Ilg , Daniel Andersen , Chao Li , Simon Gareth Green
摘要： A distributed imaging system for augmented reality devices is disclosed. The system includes a computing module in communication with a plurality of spatially distributed sensing devices. The computing module is configured to process input images from the sensing devices based on performing a local feature matching computation to generate corresponding first output images. The computing module is further configured to process the input images based on performing an optical flow correspondence computation to generate corresponding second output images. The computing module is further configured to computationally combine first and second output images to generate third output images.
-
公开(公告)号：US11804010B2
公开(公告)日：2023-10-31
申请号：US18069896
申请日：2022-12-21
发明人： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
CPC分类号： G06T17/10 , G06T7/97 , G06T17/20 , G06T19/006
摘要： In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.
-
公开(公告)号：US11562534B2
公开(公告)日：2023-01-24
申请号：US17541907
申请日：2021-12-03
发明人： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
摘要： In one embodiment, a method includes instructing, at a first time, a camera having a plurality of pixel sensors to capture a first image of an environment comprising an object to determine a first object pose; determining, based on the first object pose, a predicted object pose of the object at a second time; generating pixel-activation instructions based on a buffer region around a projection of a 3D model of the object having the predicted object pose onto a virtual image plane associated with a predicted camera pose, where the size of the buffer region may be dependent on predicted dynamics for the object; instructing, at the second time, the camera to use a subset of the plurality of pixel sensors to capture a second image of the environment according to the pixel-activation instructions, and; determining, based on the second image, a second object pose of the object.
-
公开(公告)号：US20230119703A1
公开(公告)日：2023-04-20
申请号：US18069896
申请日：2022-12-21
发明人： Steven John Lovegrove , Richard Andrew Newcombe , Andrew Samuel Berkovich , Lingni Ma , Chao Li
摘要： In one embodiment, a computing system instructs, at a first time, a camera having a plurality of pixel sensors to use the plurality of pixel sensors to capture a first image of an environment comprising an object. The computing system predicts, using at least the first image, a projection of the object appearing in a virtual image plane associated with a predicted camera pose at a second time. The computing system determines, based on the predicted projection of the object, a first region of pixels and a second region of pixels. The computing system generates pixel-activation instructions for the first region of pixels and the second region of pixels. The computing system instructs the camera to capture a second image of the environment at the second time according to the pixel-activation instructions. The pixel-activation instructions are configured to cause a first subset of the plurality of pixel sensors to sample the first region of pixels and a second subset of the plurality of pixel sensors to sample the second region of pixels. The first subset of the plurality of pixel sensors used for sampling the first region of pixels is more dense than the second subset of the plurality of pixel sensors used for sampling the second region of pixels. The computing system tracks, based on the second image, the object at the second time.
-
-
-
-
搜索结果
5 条记录 (耗时 0.015 秒)
