-
公开(公告)号:US12223581B2
公开(公告)日:2025-02-11
申请号:US17936363
申请日:2022-09-28
Applicant: Matterport, Inc.
Inventor: Kevin Balkoski , Eleanor Crane
IPC: G06T15/06 , G01S7/48 , G06F18/214
Abstract: An example method comprises simulating an environment including at least one simulated object, a simulated ray source, and a simulated receiver, simulating a plurality of rays emitting from the simulated ray source, tracking each ray in the environment, detecting changes for at least one ray that interacts with the at least one simulated object, the changes for the at least one ray including a reflection from the at least one object, tracking the reflection of the at least part of the ray from the at least one object in the environment, determining measurements for any of the plurality of rays that interact with the simulated receiver in the simulation, the at least part of the ray being received by the receiver, the measurements including intensity for any of the plurality of rays that interact with the receiver, and generating synthetic point cloud data based on the measurements.
-
公开(公告)号:US20240386687A1
公开(公告)日:2024-11-21
申请号:US18669442
申请日:2024-05-20
Applicant: Matterport, Inc.
Inventor: Matthew Bell , David Gausebeck , Michael Beebe
IPC: G06T19/20 , H04N13/10 , H04N13/106 , H04N13/156 , H04N13/204 , H04N13/246
Abstract: Systems and methods for building a three-dimensional composite scene are disclosed. Certain embodiments of the systems and methods may include the use of a three-dimensional capture device that captures a plurality of three-dimensional images of an environment. Some embodiments may further include elements concerning aligning and/or mapping the captured images. Various embodiments may further include elements concerning reconstructing the environment from which the images were captured. The methods disclosed herein may be performed by a program embodied on a non-transitory computer-readable storage medium when executed the program is executed a processor.
-
公开(公告)号:US12140679B2
公开(公告)日:2024-11-12
申请号:US18620966
申请日:2024-03-28
Applicant: Matterport, Inc.
Inventor: David Alan Gausebeck , Kirk Stromberg , Louis D. Marzano , David Proctor , Naoto Sakakibara , Simeon Trieu , Kevin Kane , Simon Wynn
IPC: G01S17/89 , G01S7/481 , G01S17/931 , G03B37/00 , H04N23/698
Abstract: An apparatus comprising a housing, a mount configured to be coupled to a motor to horizontally move the apparatus, a wide-angle lens coupled to the housing, the wide-angle lens being positioned above the mount thereby being along an axis of rotation, the axis of rotation being the axis along which the apparatus rotates, an image capture device within the housing, the image capture device configured to receive two-dimensional images through the wide-angle lens of environment, and a LiDAR device within the housing, the LiDAR device configured to generate depth data based on the environment.
-
4.
公开(公告)号:US20240179416A1
公开(公告)日:2024-05-30
申请号:US18435954
申请日:2024-02-07
Applicant: Matterport, Inc.
Inventor: David Alan Gausebeck , Kirk Stromberg , Louis D. Marzano , David Proctor , Naoto Sakakibara , Simeon Trieu , Kevin Kane , Simon Wynn
IPC: H04N23/698 , H04N5/222 , H04N5/265 , H04N23/90
CPC classification number: H04N23/698 , H04N5/2226 , H04N5/265 , H04N23/90
Abstract: An environmental capture system (ECS) captures image data and depth information in a 360-degree scene. The captured image data and depth information can be used to generate a 360-degree scene. The ECS comprises a frame, a drive train mounted to the frame, and an image capture device coupled to the drive train to capture, while pointed in a first direction, a plurality of images at different exposures in a first field of view (FOV) of the 360-degree scene. The ECS further comprises a depth information capture device coupled to the drive train. The depth information capture device and the image capture device are rotated by the drive train about a first, substantially vertical, axis from the first direction to a second direction. The depth information capture device, while being rotated from the first direction to the second direction, captures depth information for a first portion of the 360-degree scene. The image capture device captures, while pointed in the second direction, a plurality of images at different exposures in a second FOV that overlaps the first FOV of the 360-degree scene. The depth information capture device and the image capture device are rotated by the drive train about the first axis from the second direction to a third direction. The depth information capture device, while being rotated from the second direction to the third direction, captures depth information for a second portion of the 360-degree scene. The image capture device, while pointed in the third direction, captures a plurality of images at different exposures in a third FOV that overlaps the second FOV of the 360-degree scene.
-
公开(公告)号:US11734827B2
公开(公告)日:2023-08-22
申请号:US17317755
申请日:2021-05-11
Applicant: Matterport, Inc.
Inventor: Gary Bradski
IPC: G06T7/11 , G06T11/20 , G06T7/187 , G06N3/08 , G06F3/0488 , G06F3/04883
CPC classification number: G06T7/11 , G06F3/04883 , G06N3/08 , G06T7/187 , G06T11/203
Abstract: Systems and methods for user guided iterative frame and scene segmentation are disclosed herein. The systems and methods can rely on overtraining a segmentation network on a frame. A disclosed method includes selecting a frame from a scene and generating a frame segmentation using the frame and a segmentation network. The method also includes displaying the frame and frame segmentation overlain on the frame, receiving a correction input on the frame, and training the segmentation network using the correction input. The method includes overtraining the segmentation network for the scene by iterating the above steps on the same frame or a series of frames from the scene.
-
公开(公告)号:US20230199316A1
公开(公告)日:2023-06-22
申请号:US17644910
申请日:2021-12-17
Applicant: Matterport, Inc.
Inventor: Japjit Tulsi , Lou Marzano , Abhijit Limaye , David Lippman , David Alan Gausebeck
CPC classification number: H04N5/23299 , H04N5/2224 , G03B17/566 , G03B17/561
Abstract: An example system comprises a base with a bottom end and a top end opposite the bottom end, a motor within the base, the motor being coupled to a rotational component of the base and configured to turn the rotational component about an axis of rotation, the rotational component being at the top end of the base, the axis of rotation being perpendicular to the top end of the base, and an arm coupled to the rotational component, the arm configured to move a holding member above the top of the base, the holding member configurable to hold a digital device above the top end of the base, the arm being adjustable to position and tilt the holding member, the rotational component being capable of turning the arm and the holding member, the arm configured to tilt the holding member at a first angle relative to the arm.
-
公开(公告)号:US11677920B2
公开(公告)日:2023-06-13
申请号:US16559135
申请日:2019-09-03
Applicant: Matterport, Inc.
Inventor: Kyle Simek , David Gausebeck , Matthew Tschudy Bell
IPC: H04N13/106 , H04N5/265 , H04N13/254 , H04N13/239 , H04N13/232 , H04N13/271 , H04N23/45 , H04N23/698
CPC classification number: H04N13/106 , H04N5/265 , H04N13/232 , H04N13/239 , H04N13/254 , H04N13/271 , H04N23/45 , G06T2207/20221 , H04N23/698
Abstract: This application generally relates to capturing and aligning panoramic image and depth data. In one embodiment, a device is provided that comprises a housing and a plurality of cameras configured to capture two-dimensional images, wherein the cameras are arranged at different positions on the housing and have different azimuth orientations relative to a center point such that the cameras have a collective field-of-view spanning up to 360° horizontally. The device further comprises a plurality of depth detection components configured to capture depth data, wherein the depth detection components are arranged at different positions on the housing and have different azimuth orientations relative to the center point such that the depth detection components have the collective field-of-view spanning up to 360° horizontally.
-
公开(公告)号:US11551410B2
公开(公告)日:2023-01-10
申请号:US17372333
申请日:2021-07-09
Applicant: Matterport, Inc.
Inventor: Matthew Bell , Michael Beebe
Abstract: The present disclosure concerns a methodology that allows a user to “orbit” around a model on a specific axis of rotation and view an orthographic floor plan of the model. A user may view and “walk through” the model while staying at a specific height above the ground with smooth transitions between orbiting, floor plan, and walking modes.
-
公开(公告)号:US11263823B2
公开(公告)日:2022-03-01
申请号:US16141649
申请日:2018-09-25
Applicant: Matterport, Inc.
Inventor: David Alan Gausebeck , Babak Robert Shakib
IPC: G06T19/20 , H04N13/10 , H04N13/246 , H04N13/204 , H04N13/106 , H04N13/156 , G06T7/521 , G06T19/00 , G06T17/00 , G06T7/593 , H04N13/271 , G06T7/579 , H04N13/00
Abstract: The disclosed subject matter is directed to employing machine learning models configured to predict 3D data from 2D images using deep learning techniques to derive 3D data for the 2D images. In some embodiments, a method is provided that comprises employing, by a system comprising a processor, one or more three-dimensional data from two-dimensional data (3D-from-2D) neural network models to derive three-dimensional data from one or more two-dimensional images captured of an object or environment from a current perspective of the object or environment viewed on or through a display of the device. The method further comprises, determining, by the system, a position for integrating a graphical data object on or within a representation of the object or environment viewed on or through the display based on the current perspective and the three-dimensional data.
-
公开(公告)号:US11062509B2
公开(公告)日:2021-07-13
申请号:US16386910
申请日:2019-04-17
Applicant: Matterport, Inc.
Inventor: Matthew Bell , Michael Beebe
Abstract: The present disclosure concerns a methodology that allows a user to “orbit” around a model on a specific axis of rotation and view an orthographic floor plan of the model. A user may view and “walk through” the model while staying at a specific height above the ground with smooth transitions between orbiting, floor plan, and walking modes.
-
-
-
-
-
-
-
-
-