公开(公告)号：WO2022187769A1

公开(公告)日：2022-09-09

申请号：PCT/US2022/070332

申请日：2022-01-25

Applicant: FYUSION, INC.

Inventor： HOLZER, Stefan Johannes Josef ,  CHANDE, Krunal Ketan ,  MUNARO, Matteo ,  HANCHAR, Pavel ,  LIAUDANSKAS, Aidas ,  HWANG, Wook Yeon ,  MCCONNELL, Blake ,  NORDIN, Johan ,  VLASKI, Milos ,  WAWRO, Martin Markus Hubert ,  STETCO, Nick ,  SAELZLE, Martin

IPC: G06T3/40 ,  G06T15/20

Abstract: Images of an undercarriage of a vehicle may be captured via one or more cameras. A point cloud may be determined based on the images. The point cloud may includes points positioned in a virtual three-dimensional space. A stitched image may be determined based on the point cloud by projecting the point cloud onto a virtual camera view. The stitched image may be stored on a storage device.

公开(公告)号：WO2017065975A1

公开(公告)日：2017-04-20

申请号：PCT/US2016/054218

申请日：2016-09-28

Applicant: FYUSION, INC.

Inventor： HOLZER, Stefan Johannes Joseph ,  MILLER, Stephen David ,  BRUEN, Alexander Jay ,  SAELZLE, Martin ,  RUSU, Radu Bogdan

IPC: G06T19/00 ,  G06T7/40 ,  H04N13/02

CPC classification number: G06T19/006 ,  G06T13/20 ,  G06T2219/028

Abstract: Provided are mechanisms and processes for augmenting multi-view image data with synthetic objects using inertial measurement unit (TMU) and image data. In one example, a process includes receiving a selection of an anchor location in a reference image for a synthetic object to be placed within a multi-view image. Movements between the reference image and a target image are computed using visual tracking information associated with the multi-view image, device orientation corresponding to the multi-view image, and an estimate of the camera's intrinsic parameters. A first synthetic image is then generated by placing the synthetic object at the anchor location using visual tracking information in the multi-view image, orienting the synthetic object using the inverse of the movements computed between the reference image and the target image, and projecting the synthetic object along a ray into a target view associated with the target image. The first synthetic image is overlaid on the target image to generate an augmented image from the target view.

Abstract translation: 提供了使用惯性测量单元（TMU）和图像数据用合成对象增强多视点图像数据的机制和处理。 在一个示例中，过程包括接收对要置于多视图图像内的合成对象的参考图像中的锚定位置的选择。 使用与多视图图像相关联的视觉跟踪信息，与多视图图像对应的设备定向以及相机内在参数的估计来计算参考图像与目标图像之间的移动。 然后通过使用多视图图像中的视觉跟踪信息将合成对象置于锚定位置来生成第一合成图像，使用在参考图像与目标图像之间计算的运动的逆来定向合成对象， 将沿着光线的合成物体转换成与目标图像相关联的目标视图。 第一张合成图像叠加在目标图像上，以从目标视图生成增强图像。

公开(公告)号：WO2017011700A1

公开(公告)日：2017-01-19

申请号：PCT/US2016/042355

申请日：2016-07-14

Applicant: FYUSION, INC.

Inventor： HOLZER, Stefan Johannes Josef ,  MILLER, Stephen David ,  SAELZLE, Martin ,  RUSU, Radu Bogdan

IPC: G06K9/36

CPC classification number: G06K9/36 ,  G06K9/60

Abstract: Systems and methods for artificially rendering images using viewpoint interpolation and/or extrapolation estimate a transformation between first and second frames, where the first frame includes a first image captured from a first location and the second frame includes a second image captured from a second location. A rendered image corresponding to a third location positioned on a trajectory between the first and second locations is generated by interpolating a transformation from the first location to the third location and from the third location to the second location and gathering image information from the first frame and the second frame by transferring first image information from the first frame to the third frame based on the interpolated transformation and second image information from the second frame to the third frame based on the interpolated transformation. The first and second image information are then combined, and any occlusion is filled..

Abstract translation: 使用视点内插和/或外推人工渲染图像的系统和方法估计第一和第二帧之间的变换，其中第一帧包括从第一位置捕获的第一图像，并且第二帧包括从第二位置捕获的第二图像。 通过内插从第一位置到第三位置以及从第三位置到第二位置的变换来生成对应于位于第一和第二位置之间的轨迹上的第三位置的渲染图像，并从第一帧收集图像信息，以及 基于内插变换，基于插值变换从第二帧到第三帧的第二图像信息，将第一图像信息从第一帧传送到第三帧，从而第二帧。 然后组合第一和第二图像信息，并填充任何遮挡。