IMAGE STITCHING WITH DYNAMIC SEAM PLACEMENT BASED ON OBJECT SALIENCY FOR SURROUND VIEW VISUALIZATION

    公开(公告)号:US20230316458A1

    公开(公告)日:2023-10-05

    申请号:US18173589

    申请日:2023-02-23

    CPC classification number: G06T3/4038 G06T7/74

    Abstract: In various examples, dynamic seam placement is used to position seams in regions of overlapping image data to avoid crossing salient objects or regions. Objects may be detected from image frames representing overlapping views of an environment surrounding an ego-object such as a vehicle. The images may be aligned to create an aligned composite image or surface (e.g., a panorama, a 360° image, bowl shaped surface) with regions of overlapping image data, and a representation of the detected objects and/or salient regions (e.g., a saliency mask) may be generated and projected onto the aligned composite image or surface. Seams may be positioned in the overlapping regions to avoid or minimize crossing salient pixels represented in the projected masks, and the image data may be blended at the seams to create a stitched image or surface (e.g., a stitched panorama, stitched 360° image, stitched textured surface).

    TECHNIQUES FOR REGISTERING AND WARPING IMAGE STACKS
    2.
    发明申请
    TECHNIQUES FOR REGISTERING AND WARPING IMAGE STACKS 有权
    用于注册和加密图像堆栈的技术

    公开(公告)号:US20140118402A1

    公开(公告)日:2014-05-01

    申请号:US13874357

    申请日:2013-04-30

    CPC classification number: G06T5/50 G06T5/005 G06T2207/20208 G06T2207/20221

    Abstract: A set of images is processed to modify and register the images to a reference image in preparation for blending the images to create a high-dynamic range image. To modify and register a source image to a reference image, a processing unit generates correspondence information for the source image based on a global correspondence algorithm, generates a warped source image based on the correspondence information, estimates one or more color transfer functions for the source image, and fills the holes in the warped source image. The holes in the warped source image are filled based on either a rigid transformation of a corresponding region of the source image or a transformation of the reference image based on the color transfer functions.

    Abstract translation: 处理一组图像以将图像修改并注册到参考图像,以准备混合图像以创建高动态范围图像。 为了将源图像修改并注册到参考图像,处理单元基于全局对应算法生成源图像的对应信息,基于对应信息生成翘曲源图像,估计源的一个或多个颜色传递函数 图像,并填充翘曲的源图像中的孔。 基于源图像的相应区域的刚性变换或基于颜色传递函数的参考图像的变换来填充翘曲源图像中的孔。

    INTERACTION WITH AND DISPLAY OF PHOTOGRAPHIC IMAGES IN AN IMAGE STACK
    3.
    发明申请
    INTERACTION WITH AND DISPLAY OF PHOTOGRAPHIC IMAGES IN AN IMAGE STACK 有权
    在图像堆栈中与摄影图像的交互和显示

    公开(公告)号:US20140079279A1

    公开(公告)日:2014-03-20

    申请号:US13870901

    申请日:2013-04-25

    Abstract: A number of images of a scene are captured and stored. The images are captured over a range of values for an attribute (e.g., a camera setting). One of the images is displayed. A location of interest in the displayed image is identified. Regions that correspond to the location of interest are identified in each of the images. Those regions are evaluated to identify which of the regions is rated highest with respect to the attribute relative to the other regions. The image that includes the highest-rated region is then displayed.

    Abstract translation: 捕获并存储场景的许多图像。 图像被捕获在属性值范围(例如,相机设置)上。 其中一个图像被显示。 识别显示图像中感兴趣的位置。 在每个图像中识别对应于感兴趣位置的区域。 对这些区域进行评估,以确定哪个区域相对于其他区域的属性的额定值最高。 然后显示包含最高等级区域的图像。

    IMAGE STITCHING WITH DYNAMIC SEAM PLACEMENT BASED ON EGO-VEHICLE STATE FOR SURROUND VIEW VISUALIZATION

    公开(公告)号:US20230319218A1

    公开(公告)日:2023-10-05

    申请号:US18173603

    申请日:2023-02-23

    CPC classification number: H04N5/2624 G06V20/56

    Abstract: In various examples, a state machine is used to select between a default seam placement or dynamic seam placement that avoids salient regions, and to enable and disable dynamic seam placement based on speed of ego-motion, direction of ego-motion, proximity to salient objects, active viewport, driver gaze, and/or other factors. Images representing overlapping views of an environment may be aligned to create an aligned composite image or surface (e.g., a panorama, a 360° image, bowl shaped surface) with overlapping regions of image data, and a default or dynamic seam placement may be selected based on driving scenario (e.g., driving direction, speed, proximity to nearby objects). As such, seams may be positioned in the overlapping regions of image data, and the image data may be blended at the seams to create a stitched image or surface (e.g., a stitched panorama, stitched 360° image, stitched textured surface).

    METHODS AND APPARATUS FOR REGISTERING AND WARPING IMAGE STACKS
    7.
    发明申请
    METHODS AND APPARATUS FOR REGISTERING AND WARPING IMAGE STACKS 有权
    用于注册和加密图像堆栈的方法和装置

    公开(公告)号:US20140119595A1

    公开(公告)日:2014-05-01

    申请号:US13660931

    申请日:2012-10-25

    CPC classification number: G06T3/0081

    Abstract: A set of images is processed to modify and register the images to a reference image in preparation for blending the images to create a high-dynamic range image. To modify and register a source image to a reference image, a processing unit generates a correspondence map for the source image based on a non-rigid dense correspondence algorithm, generates a warped source image based on the correspondence map, estimates one or more color transfer functions for the source image, and fills the holes in the warped source image. The holes in the warped source image are filled based on either a rigid transformation of a corresponding region of the source image or a transformation of the reference image based on the color transfer functions.

    Abstract translation: 处理一组图像以将图像修改并注册到参考图像,以准备混合图像以创建高动态范围图像。 为了将源图像修改并注册到参考图像,处理单元基于非刚性密集对应算法生成源图像的对应图,基于对应图生成翘曲源图像,估计一个或多个颜色转移 用于源图像的功能,并填充翘曲的源图像中的孔。 基于源图像的相应区域的刚性变换或基于颜色传递函数的参考图像的变换来填充翘曲源图像中的孔。

Patent Agency Ranking