公开(公告)号：US20230316458A1

公开(公告)日：2023-10-05

申请号：US18173589

申请日：2023-02-23

Applicant: NVIDIA Corporation

Inventor： Yuzhuo REN ,  Kenneth TURKOWSKI ,  Nuri Murat ARAR ,  Orazio GALLO ,  Jan KAUTZ ,  Niranjan AVADHANAM ,  Hang SU

IPC: G06T3/40 ,  G06T7/73

CPC classification number: G06T3/4038 ,  G06T7/74

Abstract: In various examples, dynamic seam placement is used to position seams in regions of overlapping image data to avoid crossing salient objects or regions. Objects may be detected from image frames representing overlapping views of an environment surrounding an ego-object such as a vehicle. The images may be aligned to create an aligned composite image or surface (e.g., a panorama, a 360° image, bowl shaped surface) with regions of overlapping image data, and a representation of the detected objects and/or salient regions (e.g., a saliency mask) may be generated and projected onto the aligned composite image or surface. Seams may be positioned in the overlapping regions to avoid or minimize crossing salient pixels represented in the projected masks, and the image data may be blended at the seams to create a stitched image or surface (e.g., a stitched panorama, stitched 360° image, stitched textured surface).

公开(公告)号：US20230319218A1

公开(公告)日：2023-10-05

申请号：US18173603

申请日：2023-02-23

Applicant: NVIDIA Corporation

Inventor： Yuzhuo REN ,  Nuri Murat ARAR ,  Orazio GALLO ,  Jan KAUTZ ,  Niranjan AVADHANAM ,  Hang SU

IPC: H04N5/262 ,  G06V20/56

CPC classification number: H04N5/2624 ,  G06V20/56

Abstract: In various examples, a state machine is used to select between a default seam placement or dynamic seam placement that avoids salient regions, and to enable and disable dynamic seam placement based on speed of ego-motion, direction of ego-motion, proximity to salient objects, active viewport, driver gaze, and/or other factors. Images representing overlapping views of an environment may be aligned to create an aligned composite image or surface (e.g., a panorama, a 360° image, bowl shaped surface) with overlapping regions of image data, and a default or dynamic seam placement may be selected based on driving scenario (e.g., driving direction, speed, proximity to nearby objects). As such, seams may be positioned in the overlapping regions of image data, and the image data may be blended at the seams to create a stitched image or surface (e.g., a stitched panorama, stitched 360° image, stitched textured surface).