ADAPTIVE HUMAN INSTANCE SEGMENTATION WITH STEREO VIEW CONSISTENCY

    公开(公告)号:US20250086946A1

    公开(公告)日:2025-03-13

    申请号:US18463756

    申请日:2023-09-08

    Abstract: A system stores first and second images generated by first and second cameras; applies a segmentation model to the first image to generate a first segmentation mask identifying object instances; applies the segmentation model to the second image to generate a second segmentation mask identifying the object instances; projects the first segmentation mask to a viewpoint of the second camera to generate a first projected segmentation mask; converts the first projected segmentation mask and the second segmentation mask to first and second semantic masks, respectively; and computes a first similarity value based on the first and second semantic masks. This may be repeated exchanging the first and second images to compute a second similarity value. The system determines a loss value based on the first similarity value and the second similarity value and trains the segmentation model based on the loss value.

    WARPING-FREE MOTION GUIDED FEATURE REFERENCING FOR CONSISTENT VIDEO SEGMENTATION

    公开(公告)号:US20250078547A1

    公开(公告)日:2025-03-06

    申请号:US18461366

    申请日:2023-09-05

    Abstract: An example system include one or more memories and one or more processors coupled to the one or more memories. The one or more processors are configured to perform a first segmentation operation on a previous frame of image data to generate first segmentation data. The one or more processors are configured to perform a deformable convolution operation based on the first segmentation data to generate a deformable convolution output. The one or more processors are configured to perform a second segmentation operation on a current frame of image data to generate second segmentation data. The one or more processors are configured to combine the deformable convolution output with the second segmentation data to generate third segmentation data and control operation of a device based on the third segmentation data.

Patent Agency Ranking