GEOMETRY-AWARE SEMANTICS SEGMENTATION WITH GRAVITY-NORMAL REGULARIZATION

    公开(公告)号:US20250086995A1

    公开(公告)日:2025-03-13

    申请号:US18463068

    申请日:2023-09-07

    Abstract: Disclosed are systems and techniques for image processing. For example, a computing device can generate, using a multi-task model, a segmentation output and a normal output based on image(s) of a scene and a gravity vector for the scene. The computing device can learn semantic prediction(s) based on comparing the segmentation output to at least one ground truth semantic segmentation map. The computing device can also learn normal prediction(s) based on comparing the normal output to at least one ground truth normal map. The computing device can extract a semantics normal from the semantic prediction(s) and the normal prediction(s). The computing device can optimize a regularization loss based on the semantics normal and the gravity vector for the scene by learning gravity-normal regularization(s) for the scene. The computing device can determine final semantic labels for regions of the scene based on the gravity-normal regularization(s).

Patent Agency Ranking