公开(公告)号：US20240404296A1

公开(公告)日：2024-12-05

申请号：US18327643

申请日：2023-06-01

Applicant: NVIDIA Corporation

Inventor： Shagan Sah ,  Niranjan Avadhanam ,  Rajath Shetty ,  Ratin Kumar ,  Yile Chen

IPC: G06V20/58 ,  G06T7/20 ,  G06T7/50 ,  G06V10/764 ,  G06V20/59 ,  G08B13/196

Abstract: In various examples, low power proximity based threat detection using optical flow for vehicle systems and applications are provided. Some embodiments may use a tiered framework that uses sensor fusion techniques to detect and track the movement of a threat candidate, and perform a threat classification and/or intent prediction as the threat candidate approaches approach. Relative depth indications from optical flow, computed using data from image sensors, can be used to initially segment and track a moving object over a sequence of image frames. Additional sensors and processing may be brought online when a moving object becomes close enough to be considered a higher risk threat candidate. A threat response system may generate a risk score based on a predicted intent of a threat candidate, and when the risk score exceeds a certain threshold, then the threat response system may respond accordingly based on the threat classification and/or risk score.