公开(公告)号：US20230356728A1

公开(公告)日：2023-11-09

申请号：US18144651

申请日：2023-05-08

Applicant: NVIDIA Corporation

Inventor： Anshul Jain ,  Ratin Kumar ,  Feng Hu ,  Niranjan Avadhanam ,  Atousa Torabi ,  Hairong Jiang ,  Ram Ganapathi ,  Taek Kim

IPC: B60W30/18 ,  B60W50/00 ,  B60W40/08 ,  G06V40/19 ,  G05B13/02 ,  G05D1/00 ,  G06F18/25 ,  G06V10/141 ,  G06V20/59

CPC classification number: B60W50/0098 ,  B60W30/18 ,  B60W40/08 ,  G05B13/027 ,  G05D1/0061 ,  G06F18/251 ,  G06V10/141 ,  G06V20/597 ,  G06V40/19 ,  B60W2040/0836 ,  B60W2540/26 ,  H04N23/71

Abstract: Approaches for an advanced AI-assisted vehicle can utilize an extensive suite of sensors inside and outside the vehicle, providing information to a computing platform running one or more neural networks. The neural networks can perform functions such as facial recognition, eye tracking, gesture recognition, head position, and gaze tracking to monitor the condition and safety of the driver and passengers. The system also identifies and tracks body pose and signals of people inside and outside the vehicle to understand their intent and actions. The system can track driver gaze to identify objects the driver might not see, such as cross-traffic and approaching cyclists. The system can provide notification of potential hazards, advice, and warnings. The system can also take corrective action, which may include controlling one or more vehicle subsystems, or when necessary, autonomously controlling the entire vehicle. The system can work with vehicle systems for enhanced analytics and recommendations.

公开(公告)号：US20230410650A1

公开(公告)日：2023-12-21

申请号：US18462287

申请日：2023-09-06

Applicant: NVIDIA Corporation

Inventor： Ambrish Dantrey ,  Atousa Torabi ,  Anshul Jain ,  Ram Ganapathi ,  Abhijit Patait ,  Revanth Reddy Nalla ,  Niranjan Avadhanam

IPC: G08G1/0965 ,  H04R3/00 ,  G08G1/0967 ,  G06N3/048

CPC classification number: G08G1/0965 ,  H04R3/005 ,  G08G1/096708 ,  G06N3/048 ,  H04R2430/20

Abstract: In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data.

公开(公告)号：US11816987B2

公开(公告)日：2023-11-14

申请号：US16951224

申请日：2020-11-18

Applicant: NVIDIA Corporation

Inventor： Ambrish Dantrey ,  Atousa Torabi ,  Anshul Jain ,  Ram Ganapathi ,  Abhijit Patait ,  Revanth Reddy Nalla ,  Niranjan Avadhanam

IPC: G08G1/0965 ,  H04R3/00 ,  G08G1/0967 ,  G06N3/048

CPC classification number: G08G1/0965 ,  G06N3/048 ,  G08G1/096708 ,  H04R3/005 ,  H04R2430/20

Abstract: In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data. The locations, direction of travel, and/or siren type may allow an ego-vehicle or ego-machine to identify an emergency response vehicle and to make planning and/or control decisions in response.

公开(公告)号：US20220157165A1

公开(公告)日：2022-05-19

申请号：US16951224

申请日：2020-11-18

Applicant: NVIDIA Corporation

Inventor： Ambrish Dantrey ,  Atousa Torabi ,  Anshul Jain ,  Ram Ganapathi ,  Abhijit Patait ,  Revanth Reddy Nalla ,  Niranjan Avadhanam

IPC: G08G1/0965 ,  H04R3/00 ,  G08G1/0967 ,  G06N3/04

Abstract: In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data. The locations, direction of travel, and/or siren type may allow an ego-vehicle or ego-machine to identify an emergency response vehicle and to make planning and/or control decisions in response.