公开(公告)号：US20220057798A1

公开(公告)日：2022-02-24

申请号：US17517457

申请日：2021-11-02

Applicant: Nvidia Corporation

Inventor： Mark Costin ,  Zoran Nikolic ,  Ram Ganapathi

IPC: G05D1/00 ,  G05B9/03 ,  B60R16/023 ,  G05D1/02 ,  H04N7/18 ,  H04N7/10

Abstract: This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. Sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

公开(公告)号：US11163303B2

公开(公告)日：2021-11-02

申请号：US16273707

申请日：2019-02-12

Applicant: Nvidia Corporation

Inventor： Mark Costin ,  Zoran Nikolic ,  Ram Ganapathi

IPC: G05D1/00 ,  G05B9/03 ,  B60R16/023 ,  G05D1/02 ,  H04N7/18 ,  H04N7/10

Abstract: This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. In another embodiment, sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

公开(公告)号：US12283187B2

公开(公告)日：2025-04-22

申请号：US18462287

申请日：2023-09-06

Applicant: NVIDIA Corporation

Inventor： Ambrish Dantrey ,  Atousa Torabi ,  Anshul Jain ,  Ram Ganapathi ,  Abhijit Patait ,  Revanth Reddy Nalla ,  Niranjan Avadhanam

IPC: G08G1/0965 ,  G06N3/048 ,  G08G1/0967 ,  H04R3/00

Abstract: In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data.

公开(公告)号：US11634149B2

公开(公告)日：2023-04-25

申请号：US17532283

申请日：2021-11-22

Applicant: NVIDIA Corporation

Inventor： Mohammed Abdulla Yousuf ,  T. Y. Chan ,  Ram Ganapathi ,  Ashok Srinivasan ,  Mike Truog

IPC: B60W50/04 ,  G06F11/20 ,  B60W10/04 ,  B60W10/18 ,  G05D1/00 ,  G06F11/18 ,  G06F11/16 ,  G06F11/14 ,  B60W10/20 ,  B60W50/00

Abstract: In a self-driving autonomous vehicle, a controller architecture includes multiple processors within the same box. Each processor monitors the others and takes appropriate safe action when needed. Some processors may run dormant or low priority redundant functions that become active when another processor is detected to have failed. The processors are independently powered and independently execute redundant algorithms from sensor data processing to actuation commands using different hardware capabilities (GPUs, processing cores, different input signals, etc.). Intentional hardware and software diversity improves fault tolerance. The resulting fault-tolerant/fail-operational system meets ISO26262 ASIL-D specifications based on a single electronic controller unit platform that can be used for self-driving vehicles.

公开(公告)号：US11214273B2

公开(公告)日：2022-01-04

申请号：US15881426

申请日：2018-01-26

Applicant: NVIDIA Corporation

Inventor： Mohammed Abdulla Yousuf ,  T. Y. Chan ,  Ram Ganapathi ,  Ashok Srinivasan ,  Mike Truog

IPC: B60W50/04 ,  G06F11/20 ,  B60W10/04 ,  B60W10/18 ,  G05D1/00 ,  B60W10/20 ,  G06F11/18 ,  G06F11/16 ,  G06F11/14 ,  B60W50/00

Abstract: In a self-driving autonomous vehicle, a controller architecture includes multiple processors within the same box. Each processor monitors the others and takes appropriate safe action when needed. Some processors may run dormant or low priority redundant functions that become active when another processor is detected to have failed. The processors are independently powered and independently execute redundant algorithms from sensor data processing to actuation commands using different hardware capabilities (GPUs, processing cores, different input signals, etc.). Intentional hardware and software diversity improves fault tolerance. The resulting fault-tolerant/fail-operational system meets ISO26262 ASIL D specifications based on a single electronic controller unit platform that can be used for self-driving vehicles.

公开(公告)号：US20190250611A1

公开(公告)日：2019-08-15

申请号：US16273707

申请日：2019-02-12

Applicant: Nvidia Corporation

Inventor： Mark Costin ,  Zoran Nikolic ,  Ram Ganapathi

IPC: G05D1/00 ,  G05B9/03 ,  B60R16/023 ,  G05D1/02 ,  H04N7/10 ,  H04N7/18

CPC classification number: G05D1/0088 ,  B60R16/0231 ,  G05B9/03 ,  G05D1/0242 ,  G05D1/0246 ,  G05D1/0255 ,  G05D1/0257 ,  G05D1/0278 ,  H04N7/102 ,  H04N7/181

Abstract: This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. In another embodiment, sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

公开(公告)号：US11874662B2

公开(公告)日：2024-01-16

申请号：US17517457

申请日：2021-11-02

Applicant: Nvidia Corporation

Inventor： Mark Costin ,  Zoran Nikolic ,  Ram Ganapathi

IPC: G05D1/00 ,  G05B9/03 ,  B60R16/023 ,  G05D1/02 ,  H04N7/18 ,  H04N7/10

CPC classification number: G05D1/0088 ,  B60R16/0231 ,  G05B9/03 ,  G05D1/0242 ,  G05D1/0246 ,  G05D1/0255 ,  G05D1/0257 ,  G05D1/0278 ,  H04N7/102 ,  H04N7/181

Abstract: This disclosure presents an assisted driving vehicle system, including autonomous, semi-autonomous, and technology assisted vehicles, that can share sensor data among two or more controllers. A sensor can have one communication channel to a controller, thereby saving cabling and circuitry costs. The data from the sensor can be sent from one controller to another controller to enable redundancy and backup in case of a system failure. Sensor data from more than one sensor can be aggregated at one controller prior to the aggregated sensor data being communicated to another controller thereby saving bandwidth and reducing transmission times. The sharing of sensor data can be enabled through the use of a sensor data distributor, such as a converter, repeater, or a serializer/deserializer set located as part of the controller and communicatively coupled to another such device in another controller using a data interface communication channel.

公开(公告)号：US20230356728A1

公开(公告)日：2023-11-09

申请号：US18144651

申请日：2023-05-08

Applicant: NVIDIA Corporation

Inventor： Anshul Jain ,  Ratin Kumar ,  Feng Hu ,  Niranjan Avadhanam ,  Atousa Torabi ,  Hairong Jiang ,  Ram Ganapathi ,  Taek Kim

IPC: B60W30/18 ,  B60W50/00 ,  B60W40/08 ,  G06V40/19 ,  G05B13/02 ,  G05D1/00 ,  G06F18/25 ,  G06V10/141 ,  G06V20/59

CPC classification number: B60W50/0098 ,  B60W30/18 ,  B60W40/08 ,  G05B13/027 ,  G05D1/0061 ,  G06F18/251 ,  G06V10/141 ,  G06V20/597 ,  G06V40/19 ,  B60W2040/0836 ,  B60W2540/26 ,  H04N23/71

Abstract: Approaches for an advanced AI-assisted vehicle can utilize an extensive suite of sensors inside and outside the vehicle, providing information to a computing platform running one or more neural networks. The neural networks can perform functions such as facial recognition, eye tracking, gesture recognition, head position, and gaze tracking to monitor the condition and safety of the driver and passengers. The system also identifies and tracks body pose and signals of people inside and outside the vehicle to understand their intent and actions. The system can track driver gaze to identify objects the driver might not see, such as cross-traffic and approaching cyclists. The system can provide notification of potential hazards, advice, and warnings. The system can also take corrective action, which may include controlling one or more vehicle subsystems, or when necessary, autonomously controlling the entire vehicle. The system can work with vehicle systems for enhanced analytics and recommendations.

公开(公告)号：US11644834B2

公开(公告)日：2023-05-09

申请号：US16186473

申请日：2018-11-09

Applicant: NVIDIA Corporation

Inventor： Michael Alan Ditty ,  Gary Hicok ,  Jonathan Sweedler ,  Clement Farabet ,  Mohammed Abdulla Yousuf ,  Tai-Yuen Chan ,  Ram Ganapathi ,  Ashok Srinivasan ,  Michael Rod Truog ,  Karl Greb ,  John George Mathieson ,  David Nister ,  Kevin Flory ,  Daniel Perrin ,  Dan Hettena

IPC: G05D1/02 ,  G06V20/58 ,  G06V20/56 ,  G05D1/00 ,  G06F15/78 ,  G06N3/063 ,  G06N3/04

CPC classification number: G05D1/0088 ,  G05D1/0248 ,  G05D1/0274 ,  G06F15/7807 ,  G06N3/063 ,  G06V20/58 ,  G06V20/588 ,  G05D2201/0213 ,  G06N3/0454

Abstract: Autonomous driving is one of the world's most challenging computational problems. Very large amounts of data from cameras, RADARs, LIDARs, and HD-Maps must be processed to generate commands to control the car safely and comfortably in real-time. This challenging task requires a dedicated supercomputer that is energy-efficient and low-power, complex high-performance software, and breakthroughs in deep learning AI algorithms. To meet this task, the present technology provides advanced systems and methods that facilitate autonomous driving functionality, including a platform for autonomous driving Levels 3, 4, and/or 5. In preferred embodiments, the technology provides an end-to-end platform with a flexible architecture, including an architecture for autonomous vehicles that leverages computer vision and known ADAS techniques, providing diversity and redundancy, and meeting functional safety standards. The technology provides for a faster, more reliable, safer, energy-efficient and space-efficient System-on-a-Chip, which may be integrated into a flexible, expandable platform that enables a wide-range of autonomous vehicles, including cars, taxis, trucks, and buses, as well as watercraft and aircraft.

公开(公告)号：US20230410650A1

公开(公告)日：2023-12-21

申请号：US18462287

申请日：2023-09-06

Applicant: NVIDIA Corporation

Inventor： Ambrish Dantrey ,  Atousa Torabi ,  Anshul Jain ,  Ram Ganapathi ,  Abhijit Patait ,  Revanth Reddy Nalla ,  Niranjan Avadhanam

IPC: G08G1/0965 ,  H04R3/00 ,  G08G1/0967 ,  G06N3/048

CPC classification number: G08G1/0965 ,  H04R3/005 ,  G08G1/096708 ,  G06N3/048 ,  H04R2430/20

Abstract: In various examples, audio alerts of emergency response vehicles may be detected and classified using audio captured by microphones of an autonomous or semi-autonomous machine in order to identify travel directions, locations, and/or types of emergency response vehicles in the environment. For example, a plurality of microphone arrays may be disposed on an autonomous or semi-autonomous machine and used to generate audio signals corresponding to sounds in the environment. These audio signals may be processed to determine a location and/or direction of travel of an emergency response vehicle (e.g., using triangulation). Additionally, to identify siren types—and thus emergency response vehicle types corresponding thereto—the audio signals may be used to generate representations of a frequency spectrum that may be processed using a deep neural network (DNN) that outputs probabilities of alert types being represented by the audio data.