公开(公告)号：US20210110575A1

公开(公告)日：2021-04-15

申请号：US16653959

申请日：2019-10-15

Applicant: NVIDIA Corporation

Inventor： Feng Hu ,  Yuzhuo Ren ,  Niranjan Avadhanam ,  Ankit Pashiney

IPC: G06T7/80 ,  G06T7/70 ,  G06F3/14 ,  H04N17/00

Abstract: Systems and methods for automatic camera calibration without using a robotic actuator or similar hardware. An electronic display screen projects an image of a simulated three-dimensional calibration pattern, such as a checkerboard, oriented in a particular pose. The camera captures an image of the calibration pattern that is displayed on the screen, and this image together with the transform of the simulated three-dimensional calibration pattern are used to calibrate the camera. Multiple different pictures of different poses are employed to determine the optimal set of poses that produces the lowest reprojection error. To aid in selecting different poses, i.e., spatial positions and orientations of the simulated three-dimensional calibration pattern, poses may be selected from only that portion of the camera's field of view which is expected to be typically used in operation of the camera.

公开(公告)号：US20250156717A1

公开(公告)日：2025-05-15

申请号：US19022588

申请日：2025-01-15

Applicant: Nvidia Corporation

Inventor： Feng Hu ,  Niranjan Avadhanam ,  Yuzhuo Ren ,  Sujay Yadawadkar ,  Sakthivel Sivaraman ,  Hairong Jiang ,  Siyue Wu

IPC: G06N3/084 ,  G06F3/01 ,  G06F18/21 ,  G06N3/08 ,  G06V10/764 ,  G06V10/82 ,  G06V20/59 ,  G06V40/18 ,  G06V40/19

Abstract: Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.

公开(公告)号：US12288403B2

公开(公告)日：2025-04-29

申请号：US18611462

申请日：2024-03-20

Applicant: NVIDIA Corporation

Inventor： Nuri Murat Arar ,  Niranjan Avadhanam ,  Yuzhuo Ren

IPC: G06V20/56 ,  B60W30/095 ,  B60W40/08 ,  B60W50/14 ,  B60W60/00 ,  G06V20/59 ,  B60W30/09

Abstract: In various examples, estimated field of view or gaze information of a user may be projected external to a vehicle and compared to vehicle perception information corresponding to an environment outside of the vehicle. As a result, interior monitoring of a driver or occupant of the vehicle may be used to determine whether the driver or occupant has processed or seen certain object types, environmental conditions, or other information exterior to the vehicle. For a more holistic understanding of the state of the user, attentiveness and/or cognitive load of the user may be monitored to determine whether one or more actions should be taken. As a result, notifications, AEB system activations, and/or other actions may be determined based on a more complete state of the user as determined based on cognitive load, attentiveness, and/or a comparison between external perception of the vehicle and estimated perception of the user.

公开(公告)号：US20240412491A1

公开(公告)日：2024-12-12

申请号：US18207953

申请日：2023-06-09

Applicant: NVIDIA Corporation

Inventor： Shagan Sah ,  Nishant Puri ,  Yuzhuo Ren ,  Rajath Bellipady Shetty ,  Weili Nie ,  Arash Vahdat ,  Animashree Anandkumar

IPC: G06V10/776 ,  G06N3/094 ,  G06T11/00 ,  G06V10/75 ,  G06V10/774 ,  G06V10/82 ,  G06V40/16

Abstract: Apparatuses, system, and techniques use one or more first neural networks to generate one or more synthetic data to train one or more second neural networks based, at least in part, on one or more performance metrics of one or more second neural networks.

公开(公告)号：US12122392B2

公开(公告)日：2024-10-22

申请号：US17410580

申请日：2021-08-24

Applicant: Nvidia Corporation

Inventor： Yuzhuo Ren ,  Niranjan Avadhanam

IPC: B60W40/09 ,  G06V20/59 ,  G06V40/16

CPC classification number: B60W40/09 ,  G06V20/597 ,  B60W2420/403 ,  B60W2540/229 ,  B60W2554/4046 ,  B60W2554/4049 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172

Abstract: State information can be determined for a subject that is robust to different inputs or conditions. For drowsiness, facial landmarks can be determined from captured image data and used to determine a set of blink parameters. These parameters can be used, such as with a temporal network, to estimate a state (e.g., drowsiness) of the subject. To improve robustness, an eye state determination network can determine eye state from the image data, without reliance on intermediate landmarks, that can be used, such as with another temporal network, to estimate the state of the subject. A weighted combination of these values can be used to determine an overall state of the subject. To improve accuracy, individual behavior patterns and context information can be utilized to account for variations in the data due to subject variation or current context rather than changes in state.

公开(公告)号：US20240257539A1

公开(公告)日：2024-08-01

申请号：US18611462

申请日：2024-03-20

Applicant: NVIDIA Corporation

Inventor： Nuri Murat Arar ,  Niranjan Avadhanam ,  Yuzhuo Ren

IPC: G06V20/59 ,  B60W30/09 ,  B60W30/095 ,  B60W40/08 ,  B60W50/14 ,  B60W60/00 ,  G06V20/56

CPC classification number: G06V20/597 ,  B60W30/0956 ,  B60W40/08 ,  B60W50/14 ,  B60W60/001 ,  G06V20/56 ,  B60W30/09 ,  B60W2540/22 ,  B60W2540/221 ,  B60W2540/223 ,  B60W2540/225

Abstract: In various examples, estimated field of view or gaze information of a user may be projected external to a vehicle and compared to vehicle perception information corresponding to an environment outside of the vehicle. As a result, interior monitoring of a driver or occupant of the vehicle may be used to determine whether the driver or occupant has processed or seen certain object types, environmental conditions, or other information exterior to the vehicle. For a more holistic understanding of the state of the user, attentiveness and/or cognitive load of the user may be monitored to determine whether one or more actions should be taken. As a result, notifications, AEB system activations, and/or other actions may be determined based on a more complete state of the user as determined based on cognitive load, attentiveness, and/or a comparison between external perception of the vehicle and estimated perception of the user.

公开(公告)号：US20240087341A1

公开(公告)日：2024-03-14

申请号：US18516531

申请日：2023-11-21

Applicant: Nvidia Corporation

Inventor： Yuzhuo Ren ,  Niranjan Avadhanam

IPC: G06V20/59 ,  B60W40/08 ,  G06F18/21 ,  G06N3/045 ,  G06V40/16 ,  G06V40/18

CPC classification number: G06V20/597 ,  B60W40/08 ,  G06F18/21 ,  G06N3/045 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172 ,  G06V40/18 ,  B60W2540/229

Abstract: State information can be determined for a subject that is robust to different inputs or conditions. For drowsiness, facial landmarks can be determined from captured image data and used to determine a set of blink parameters. These parameters can be used, such as with a temporal network, to estimate a state (e.g., drowsiness) of the subject. To improve robustness, an eye state determination network can determine eye state from the image data, without reliance on intermediate landmarks, that can be used, such as with another temporal network, to estimate the state of the subject. A weighted combination of these values can be used to determine an overall state of the subject. To improve accuracy, individual behavior patterns and context information can be utilized to account for variations in the data due to subject variation or current context rather than changes in state.

公开(公告)号：US20240062067A1

公开(公告)日：2024-02-22

申请号：US18497501

申请日：2023-10-30

Applicant: Nvidia Corporation

Inventor： Feng Hu ,  Niranjan Avadhanam ,  Yuzhuo Ren ,  Sujay Yadawadkar ,  Sakthivel Sivaraman ,  Hairong Jiang ,  Siyue Wu

IPC: G06N3/084 ,  G06N3/08 ,  G06F3/01 ,  G06V40/19 ,  G06V20/59 ,  G06F18/21 ,  G06V10/764 ,  G06V10/82 ,  G06V40/18

CPC classification number: G06N3/084 ,  G06N3/08 ,  G06F3/013 ,  G06V40/19 ,  G06V20/59 ,  G06F18/217 ,  G06V10/764 ,  G06V10/82 ,  G06V20/597 ,  G06V40/193

Abstract: Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.

公开(公告)号：US11830259B2

公开(公告)日：2023-11-28

申请号：US17410564

申请日：2021-08-24

Applicant: Nvidia Corporation

Inventor： Yuzhuo Ren ,  Niranjan Avadhanam

IPC: G06V20/59 ,  G06V40/18 ,  G06V40/16 ,  B60W40/08 ,  G06F18/21 ,  G06N3/045

CPC classification number: G06V20/597 ,  B60W40/08 ,  G06F18/21 ,  G06N3/045 ,  G06V40/161 ,  G06V40/171 ,  G06V40/172 ,  G06V40/18 ,  B60W2540/229

Abstract: State information can be determined for a subject that is robust to different inputs or conditions. For drowsiness, facial landmarks can be determined from captured image data and used to determine a set of blink parameters. These parameters can be used, such as with a temporal network, to estimate a state (e.g., drowsiness) of the subject. To improve robustness, an eye state determination network can determine eye state from the image data, without reliance on intermediate landmarks, that can be used, such as with another temporal network, to estimate the state of the subject. A weighted combination of these values can be used to determine an overall state of the subject. To improve accuracy, individual behavior patterns and context information can be utilized to account for variations in the data due to subject variation or current context rather than changes in state.

公开(公告)号：US11803759B2

公开(公告)日：2023-10-31

申请号：US17498353

申请日：2021-10-11

Applicant: Nvidia Corporation

Inventor： Feng Hu ,  Niranjan Avadhanam ,  Yuzhuo Ren ,  Sujay Yadawadkar ,  Sakthivel Sivaraman ,  Hairong Jiang ,  Siyue Wu

IPC: G06N3/00 ,  G06N3/084 ,  G06N3/08 ,  G06F3/01 ,  G06V40/19 ,  G06V20/59 ,  G06F18/21 ,  G06V10/764 ,  G06V10/82 ,  G06V40/18

CPC classification number: G06N3/084 ,  G06F3/013 ,  G06F18/217 ,  G06N3/08 ,  G06V10/764 ,  G06V10/82 ,  G06V20/59 ,  G06V20/597 ,  G06V40/19 ,  G06V40/193

Abstract: Apparatuses, systems, and techniques are described to determine locations of objects using images including digital representations of those objects. In at least one embodiment, a gaze of one or more occupants of a vehicle is determined independently of a location of one or more sensors used to detect those occupants.