公开(公告)号：US20240282121A1

公开(公告)日：2024-08-22

申请号：US18171517

申请日：2023-02-20

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ron M. Hecht ,  Ariel Telpaz ,  Yael Shmueli Friedland ,  Asaf Degani ,  Michael Baltaxe ,  Andrea Forgacs

IPC: G06V20/56 ,  B60W50/14 ,  B60W60/00 ,  G06V20/58

CPC classification number: G06V20/588 ,  B60W50/14 ,  B60W60/001 ,  G06V20/58 ,  B60W2050/146 ,  B60W2420/403 ,  B60W2552/53

Abstract: A system for vehicle trajectory planning. The system may include a polarized camera system configured to generate polarized images of a roadway to be driven over with a vehicle, a prior controller configured to generate a prior for the roadway based at least in part on the polarized images, and a driving assistance system configured to provide a driving assistance according to the prior.

公开(公告)号：US20240143074A1

公开(公告)日：2024-05-02

申请号：US18489338

申请日：2023-10-18

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ron M. Hecht ,  Omer Tsimhoni ,  Dan Levi ,  Shaul Oron ,  Andrea Forgacs ,  Ohad Rahamim ,  Gershon Celniker

IPC: G06F3/01 ,  G06T7/50 ,  G06V10/74

CPC classification number: G06F3/013 ,  G06T7/50 ,  G06V10/761 ,  G06T2207/20084 ,  G06T2207/20228 ,  G06V2201/07

Abstract: A method of training a disparity estimation network. The method includes obtaining an eye-gaze dataset having first images with at least one gaze direction associated with each of the first images. A gaze prediction neural network is trained based on the eye-gaze dataset to develop a model trained to provide a gaze prediction for an external image. A depth database is obtained that includes second images having depth information associated with each of the second images. A disparity estimation neural network for object detection is trained based on an output from the gaze prediction neural network and an output from the depth database.

公开(公告)号：US12200233B2

公开(公告)日：2025-01-14

申请号：US18165476

申请日：2023-02-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ronit Bustin ,  Omer Tsimhoni ,  Andrea Forgacs ,  Yi Guo Glaser ,  Daniel S. Glaser ,  Ron M. Hecht

IPC: H04N19/25 ,  G06F3/01 ,  G06T7/70 ,  G06V20/59 ,  H04N19/179

Abstract: A system and method for limited rate context-based eye gaze encoding includes generating, based on an outward looking camera situated in a vehicle, a first video stream of a surrounding environment to a controller. The controller generates a scene description based on the first video stream and selects a corresponding scene from a predefined list of known scenes. Further, the controller, based on the selected corresponding scene, selects a codebook of encoding and decoding parameters from a plurality of predefined codebooks. Based on an inward looking camera situated in the vehicle, a second video stream of a face of a driver to an eye tracker controller is generated, where the eye tracker controller estimates a gaze direction of the driver. Encoded data comprising the estimated gaze direction of the driver is transmitted over a bandwidth limited channel to a decoder, based on the selected codebook, the encoded data.

公开(公告)号：US20240275994A1

公开(公告)日：2024-08-15

申请号：US18165476

申请日：2023-02-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ronit Bustin ,  Omer Tsimhoni ,  Andrea Forgacs ,  Yi Guo Glaser ,  Daniel S. Glaser ,  Ron M. Hecht

IPC: H04N19/25 ,  G06F3/01 ,  G06T7/70 ,  G06V20/59 ,  H04N19/179

CPC classification number: H04N19/25 ,  G06F3/013 ,  G06T7/70 ,  G06V20/597 ,  H04N19/179 ,  G06T2207/30201 ,  G06T2207/30252

Abstract: A system and method for limited rate context-based eye gaze encoding includes generating, based on an outward looking camera situated in a vehicle, a first video stream of a surrounding environment to a controller. The controller generates a scene description based on the first video stream and selects a corresponding scene from a predefined list of known scenes. Further, the controller, based on the selected corresponding scene, selects a codebook of encoding and decoding parameters from a plurality of predefined codebooks. Based on an inward looking camera situated in the vehicle, a second video stream of a face of a driver to an eye tracker controller is generated, where the eye tracker controller estimates a gaze direction of the driver. Encoded data comprising the estimated gaze direction of the driver is transmitted over a bandwidth limited channel to a decoder, based on the selected codebook, the encoded data.

公开(公告)号：US12293592B2

公开(公告)日：2025-05-06

申请号：US18171517

申请日：2023-02-20

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ron M. Hecht ,  Ariel Telpaz ,  Yael Shmueli Friedland ,  Asaf Degani ,  Michael Baltaxe ,  Andrea Forgacs

IPC: G06V20/58 ,  B60W50/14 ,  B60W60/00 ,  G06V20/56

Abstract: A system for vehicle trajectory planning. The system may include a polarized camera system configured to generate polarized images of a roadway to be driven over with a vehicle, a prior controller configured to generate a prior for the roadway based at least in part on the polarized images, and a driving assistance system configured to provide a driving assistance according to the prior.

公开(公告)号：US20240351588A1

公开(公告)日：2024-10-24

申请号：US18302231

申请日：2023-04-18

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ron M. Hecht ,  Shaul Oron ,  Omer Tsimhoni ,  Gershon Celniker ,  Daniel S. Glaser ,  Yi Guo Glaser ,  Andrea Forgacs

IPC: B60W40/08 ,  G06V20/58 ,  G06V20/59

CPC classification number: B60W40/08 ,  G06V20/58 ,  G06V20/597 ,  B60W2420/403 ,  B60W2540/225 ,  B60W2540/229

Abstract: A system and method for estimation of a driver state based on eye gaze includes, capturing and sending, using an outward looking camera situated in a vehicle, a first video stream of surrounding environment to a neural controller. The neural controller, based on the first video stream, generates an expected gaze distribution. Using an inward looking camera situated in the vehicle, the camera captures and sends a second video stream of a face of a driver to an eye tracker controller, where based on the second video stream, the eye tracker controller extracts a plurality of gaze directions. A gaze distribution module generates, based on the plurality of gaze directions, an actual gaze distribution. A distance distribution controller, based on a difference between the expected gaze distribution and the actual gaze distribution, generates a distance measure where a determination is made that the distance measure exceeds a threshold.