-
公开(公告)号:US20240282121A1
公开(公告)日:2024-08-22
申请号:US18171517
申请日:2023-02-20
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ron M. Hecht , Ariel Telpaz , Yael Shmueli Friedland , Asaf Degani , Michael Baltaxe , Andrea Forgacs
CPC classification number: G06V20/588 , B60W50/14 , B60W60/001 , G06V20/58 , B60W2050/146 , B60W2420/403 , B60W2552/53
Abstract: A system for vehicle trajectory planning. The system may include a polarized camera system configured to generate polarized images of a roadway to be driven over with a vehicle, a prior controller configured to generate a prior for the roadway based at least in part on the polarized images, and a driving assistance system configured to provide a driving assistance according to the prior.
-
公开(公告)号:US20240143074A1
公开(公告)日:2024-05-02
申请号:US18489338
申请日:2023-10-18
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ron M. Hecht , Omer Tsimhoni , Dan Levi , Shaul Oron , Andrea Forgacs , Ohad Rahamim , Gershon Celniker
CPC classification number: G06F3/013 , G06T7/50 , G06V10/761 , G06T2207/20084 , G06T2207/20228 , G06V2201/07
Abstract: A method of training a disparity estimation network. The method includes obtaining an eye-gaze dataset having first images with at least one gaze direction associated with each of the first images. A gaze prediction neural network is trained based on the eye-gaze dataset to develop a model trained to provide a gaze prediction for an external image. A depth database is obtained that includes second images having depth information associated with each of the second images. A disparity estimation neural network for object detection is trained based on an output from the gaze prediction neural network and an output from the depth database.
-
公开(公告)号:US12200233B2
公开(公告)日:2025-01-14
申请号:US18165476
申请日:2023-02-07
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ronit Bustin , Omer Tsimhoni , Andrea Forgacs , Yi Guo Glaser , Daniel S. Glaser , Ron M. Hecht
IPC: H04N19/25 , G06F3/01 , G06T7/70 , G06V20/59 , H04N19/179
Abstract: A system and method for limited rate context-based eye gaze encoding includes generating, based on an outward looking camera situated in a vehicle, a first video stream of a surrounding environment to a controller. The controller generates a scene description based on the first video stream and selects a corresponding scene from a predefined list of known scenes. Further, the controller, based on the selected corresponding scene, selects a codebook of encoding and decoding parameters from a plurality of predefined codebooks. Based on an inward looking camera situated in the vehicle, a second video stream of a face of a driver to an eye tracker controller is generated, where the eye tracker controller estimates a gaze direction of the driver. Encoded data comprising the estimated gaze direction of the driver is transmitted over a bandwidth limited channel to a decoder, based on the selected codebook, the encoded data.
-
公开(公告)号:US20240275994A1
公开(公告)日:2024-08-15
申请号:US18165476
申请日:2023-02-07
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ronit Bustin , Omer Tsimhoni , Andrea Forgacs , Yi Guo Glaser , Daniel S. Glaser , Ron M. Hecht
IPC: H04N19/25 , G06F3/01 , G06T7/70 , G06V20/59 , H04N19/179
CPC classification number: H04N19/25 , G06F3/013 , G06T7/70 , G06V20/597 , H04N19/179 , G06T2207/30201 , G06T2207/30252
Abstract: A system and method for limited rate context-based eye gaze encoding includes generating, based on an outward looking camera situated in a vehicle, a first video stream of a surrounding environment to a controller. The controller generates a scene description based on the first video stream and selects a corresponding scene from a predefined list of known scenes. Further, the controller, based on the selected corresponding scene, selects a codebook of encoding and decoding parameters from a plurality of predefined codebooks. Based on an inward looking camera situated in the vehicle, a second video stream of a face of a driver to an eye tracker controller is generated, where the eye tracker controller estimates a gaze direction of the driver. Encoded data comprising the estimated gaze direction of the driver is transmitted over a bandwidth limited channel to a decoder, based on the selected codebook, the encoded data.
-
公开(公告)号:US12293592B2
公开(公告)日:2025-05-06
申请号:US18171517
申请日:2023-02-20
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ron M. Hecht , Ariel Telpaz , Yael Shmueli Friedland , Asaf Degani , Michael Baltaxe , Andrea Forgacs
Abstract: A system for vehicle trajectory planning. The system may include a polarized camera system configured to generate polarized images of a roadway to be driven over with a vehicle, a prior controller configured to generate a prior for the roadway based at least in part on the polarized images, and a driving assistance system configured to provide a driving assistance according to the prior.
-
公开(公告)号:US20240351588A1
公开(公告)日:2024-10-24
申请号:US18302231
申请日:2023-04-18
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Ron M. Hecht , Shaul Oron , Omer Tsimhoni , Gershon Celniker , Daniel S. Glaser , Yi Guo Glaser , Andrea Forgacs
CPC classification number: B60W40/08 , G06V20/58 , G06V20/597 , B60W2420/403 , B60W2540/225 , B60W2540/229
Abstract: A system and method for estimation of a driver state based on eye gaze includes, capturing and sending, using an outward looking camera situated in a vehicle, a first video stream of surrounding environment to a neural controller. The neural controller, based on the first video stream, generates an expected gaze distribution. Using an inward looking camera situated in the vehicle, the camera captures and sends a second video stream of a face of a driver to an eye tracker controller, where based on the second video stream, the eye tracker controller extracts a plurality of gaze directions. A gaze distribution module generates, based on the plurality of gaze directions, an actual gaze distribution. A distance distribution controller, based on a difference between the expected gaze distribution and the actual gaze distribution, generates a distance measure where a determination is made that the distance measure exceeds a threshold.
-
-
-
-
-