公开(公告)号：US20210125521A1

公开(公告)日：2021-04-29

申请号：US16661665

申请日：2019-10-23

Applicant: GM Global Technology Operations LLC

Inventor： Ariel Telpaz ,  Michael Baltaxe ,  Donald K. Grimm ,  Gila Kamhi

IPC: G09B19/16 ,  G06K9/00 ,  G06K9/62 ,  G06T7/70 ,  G06N3/08 ,  B60Q9/00

Abstract: Methods and systems involve obtaining information from one or more sources to determine a real-time context. A method includes determining a situational awareness score indicating a level of vigilance required based on the real-time context, obtaining images of eyes of a driver to detect a gaze pattern of the driver, determining a relevant attention score indicating a level of engagement of the driver in the real-time context based on a match between the gaze pattern of the driver and the real-time context, and obtaining images of the driver to detect behavior of the driver. A driver readiness score is determined and indicates a level of readiness of the driver to resume driving the vehicle based on the behavior of the driver. An off-road glance time is obtained based on using the situational awareness score, the relevant attention score, and the driver readiness score.

公开(公告)号：US20200334478A1

公开(公告)日：2020-10-22

申请号：US16385484

申请日：2019-04-16

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ron M. Hecht ,  Ariel Telpaz ,  Kobi Nistel ,  Tzvi Philipp ,  Michael Baltaxe ,  Dan Levi

IPC: G06K9/00 ,  G06F3/01

Abstract: An occupant monitoring apparatus is provided. The apparatus includes a laser illuminator configured to emit a laser to illuminate an occupant; and a sensor configured to generate an image of the occupant illuminated by the laser.

公开(公告)号：US20200231109A1

公开(公告)日：2020-07-23

申请号：US16253312

申请日：2019-01-22

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Michael Baltaxe ,  Ruben Mergui ,  Kobi Nistel ,  Gila Kamhi

IPC: B60R21/015 ,  G06N3/08 ,  G06N3/04 ,  G05D1/00 ,  B60Q9/00 ,  B60R22/48 ,  G06K9/00 ,  G06K9/62

Abstract: A seat belt status determining system and method for a vehicle that evaluate a seat belt and determine if it is buckled and if it is properly routed on a passenger. In order to evaluate the seat belt status, the system and method use seat belt sensors and cameras inside the vehicle cabin to generate data that is then analyzed in conjunction with machine learning techniques (e.g., supervised machine learning techniques implemented through the use of neural networks) to classify the seat belt status into one or more categories, such as: passenger not present, passenger present/seat belt not being worn, passenger present/seat belt being worn improperly, passenger present/seat belt being worn properly, and blocked view.

公开(公告)号：US20240257527A1

公开(公告)日：2024-08-01

申请号：US18161211

申请日：2023-01-30

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Michael Baltaxe ,  Tomer Pe'er ,  Dan Levi

IPC: G06V20/56 ,  G06V10/143 ,  G06V10/60 ,  G06V10/774 ,  G06V10/80 ,  G06V10/82 ,  G06V20/70

CPC classification number: G06V20/56 ,  G06V10/143 ,  G06V10/60 ,  G06V10/774 ,  G06V10/806 ,  G06V10/82 ,  G06V20/70 ,  B60W50/14 ,  B60W2050/146 ,  B60W60/001 ,  B60W2420/403

Abstract: A free space estimation and visualization system for a host vehicle includes a camera configured to collect red-green-blue (“RGB”)-polarimetric image data of drive environs of the host vehicle, including a potential driving path. An electronic control unit (“ECU”) receives the RGB-polarimetric image data and estimates free space in the driving path by processing the RGB-polarimetric image data via a run-time neural network. Control actions are taken in response to the estimated free space. A method for use with the visualization system includes collecting RGB and lidar data of target drive scenes and generating, via a first neural network, pseudo-labels of the scenes. The method includes collecting RGB-polarimetric data via a camera and thereafter training a second neural network using the RGB-polarimetric data and pseudo-labels. The second neural network is used in the ECU to estimate free space in the potential driving path.

公开(公告)号：US12014552B2

公开(公告)日：2024-06-18

申请号：US17544195

申请日：2021-12-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ariel Telpaz ,  Ravid Erez ,  Michael Baltaxe ,  Barak Hershkovitz ,  Nadav Baron ,  Christopher A Stanek

IPC: G06V20/56 ,  B60R16/023 ,  G05D1/00 ,  G06V10/25 ,  G06V10/26 ,  G06V10/44 ,  G06V10/62 ,  G06V10/82 ,  G07C5/00 ,  G07C5/02 ,  H04N23/90

CPC classification number: G06V20/56 ,  B60R16/0231 ,  G05D1/0214 ,  G05D1/0246 ,  G06V10/25 ,  G06V10/267 ,  G06V10/44 ,  G06V10/62 ,  G06V10/82 ,  G07C5/008 ,  G07C5/02 ,  H04N23/90

Abstract: Presented are intelligent vehicle systems for off-road driving incident prediction and assistance, methods for making/operating such systems, and vehicles networking with such systems. A method for operating a motor vehicle includes a system controller receiving geolocation data indicating the vehicle is in or entering off-road terrain. Responsive to the vehicle geolocation data, the controller receives, from vehicle-mounted cameras, camera-generated images each containing the vehicle's drive wheel(s) and/or the off-road terrain's surface. The controller receives, from a controller area network bus, vehicle operating characteristics data and vehicle dynamics data for the motor vehicle. The camera data, vehicle operating characteristics data, and vehicle dynamics data is processed via a convolutional neural network backbone to predict occurrence of a driving incident on the off-road terrain within a prediction time horizon. The system controller commands a resident vehicle system to execute a control operation responsive to the predicted occurrence of the driving incident.

公开(公告)号：US11807181B2

公开(公告)日：2023-11-07

申请号：US17081428

申请日：2020-10-27

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Itai Druker ,  Gila Kamhi ,  Michael Baltaxe ,  Kobi Nistel ,  Ruben Mergui ,  Dorel M. Sala ,  Lisa A. Fallon

IPC: B60R22/00 ,  E05F15/00 ,  G05D1/00 ,  G05D3/00 ,  G06F7/00 ,  G06F17/00 ,  B60R21/015 ,  B60R21/16 ,  G06T7/194 ,  G06T7/70

CPC classification number: B60R21/01538 ,  B60R21/01516 ,  B60R21/16 ,  G06T7/194 ,  G06T7/70 ,  B60R2021/161 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30268

Abstract: Vision-based airbag enablement may include capturing two-dimensional images of a passenger, segmenting the image, classifying the image, and determining seated height of the passenger from the image. Enabling or disabling deployment of the airbag may be controlled based at least in part upon the determined seated height.

公开(公告)号：US11603060B2

公开(公告)日：2023-03-14

申请号：US16871252

申请日：2020-05-11

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Scott D. Thomas ,  Michael Baltaxe ,  Kobi Nistel

IPC: B60R21/215 ,  B60R21/015 ,  B60R22/48

Abstract: A system includes a seat belt routing module and a user interface device (UID) control module. The seat belt routing module is configured to: determine a routing of a seat belt relative to an occupant in a vehicle seat based on input from a webbing payout sensor; and determine the seat belt routing based on an input from an in-cabin sensor. The in-cabin sensor includes at least one of a camera, an infrared sensor, an ultrasonic sensor, a radar sensor, and a lidar sensor. The UID control module is configured to control a user interface device to indicate that the seat belt is being worn improperly when: the seat belt routing determined using at least one of the webbing payout sensor and the in-cabin sensor is improper; and the seat belt routing determined using the webbing payout sensor corresponds to the seat belt routing determined using the in-cabin sensor.

公开(公告)号：US20200369206A1

公开(公告)日：2020-11-26

申请号：US16421437

申请日：2019-05-23

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Michael Baltaxe ,  Ruben Mergui ,  Ron M. Hecht ,  Yael Shmueli Friedland ,  Ariel Telpaz ,  Shihchye A. Lin

IPC: B60R1/066 ,  B60R1/12 ,  B60R1/02 ,  B60R11/04 ,  B60N2/00 ,  B60R21/015

Abstract: A vehicle, system and method of adjusting a mirror of a vehicle. A system for adjusting a mirror of a vehicle is disclosed. The system includes a calibration a calibration marker disposed on the vehicle, a camera, a motor and a processor. The calibration marker forms a calibration image onto a face of an occupant of the vehicle via reflection through the mirror. The camera obtains a camera image including the calibration image and the face of the occupant. The processor determines from the camera image an initial location of the calibration image at the face, determines a calibrated setting of the mirror that places the calibration image at a calibration location, and operates the motor to adjust the mirror to the calibrated setting.

公开(公告)号：US20240329225A1

公开(公告)日：2024-10-03

申请号：US18190437

申请日：2023-03-27

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Michael Baltaxe ,  Michael Slutsky ,  Ariel Rubanenko ,  Dan Levi

IPC: G01S7/539 ,  G01S15/89

CPC classification number: G01S7/539 ,  G01S15/89 ,  G01S2015/938

Abstract: A disclosure is presented for estimating height of an object using ultrasonic sensors carried onboard a vehicle. The height may be estimated by generating ultrasonic distance measurements based on a time of flight associated with ultrasonic reflections detected with the ultrasonic sensors, generating a three-dimensional (3D) occupancy grid to volumetrically represent at least a portion of an environment within field of view of the ultrasonic sensors, the 3D occupancy grid including a plurality of volumetric pixels (voxels), assigning a count value to each of the voxels based on the distance measurements, and estimating the height according to a relative spatial relationship between the vehicle and the voxel having the count value with a greatest value.

公开(公告)号：US20230177840A1

公开(公告)日：2023-06-08

申请号：US17544195

申请日：2021-12-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Ariel Telpaz ,  Ravid Erez ,  Michael Baltaxe ,  Barak Hershkovitz ,  Nadav Baron ,  Christopher A. Stanek

IPC: G06V20/56 ,  H04N5/247 ,  G06V10/82 ,  G06V10/25 ,  G06V10/26 ,  G06V10/62 ,  G06V10/44 ,  B60R16/023 ,  G07C5/00 ,  G07C5/02 ,  G05D1/02

CPC classification number: G06V20/56 ,  H04N5/247 ,  G06V10/82 ,  G06V10/25 ,  G06V10/267 ,  G06V10/62 ,  G06V10/44 ,  B60R16/0231 ,  G07C5/008 ,  G07C5/02 ,  G05D1/0214 ,  G05D1/0246

Abstract: Presented are intelligent vehicle systems for off-road driving incident prediction and assistance, methods for making/operating such systems, and vehicles networking with such systems. A method for operating a motor vehicle includes a system controller receiving geolocation data indicating the vehicle is in or entering off-road terrain. Responsive to the vehicle geolocation data, the controller receives, from vehicle-mounted cameras, camera-generated images each containing the vehicle's drive wheel(s) and/or the off-road terrain's surface. The controller receives, from a controller area network bus, vehicle operating characteristics data and vehicle dynamics data for the motor vehicle. The camera data, vehicle operating characteristics data, and vehicle dynamics data is processed via a convolutional neural network backbone to predict occurrence of a driving incident on the off-road terrain within a prediction time horizon. The system controller commands a resident vehicle system to execute a control operation responsive to the predicted occurrence of the driving incident.