公开(公告)号：US12194919B2

公开(公告)日：2025-01-14

申请号：US18171504

申请日：2023-02-20

Applicant: GM Global Technology Operations LLC

Inventor： Esther Anderson ,  Fan Bai ,  Donald K. Grimm ,  Paul E. Krajewski ,  Jace C. Stokes ,  Peter Finnegan ,  Hannah Elizabeth Wagner ,  Himabindu G. Sundaram ,  Mark T. Gaylord ,  Travis Scott Hester ,  Mark L. Reuss

IPC: B60Q1/00 ,  B60Q9/00 ,  G06V10/26 ,  G06V10/764 ,  G06V20/59 ,  G06V40/20 ,  G10L13/04 ,  H04N7/18 ,  H04W4/40

Abstract: A method for enabling vehicle connected services for a hearing-impaired vehicle occupant includes receiving sensor data from a plurality of sensors of a vehicle. The sensor data includes scene data indicative of a scene inside the vehicle and outside the vehicle. The method further includes determining that the hearing-impaired vehicle occupant is articulating sign language using the sensor data. Also, the method includes determining a vehicle-occupant message corresponding to the sign language articulated by the hearing-impaired vehicle occupant to generate vehicle occupant-message data in response to determining that the hearing-impaired vehicle occupant is articulating sign language. The method further includes transmitting the vehicle occupant-message data and the scene data to a remote system in response to generating the vehicle occupant-message data. Further, the method includes receiving a vehicle connected service from the remote system.

公开(公告)号：US12136421B2

公开(公告)日：2024-11-05

申请号：US17685716

申请日：2022-03-03

Applicant: GM Global Technology Operations LLC

Inventor： Jacob Alan Bond ,  Hannah Elizabeth Wagner ,  Joseph F. Szczerba ,  Alan D. Hejl

IPC: G10L15/22 ,  B60W40/08 ,  G06F18/25 ,  G06N3/08 ,  G06T7/20 ,  G10L15/16 ,  G10L15/25

Abstract: A speech recognition method includes receiving audible data and user data. The audible data includes information about an utterance by the user. The user data includes information about movements by the user. The method further includes fusing the audible data and the user data to obtain fused data and determining at least one spoken word of the utterance based on the fused data.

公开(公告)号：US20230282210A1

公开(公告)日：2023-09-07

申请号：US17685716

申请日：2022-03-03

Applicant: GM Global Technology Operations LLC

Inventor： Jacob Alan Bond ,  Hannah Elizabeth Wagner ,  Joseph F. Szczerba ,  Alan D. Hejl

IPC: G10L15/22 ,  G10L15/16 ,  G10L15/25 ,  G06T7/20 ,  G06K9/62 ,  B60W40/08 ,  G06N3/08

CPC classification number: G10L15/22 ,  B60W40/08 ,  G06K9/6289 ,  G06N3/08 ,  G06T7/20 ,  G10L15/16 ,  G10L15/25 ,  B60W2040/089 ,  B60W2420/42 ,  B60W2420/54 ,  B60W2540/21 ,  B60W2540/221 ,  G06T2207/30201 ,  G10L2015/223

Abstract: A speech recognition method includes receiving audible data and user data. The audible data includes information about an utterance by the user. The user data includes information about movements by the user. The method further includes fusing the audible data and the user data to obtain fused data and determining at least one spoken word of the utterance based on the fused data.

公开(公告)号：US11645038B1

公开(公告)日：2023-05-09

申请号：US17828121

申请日：2022-05-31

Applicant: GM Global Technology Operations LLC

Inventor： Jacob Alan Bond ,  Joseph F. Szczerba ,  Hannah Elizabeth Wagner ,  Kai-Han Chang ,  Thomas A. Seder

IPC: G06F3/16 ,  G06F3/01

CPC classification number: G06F3/167 ,  G06F3/011

Abstract: An augmented reality head up display system includes an audio microphone array, a driver position tracking device, and an augmented reality head up display. The augmented reality head up display system also includes a controller in electronic communication with the audio microphone array, the driver position tracking device, and the augmented reality head up display, where the controller is programmed to: receive audio data from the audio microphone array corresponding to audio detected by the audio microphone array, classify the audio data as corresponding to an audio event occurring in an environment surrounding the vehicle, and display a graphic corresponding to the audio event on the windscreen of the vehicle using the augmented reality head up display and input from the driver position tracking device.

公开(公告)号：US20250034916A1

公开(公告)日：2025-01-30

申请号：US18358374

申请日：2023-07-25

Applicant: GM Global Technology Operations LLC

Inventor： Hannah Elizabeth Wagner ,  Jacob Alan Bond ,  Joseph F. Szczerba ,  Akilesh Rajavenkatanarayanan

IPC: E05B81/76 ,  E05B77/00 ,  E05B85/10

Abstract: A door handle locator system for a vehicle includes one or more modalities that provide sensory feedback to a user indicating a location of a door handle that is part of a door of the vehicle. The door handle locator system also includes one or more controllers in electronic communication with the one or more modalities. The one or more controllers execute instructions to receive a wireless signal indicating a location of the user with respect to the vehicle. The one or more controllers determine the user is approaching the vehicle based on the location of the user with respect to the vehicle. In response to determining the user is approaching the vehicle, the one or more controllers instruct the one or more modalities to provide the sensory feedback to the user indicating the location of the door handle.

公开(公告)号：US20240278717A1

公开(公告)日：2024-08-22

申请号：US18171504

申请日：2023-02-20

Applicant: GM Global Technology Operations LLC

Inventor： Esther Anderson ,  Fan Bai ,  Donald K. Grimm ,  Paul E. Krajewski ,  Jace C. Stokes ,  Peter Finnegan ,  Hannah Elizabeth Wagner ,  Himabindu G. Sundaram ,  Mark T. Gaylord ,  Travis Scott Hester ,  Mark L. Reuss

IPC: B60Q9/00 ,  G06V10/26 ,  G06V10/764 ,  G06V20/59 ,  G06V40/20 ,  G10L13/04 ,  H04N7/18 ,  H04W4/40

CPC classification number: B60Q9/00 ,  G06V10/26 ,  G06V10/764 ,  G06V20/59 ,  G06V40/28 ,  G10L13/04 ,  H04N7/183 ,  H04W4/40

Abstract: A method for enabling vehicle connected services for a hearing-impaired vehicle occupant includes receiving sensor data from a plurality of sensors of a vehicle. The sensor data includes scene data indicative of a scene inside the vehicle and outside the vehicle. The method further includes determining that the hearing-impaired vehicle occupant is articulating sign language using the sensor data. Also, the method includes determining a vehicle-occupant message corresponding to the sign language articulated by the hearing-impaired vehicle occupant to generate vehicle occupant-message data in response to determining that the hearing-impaired vehicle occupant is articulating sign language. The method further includes transmitting the vehicle occupant-message data and the scene data to a remote system in response to generating the vehicle occupant-message data. Further, the method includes receiving a vehicle connected service from the remote system.