公开(公告)号：US12233797B2

公开(公告)日：2025-02-25

申请号：US17946477

申请日：2022-09-16

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Gaurav Talwar ,  Alaa M. Khamis ,  Xu Fang Zhao ,  Kenneth R. Booker

IPC: B60R16/037 ,  G10L15/22 ,  G10L25/63

Abstract: The concepts include a user support system in the form of a microphone, a visual display arranged in a vehicle cabin, and a controller. The controller includes an instruction set that is executable to receive, via the microphone, a voice-based request from a user, and employ a virtual assistant to determine a user interaction in real time and to determine a specific intent for the voice-based request, including capturing metadata. A user interaction routine determines a user interaction parameter associated with the virtual assistant based upon the voice-based request from the user. A user sentiment analysis routine determines a user satisfaction parameter associated with the virtual assistant based upon the voice-based request from the user. The controller responds in real-time to the voice-based request based upon the user satisfaction parameter and the user interaction parameter that are associated with the virtual assistant.

公开(公告)号：US20240424873A1

公开(公告)日：2024-12-26

申请号：US18339425

申请日：2023-06-22

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Yujie Guo ,  Brooke Lynn Waldon ,  Julien P. Mourou ,  Jarvis Cahu

IPC: B60J3/04 ,  G02F1/163 ,  G07C5/02

Abstract: Some embodiments disclosed herein are directed to controlling tinting levels of dimmable glass on vehicles. Other embodiments may be disclosed or claimed.

公开(公告)号：US20240383501A1

公开(公告)日：2024-11-21

申请号：US18318826

申请日：2023-05-17

Applicant: GM Global Technology Operations LLC

Inventor： Alaa M. Khamis ,  Wei Tong ,  Robert Dale Burns

IPC: B60W60/00 ,  B60Q1/50 ,  B60Q5/00 ,  G05D1/00

Abstract: A system for responding to adversarial behavior within an autonomous vehicle includes a pedestrian detection system in communication with a vehicle controller and an adversarial intent algorithm adapted to determine a risk level of adversarial behavior from at least one pedestrian within proximity of the autonomous vehicle, the vehicle controller adapted to provide proactive and reactive actions to be performed by the autonomous vehicle in response to the adversarial behavior based on the risk level of the adversarial behavior.

公开(公告)号：US12049199B2

公开(公告)日：2024-07-30

申请号：US17892067

申请日：2022-08-20

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Kenneth R. Booker ,  Gaurav Talwar ,  Xu Fang Zhao

IPC: B60S1/08 ,  B60S1/02 ,  G10L25/51 ,  H04R1/40 ,  H04R3/00 ,  G01C21/36

CPC classification number: B60S1/0866 ,  B60S1/026 ,  B60S1/0803 ,  G10L25/51 ,  H04R1/406 ,  H04R3/005 ,  G01C21/3691 ,  H04R2499/13

Abstract: An automatic rain response system includes microphones of a vehicle, windshield wipers, and a controller. The microphones generate acoustic signals in response to rain. The controller is configured to receive a local weather condition, extract acoustic features from the acoustic signals, form feature vectors in response to the acoustic features and the local weather condition, classify the feature vectors to determine a current class among multiple classes, activate the windshield the wipers at a high speed in response to the current class being a heavy rain on a windshield class, activate the windshield wipers at a medium speed in response to the current class being a freezing rain on the windshield class, activate the windshield wipers at a low speed in response to the current class being a light rain on the windshield class, and deactivate the windshield wipers in response to the current class being a no rain class.

公开(公告)号：US11862904B2

公开(公告)日：2024-01-02

申请号：US17457009

申请日：2021-11-30

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Yun Qian Miao ,  Ralph David Schlottke

IPC: H01R13/66 ,  H01R13/42

CPC classification number: H01R13/6683 ,  H01R13/42 ,  H01R2201/26

Abstract: Systems, Methods, and Apparatuses are provided for monitoring cable connections between a trailer and vehicle. The system includes a monitoring device disposed within the vehicle; and a trailer cable and a breakaway trailer cable that provide a set of cable connections, the monitoring device is configured to: monitor the set of cable connections from connection data generated by a set of multimodal sensors integrated with the vehicle about statuses of the cable connections between the trailer and the vehicle; initiate a monitor function upon detection of a presence of the trailer connected to the vehicle by at least one sensor of the set of multimodal sensors integrated with the vehicle; and determine the statuses of the cable connections by fusing together using an information fusion algorithm one or more types of signal data from the set of multimodal sensors comprising optical signal data, radio signal data, and range signal data.

公开(公告)号：US20230391344A1

公开(公告)日：2023-12-07

申请号：US17829643

申请日：2022-06-01

Applicant: GM Global Technology Operations LLC

Inventor： Alaa M. Khamis ,  Wei Tong ,  Sai Vishnu Aluru ,  Upali P. Mudalige ,  Sravan Daruri

IPC: B60W40/08 ,  G06V20/59 ,  G10L25/63 ,  G10L15/22 ,  G06V10/12 ,  G06V20/70 ,  B60W30/18

CPC classification number: B60W40/08 ,  G06V20/59 ,  G10L25/63 ,  G10L15/22 ,  G06V10/12 ,  G06V20/70 ,  B60W30/18109 ,  B60W2040/089 ,  A61B5/0205

Abstract: An in-vehicle violence detection system includes a speech and non-speech audio recognition module capturing occupant threat words and non-speech audio events. In-vehicle accelerometers generate data analyzed in a shaking movement recognition module. A heart rate and breathing rate detection module measures physiological changes in occupant heart rates and breathing rhythms. An in-vehicle semantic scene recognition module analyzes occupant non-verbal interactions. Occupant threat indicators including an audible threat indicator are generated by the speech and non-speech audio event recognition module. Visual threat indicators are generated by the in-vehicle semantic scene recognition module. Physiological threat indicators are generated by the heart rate and breathing rate detection module. Vibration-based threat indicators are generated by the shaking movement recognition module. The four threat indicators are fused to estimate a threat level, consolidated by incorporating contextual information including a vehicle location and time. Different actions are taken based on the consolidated threat level.

公开(公告)号：US20230174089A1

公开(公告)日：2023-06-08

申请号：US17544066

申请日：2021-12-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Neeraj R. Gautama ,  Jarvis Chau ,  Jomo Hanley ,  Kelley J. Kettenbeil ,  Gina E. Griffith ,  Scott E. Jackson ,  Ian Gibbs ,  Mark T. Gaylord ,  Maria Alejandra Gonzalez ,  Nicholis Festa ,  Nathan Robinson ,  Ute Winter ,  Sachin Raviram

IPC: B60W50/14 ,  B60W50/10 ,  G06V20/59 ,  G06V40/16 ,  H04W4/46

CPC classification number: B60W50/14 ,  B60W50/10 ,  G06V20/597 ,  G06V40/174 ,  H04W4/46 ,  B60W2050/146

Abstract: A system for context-based adaptive virtual experience control in a vehicle is provided. The system includes an output device configured for providing a sensory output to a user of the vehicle and a computerized virtual experience control module configured for controlling the output device based upon a virtual experience mode. The system further includes a computerized context-based adaptive control module configured for monitoring contextual data related to one of the user of the vehicle or operation of the vehicle, monitoring feedback from the user related to one of favor or disfavor related to the virtual experience mode, and utilizing the contextual data and the feedback from the user to selectively, automatically command activation of the virtual experience mode.

公开(公告)号：US20220348165A1

公开(公告)日：2022-11-03

申请号：US17242814

申请日：2021-04-28

Applicant: GM Global Technology Operations LLC

Inventor： Alaa M. Khamis ,  Arief Barkah Koesdwiady ,  Kiana Karimpoor ,  Mohannad Murad

IPC: B60R25/30 ,  B60R25/31 ,  B60R25/102 ,  B60R25/10

Abstract: An alarm system and method of protecting a property from intrusion is disclosed. The property can be a vehicle that includes the alarm system. The alarm system includes an exterior camera for obtaining an exterior camera image data, an interior camera for obtaining an interior camera image data, and a processor. The processor is configured to determine first threat indicator for a potential intruder from the exterior camera image data, determine a second threat indicator for the potential intruder from the interior camera image data, determine a fused threat estimate indicative of an intention of the potential intruder from the first threat indicator and the second threat indicator, determine a consolidated threat estimate from the fused threat estimate and a contextual information for the property, and provide an alarm to protect the property from intrusion based on the consolidated threat estimate.

公开(公告)号：US12280786B2

公开(公告)日：2025-04-22

申请号：US18319037

申请日：2023-05-17

Applicant: GM Global Technology Operations LLC

Inventor： Alaa M. Khamis ,  Wei Tong

IPC: B60W60/00 ,  B60W40/04 ,  G06V20/58 ,  G06V40/20 ,  G10L15/02 ,  G10L15/30 ,  G10L25/63

Abstract: A system for identifying adversarial behavior directed to an autonomous vehicle includes a pedestrian detection system in communication with a vehicle controller adapted to identify a pedestrian within proximity of the autonomous vehicle, track the pedestrian, determine if the pedestrian is intending to cross in front of the autonomous vehicle, and if the pedestrian tracking system determines that the pedestrian is not intending to cross in front of the autonomous vehicle, the pedestrian tracking system is further adapted to continue tracking the pedestrian, and if the pedestrian tracking system determines that the pedestrian is intending to cross in front of the autonomous vehicle, the pedestrian tracking system is further adapted to determine, with an adversarial intent algorithm, if the pedestrian is exhibiting any adversarial behavior.

公开(公告)号：US20240404141A1

公开(公告)日：2024-12-05

申请号：US18328170

申请日：2023-06-02

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Yun Qian Miao ,  Alaa M. Khamis

IPC: G06T11/60 ,  G06T11/00 ,  G06V10/25 ,  G06V10/74 ,  G06V10/774 ,  G06V20/54 ,  G06V40/16

Abstract: Methods and systems are provided for data processing that include cameras and processors. The cameras are configured to obtain data including frames. The processors are coupled to the cameras, and are configured to at least facilitate identifying, for each frame, regions of interest for privacy protection; extracting, for each region of interest, high level properties of the region of interest for the frame; generating a replacement image for each of the regions of interest, thereby protecting privacy while maintaining the high level properties of the region of interest; and updating the frame utilizing the replacement image for each of the one or more regions of interest, generating an updated frame that protects individual privacy.