公开(公告)号：US20240281757A1

公开(公告)日：2024-08-22

申请号：US18171784

申请日：2023-02-21

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Steffen P. Lindenthal ,  Hojjat Izadi ,  Michael D. Alarcon

IPC: G06Q10/087

CPC classification number: G06Q10/087

Abstract: Methods and systems for controlling movement of e-pallets using multi-modal interaction with a user are provided that include: one or more first sensors configured to obtain first sensor data of a first modality pertaining to a command from the user for movement of the e-pallets; one or more second sensors configured to obtain second sensor data of a second modality, different from the first modality, pertaining to the command; and a processor that is coupled to the one or more first sensors and the one or more second sensors, the processor configured to at least facilitate: determining an intended movement of the e-pallets based on both the first sensor data and the second sensor data; and moving the e-pallets in executing the intended movement, in accordance with instructions provided by the processor to actuators of the e-pallets.

公开(公告)号：US12054172B2

公开(公告)日：2024-08-06

申请号：US17819615

申请日：2022-08-12

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Arief Barkah Koesdwiady

IPC: B60Q9/00 ,  B60W40/08 ,  B60W50/14 ,  G06V10/25 ,  G06V20/56 ,  G06V20/59 ,  G06V40/10 ,  G06V40/20

CPC classification number: B60W50/14 ,  B60W40/08 ,  G06V10/25 ,  G06V20/56 ,  G06V20/593 ,  G06V40/103 ,  G06V40/28 ,  B60W2420/403 ,  B60W2540/01 ,  B60W2540/223

Abstract: A vehicle including one or more interior image sensors, one or more exterior image sensors, and a controller configured to automatically detect occupant risky behavior is provided. The controller is configured to: detect whether a vehicle occupant exists who may pose a risk; determine whether a detected vehicle occupant in engaged in potentially risky behavior in an area of interest (AoI) based on image data from the one or more interior image sensors or the one or more exterior image sensors; determine whether the potentially risky behavior poses an actual risk; classify a level of risk when the potentially risky behavior poses an actual risk; and perform risk mitigation actions based on risk classification.

公开(公告)号：US20240140738A1

公开(公告)日：2024-05-02

申请号：US17973763

申请日：2022-10-26

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Yun Qian Miao ,  Christopher L. Oesterling ,  Derek B. Ancrum ,  Shawn F. Granda

IPC: B65G67/04 ,  G06V20/52

CPC classification number: B65G67/04 ,  G06V20/52

Abstract: A multimodal freight monitoring and contextual notification system for a delivery vehicle. The system may include one or more monitoring systems configured to generate monitoring data for multimodal monitoring of freight included within a cargo bay of the delivery vehicle and a contextual notification controller configured to generate a contextual notification as a function thereof.

公开(公告)号：US20240059252A1

公开(公告)日：2024-02-22

申请号：US17892067

申请日：2022-08-20

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Kenneth R. Booker ,  Gaurav Talwar ,  Xu Fang Zhao

IPC: B60S1/08 ,  H04R1/40 ,  H04R3/00 ,  G10L25/51 ,  B60S1/02

CPC classification number: B60S1/0866 ,  H04R1/406 ,  H04R3/005 ,  G10L25/51 ,  B60S1/0803 ,  B60S1/026 ,  H04R2499/13 ,  G01C21/3691

Abstract: An automatic rain response system includes microphones of a vehicle, windshield wipers, and a controller. The microphones generate acoustic signals in response to rain. The controller is configured to receive a local weather condition, extract acoustic features from the acoustic signals, form feature vectors in response to the acoustic features and the local weather condition, classify the feature vectors to determine a current class among multiple classes, activate the windshield the wipers at a high speed in response to the current class being a heavy rain on a windshield class, activate the windshield wipers at a medium speed in response to the current class being a freezing rain on the windshield class, activate the windshield wipers at a low speed in response to the current class being a light rain on the windshield class, and deactivate the windshield wipers in response to the current class being a no rain class.

公开(公告)号：US11891083B2

公开(公告)日：2024-02-06

申请号：US17544066

申请日：2021-12-07

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Neeraj R. Gautama ,  Jarvis Chau ,  Jomo Hanley ,  Kelley J. Kettenbeil ,  Gina E. Griffith ,  Scott E. Jackson ,  Ian Gibbs ,  Mark T. Gaylord ,  Maria Alejandra Gonzalez ,  Nicholis Festa ,  Nathan Robinson ,  Ute Winter ,  Sachin Raviram

IPC: B60W50/14 ,  H04W4/46 ,  B60W50/10 ,  G06V40/16 ,  G06V20/59

CPC classification number: B60W50/14 ,  B60W50/10 ,  G06V20/597 ,  G06V40/174 ,  H04W4/46 ,  B60W2050/146

Abstract: A system for context-based adaptive virtual experience control in a vehicle is provided. The system includes an output device configured for providing a sensory output to a user of the vehicle and a computerized virtual experience control module configured for controlling the output device based upon a virtual experience mode. The system further includes a computerized context-based adaptive control module configured for monitoring contextual data related to one of the user of the vehicle or operation of the vehicle, monitoring feedback from the user related to one of favor or disfavor related to the virtual experience mode, and utilizing the contextual data and the feedback from the user to selectively, automatically command activation of the virtual experience mode.

公开(公告)号：US20230419690A1

公开(公告)日：2023-12-28

申请号：US17846548

申请日：2022-06-22

Applicant: GM Global Technology Operations LLC

Inventor： Wei Tong ,  Alaa M. Khamis ,  Sai Vishnu Aluru

IPC: G06V20/59 ,  G06V10/25 ,  G06V10/80 ,  G06V20/40 ,  H04N5/235 ,  G06T7/215 ,  G06T7/292 ,  G06V20/20

CPC classification number: G06V20/59 ,  G06V10/25 ,  G06V10/809 ,  G06V20/41 ,  H04N5/2353 ,  G06T7/215 ,  G06T7/292 ,  G06V20/20 ,  G06T2207/30268

Abstract: An in-vehicle violence detection and fusion system includes a standard vehicle camera positioned within a vehicle capturing images of at least one occupant of the vehicle. An event camera positioned within the vehicle captures motion images of the at least one occupant. A standard vehicle camera-based region of interest (ROI) signal and an event camera-based ROI signal are received and fused by an ROI fusion module to generate a fused ROI signal. A threat evaluation module receives the fused ROI signal and augments the fused ROI signal with saved data to assist in differentiating normal events from threat events. An event camera-based violence indicator identifies the threat events to the at least one occupant of the vehicle.

公开(公告)号：US20230415697A1

公开(公告)日：2023-12-28

申请号：US17809231

申请日：2022-06-27

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Drew Walker ,  Jarvis Chau

IPC: B60R22/48 ,  G07C5/00 ,  G07C5/10

CPC classification number: B60R22/48 ,  G07C5/008 ,  G07C5/10 ,  B60R2022/4866 ,  B60R2022/4883 ,  B60R2022/4841 ,  B60R2022/4816

Abstract: Systems and methods are provided for monitoring seatbelt usage by an occupant of a vehicle. The method includes, by a processor: receiving sensor data generated by at least one sensing device of the vehicle, determining a seatbelt gaming activity has occurred based on the sensor data, wherein the seatbelt gaming activity occurs when a seatbelt of the vehicle is latched while the occupant is not secured to a corresponding seat with the seatbelt, performing a persistence check to compare a frequency of the seatbelt gaming activity over a period of time to a minimum seatbelt gaming activity threshold, determining a classification of seatbelt gaming activity attributed to the occupant based on the persistence check, and generating record data that includes the classification of seatbelt gaming activity attributed to the occupant.

公开(公告)号：US20230144986A1

公开(公告)日：2023-05-11

申请号：US17519866

申请日：2021-11-05

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Alaa M. Khamis ,  Ramzi Abdelmoula ,  Vyacheslav Berezin ,  Arief B. Koesdwiady ,  Pedro E. Villanueva Pena

IPC: B60L53/66 ,  B60L53/30 ,  B60L55/00 ,  G06Q30/08

CPC classification number: B60L53/665 ,  B60L53/305 ,  B60L55/00 ,  G06Q30/08

Abstract: Presented are intelligent charging systems for transferring energy to and from motor vehicles, methods for making/operating such systems, and vehicles with V2V and V2G energy transfer capabilities. A method for operating an intelligent charging system includes a system controller receiving, from a user interface of a user, a request to schedule a transfer of electricity to the user. The system controller broadcasts to a crowdsourced set of service providers a solicitation for energy transfer bids for completing the user’s transfer request. After receiving multiple bid submissions for completing the transfer request from multiple service providers, the system controller selects an optimized one of the bid submissions using a multi-criteria selection strategy. The multi-criteria selection strategy includes a joint utility maximization function and/or a trade-off Pareto solution. The system controller transmits to the service provider associated with the optimized bid submission a task allocation with instructions to provide the transfer request.

公开(公告)号：US11600278B2

公开(公告)日：2023-03-07

申请号：US17234221

申请日：2021-04-19

Applicant: GM Global Technology Operations LLC

Inventor： Alaa M. Khamis ,  Gaurav Talwar ,  Romeo D. Garcia, Jr. ,  Carmine F. D'agostino ,  Neeraj R. Gautama

IPC: G10L15/22 ,  G10L21/02 ,  H04R3/00 ,  G10L21/0208 ,  G10L21/0272

Abstract: A vehicle includes a plurality of microphones to obtain speech from a person outside the vehicle as an input signal and a sensor system to determine a location and orientation of the person relative to the vehicle. The vehicle also includes a controller to determine characteristics of the input signal and to determine whether to perform speech enhancement on the input signal based on one or more of the characteristics and the location and orientation of the person.

公开(公告)号：US11507346B1

公开(公告)日：2022-11-22

申请号：US17509306

申请日：2021-10-25

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Xu Fang Zhao ,  Gaurav Talwar ,  Alaa M. Khamis

IPC: G06F3/048 ,  G06F3/16 ,  G10L15/22

Abstract: A method for text feedback includes: receiving, by a controller, an utterance from a user; determining, by an automatic speech recognition engine of the controller, a plurality of speech recognition results based on the utterance from the user, wherein the speech recognition results include probable commands; determining, by the automatic speech recognition engine of the controller, a plurality of confidence scores for each of the plurality of speech recognition results; determining, by the controller, a text characteristic for each of the plurality of probable commands as a function of the confidence scores for each of the plurality of speech recognition results; and commanding, by the controller, a display to show text corresponding to each of the plurality of probable commands with the text characteristic determined by the controller.