公开(公告)号：US20230316914A1

公开(公告)日：2023-10-05

申请号：US17711476

申请日：2022-04-01

Applicant: GM Global Technology Operations LLC

Inventor： Joseph Philip McLaine ,  Joseph F. Szczerba ,  John P. Weiss ,  Thomas A. Seder ,  Kai-Han Chang ,  Steven Landry

IPC: G08G1/133 ,  G06F3/14 ,  G06F3/01 ,  B60K35/00 ,  G08G1/00 ,  G08G1/09 ,  G02B27/01

CPC classification number: G08G1/133 ,  G06F3/14 ,  G06F3/013 ,  B60K35/00 ,  G08G1/20 ,  G02B2027/0141 ,  G08G1/22 ,  G02B27/0101 ,  B60K2370/152 ,  B60K2370/177 ,  G08G1/093

Abstract: A method is designed to provide platooning information using a multi-focal plane augmented reality display of a host vehicle. The method includes receiving platooning data from at least one of a plurality of remote vehicles. Each of the plurality of remote vehicle is part of a platoon. The platooning data includes locations, trajectories, and headways of each of the plurality of remote vehicles. The method further includes determining whether the platoon is within a predetermined distance from the host vehicle using the platooning data. Further, the method includes transmitting a command signal to the multi-focal plane augmented reality display of the host vehicle to display a virtual image on the multi-focal plane augmented reality display. The virtual image is indicative of a platooning action related to the platoon that is within the predetermined distance from the host vehicle.

公开(公告)号：US20230296886A1

公开(公告)日：2023-09-21

申请号：US17695041

申请日：2022-03-15

Applicant: GM Global Technology Operations LLC

Inventor： Kai-Han Chang ,  Thomas A, Seder ,  Joseph F. Szczerba ,  John P. Weiss

IPC: G02B27/01

CPC classification number: G02B27/0101 ,  G02B27/0179 ,  G02B2027/0118 ,  G02B2027/0187

Abstract: A head-up display system includes a laser adapted to project a holographic image, a spatial light modulator, an exit pupil replicator, a diffuser adapted to be positioned within a x-y plane at a center point of a vehicle eyellipse, the hologram projector adapted to project a dot pattern onto the diffuser, and a controller adapted to characterize an intensity distribution of the dot pattern, store the intensity distribution therein, acquire a location of a driver's eyes, map the location of the driver's eyes to the intensity distribution of the dot pattern, and implement corrective action based on the intensity distribution at the location of the driver's eyes.

公开(公告)号：US11758114B2

公开(公告)日：2023-09-12

申请号：US17480624

申请日：2021-09-21

Applicant: GM Global Technology Operations LLC

Inventor： Ke Liu ,  Joseph F. Szczerba

IPC: H04N13/31 ,  B60K35/00 ,  H04N13/383 ,  H04N13/398 ,  G06F3/01 ,  G02B30/31 ,  G02B27/00

CPC classification number: H04N13/31 ,  B60K35/00 ,  G02B27/0093 ,  G02B30/31 ,  G06F3/013 ,  H04N13/383 ,  H04N13/398 ,  B60K2370/149 ,  B60K2370/152

Abstract: A virtual 3D display for a motor vehicle includes a substrate and a flexible display positioned on the substrate. The flexible display has two foldable sections and a main section. The main section provides a shared viewing area and each of the foldable sections provides a first and a second independent viewing area.

公开(公告)号：US20230282210A1

公开(公告)日：2023-09-07

申请号：US17685716

申请日：2022-03-03

Applicant: GM Global Technology Operations LLC

Inventor： Jacob Alan Bond ,  Hannah Elizabeth Wagner ,  Joseph F. Szczerba ,  Alan D. Hejl

IPC: G10L15/22 ,  G10L15/16 ,  G10L15/25 ,  G06T7/20 ,  G06K9/62 ,  B60W40/08 ,  G06N3/08

CPC classification number: G10L15/22 ,  B60W40/08 ,  G06K9/6289 ,  G06N3/08 ,  G06T7/20 ,  G10L15/16 ,  G10L15/25 ,  B60W2040/089 ,  B60W2420/42 ,  B60W2420/54 ,  B60W2540/21 ,  B60W2540/221 ,  G06T2207/30201 ,  G10L2015/223

Abstract: A speech recognition method includes receiving audible data and user data. The audible data includes information about an utterance by the user. The user data includes information about movements by the user. The method further includes fusing the audible data and the user data to obtain fused data and determining at least one spoken word of the utterance based on the fused data.

公开(公告)号：US11699250B1

公开(公告)日：2023-07-11

申请号：US17862859

申请日：2022-07-12

Applicant: GM Global Technology Operations LLC

Inventor： Morgan Lee McCann ,  Joseph F. Szczerba ,  John P. Weiss ,  Kai-Han Chang ,  Thomas A. Seder

IPC: G06T11/00 ,  H04N9/31 ,  G06V20/58 ,  B60K37/00 ,  G02B27/01 ,  G06F3/01 ,  G06V10/58

CPC classification number: G06T11/00 ,  B60K37/00 ,  G02B27/0101 ,  G02B27/0179 ,  G06F3/013 ,  G06V10/58 ,  G06V20/58 ,  H04N9/3135 ,  B60K2370/1529 ,  B60K2370/177 ,  B60K2370/21 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0141 ,  G02B2027/0181 ,  G06T2210/12

Abstract: A method for low visibility driving includes receiving image data from a visible-light camera. The image data includes an image of an area in front of a vehicle. The method includes receiving sensor data from an object-detecting sensor. The object-detecting sensor is configured to detect an object in front of the vehicle. The sensor data includes information about the object in front of the vehicle. The method further includes detecting the object in front of the vehicle using the sensor data received from the object-detecting sensor and determining whether the visible-light camera is unable to detect the object in front of the vehicle that was detected by the object-detecting sensor. The method further includes commanding a display to generate a virtual image using the sensor data to identify the object in front of the vehicle.

公开(公告)号：US11697346B1

公开(公告)日：2023-07-11

申请号：US17707239

申请日：2022-03-29

Applicant: GM Global Technology Operations LLC

Inventor： John P. Weiss ,  Joseph F. Szczerba ,  Thomas A. Seder ,  Kai-Han Chang

IPC: B60K35/00 ,  G06V20/56 ,  G06T7/73 ,  G06T7/50 ,  G06T11/00 ,  G02B27/00 ,  G02B27/01 ,  G08G1/0967

CPC classification number: B60K35/00 ,  G02B27/0093 ,  G02B27/0101 ,  G06T7/50 ,  G06T7/73 ,  G06T11/001 ,  G06V20/588 ,  G08G1/096766 ,  B60K2370/1529 ,  B60K2370/168 ,  B60K2370/178 ,  B60K2370/179 ,  B60K2370/188 ,  B60K2370/21 ,  B60K2370/52 ,  B60K2370/736 ,  G02B2027/014 ,  G02B2027/0138 ,  G02B2027/0141 ,  G06T2207/30256

Abstract: A head-up display system for a vehicle includes at least one light source adapted to project an image upon an inner surface of a windshield of the vehicle, a driver monitoring system adapted to track a position of a driver's eyes, at least one non-visual sensor adapted to detect objects within an environment surrounding the vehicle, at least one image capturing device adapted to capture images of the environment surrounding the vehicle, and, a controller in communication with the at least one laser, the at least one non-visual sensor and the at least one image capturing device, the controller adapted to identify lane markers and objects within the environment surrounding the vehicle, determine the position of the vehicle within a lane of a roadway the vehicle is traveling upon, and, display, with the at least one light source, a lane position alert.

公开(公告)号：US11663939B1

公开(公告)日：2023-05-30

申请号：US17702320

申请日：2022-03-23

Applicant: GM Global Technology Operations LLC

Inventor： John P. Weiss ,  Joseph F. Szczerba ,  Omer Tsimhoni ,  Jeffrey Rupert Cooke

IPC: G09G3/00 ,  G06V20/58 ,  G02B27/01 ,  B60K35/00

CPC classification number: G09G3/001 ,  B60K35/00 ,  G02B27/0101 ,  G06V20/58 ,  B60K2370/1529 ,  B60K2370/166 ,  B60K2370/167 ,  B60K2370/168 ,  B60K2370/177 ,  B60K2370/21 ,  B60K2370/52 ,  B60K2370/736 ,  B60K2370/741 ,  G02B2027/0138 ,  G02B2027/0141 ,  G09G2340/04 ,  G09G2354/00 ,  G09G2380/10

Abstract: An augmented reality head-up display system for displaying graphics upon a windscreen of a vehicle includes one or more image-capturing devices that capture image data of an environment surrounding the vehicle, a graphic projection device for generating images upon the windscreen of the vehicle, and a controller in electronic communication with the one or more image-capturing devices and the graphic projection device. The controller executes instructions to receive object detection data indicating a current position of objects located within the environment surrounding the vehicle. The controller executes instructions to compare the current position of the objects within the environment with a visual location of the objects within the environment determined based on the image data to identify a visually occluded object located within the environment. In response to identifying the visually occluded object, the controller determines a contextual graphic that signifies the visually occluded object.

公开(公告)号：US11645038B1

公开(公告)日：2023-05-09

申请号：US17828121

申请日：2022-05-31

Applicant: GM Global Technology Operations LLC

Inventor： Jacob Alan Bond ,  Joseph F. Szczerba ,  Hannah Elizabeth Wagner ,  Kai-Han Chang ,  Thomas A. Seder

IPC: G06F3/16 ,  G06F3/01

CPC classification number: G06F3/167 ,  G06F3/011

Abstract: An augmented reality head up display system includes an audio microphone array, a driver position tracking device, and an augmented reality head up display. The augmented reality head up display system also includes a controller in electronic communication with the audio microphone array, the driver position tracking device, and the augmented reality head up display, where the controller is programmed to: receive audio data from the audio microphone array corresponding to audio detected by the audio microphone array, classify the audio data as corresponding to an audio event occurring in an environment surrounding the vehicle, and display a graphic corresponding to the audio event on the windscreen of the vehicle using the augmented reality head up display and input from the driver position tracking device.

公开(公告)号：US11630302B1

公开(公告)日：2023-04-18

申请号：US17714418

申请日：2022-04-06

Applicant: GM Global Technology Operations LLC

Inventor： John P. Weiss ,  Joseph F. Szczerba ,  Thomas A. Seder ,  Kai-Han Chang

IPC: B60W30/095 ,  B60W30/08 ,  G02B27/01 ,  G09G3/00 ,  G06F3/01 ,  G06V20/56 ,  G06V20/58 ,  B60K35/00

Abstract: A driving guidance system is provided for a motor vehicle having a windshield. The system includes an input device for generating an input signal associated with the movement of the motor vehicle, a road detection module for generating a road signal associated with a road geometry, and an ARHUD for generating a plurality of images upon the windshield. The system further includes a computer having a processor and a non-transitory computer readable medium storing instructions, such that the processor is programmed to receive the input signal and the road signal. The processor is further programmed to determine a predicted trajectory and a recommended trajectory of the motor vehicle along the road geometry based on the input signal and the road signal. The ARHUD is configured to generate the images upon the windshield and overlaid onto the road geometry to notify the driver of the predicted trajectory and the recommended trajectory.

公开(公告)号：US20230058508A1

公开(公告)日：2023-02-23

申请号：US17445450

申请日：2021-08-19

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Lawrence A. Bush ,  Joseph F. Szczerba ,  Roy J. Mathieu

IPC: G01C21/36 ,  B60W50/16 ,  B60W60/00 ,  B60W40/105

Abstract: A method for providing a situational awareness interface for an occupant of an automated vehicle is provided. The method includes: generating a vehicle route graphic that displays a street level map of an area that includes a current location of the vehicle and an intended destination of the vehicle along with a visual depiction of a planned route and one or more alternate routes for the vehicle; determining a probability of requiring assistance or interaction and an estimated time of arrival for each of the planned route and the one or more alternate routes; providing a visual indication of the probability of requiring assistance or interaction and the estimated time of arrival for each of the planned route and the one or more alternate routes on the vehicle route graphic; and signaling a display device to display the vehicle route graphic.