公开(公告)号：US20240134022A1

公开(公告)日：2024-04-25

申请号：US18047102

申请日：2022-10-17

Applicant: GM Global Technology Operations LLC

Inventor： Wei Zeng ,  Shuqing Zeng ,  Huabing Zhu ,  Jordan B. Chipka

IPC: G01S7/497 ,  G01S17/00 ,  G01S17/89 ,  G01S17/931

CPC classification number: G01S7/497 ,  G01S17/006 ,  G01S17/89 ,  G01S17/931 ,  G01S2007/4975

Abstract: A method of modeling precipitation effects in a virtual LiDAR sensor, the method includes receiving a point cloud model representing three-dimensional coordinates of objects as the objects would be sensed by a LiDAR sensor. The method further includes generating a stochastic model of rainfall or snowfall, estimating a probability that a light source from the LiDAR sensor hits a raindrop or a snowflake based on the stochastic model, and modifying the received point cloud model to include effects induced by the modeled rainfall or snowfall based on the probability that light sourced from the LiDAR sensor encounters a raindrop or a snowflake.

公开(公告)号：US11592574B2

公开(公告)日：2023-02-28

申请号：US16711724

申请日：2019-12-12

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Wei Zeng ,  Shuqing Zeng ,  Scott E. Parrish

IPC: H04B10/00 ,  G01S17/931 ,  G01S7/481

Abstract: In an exemplary embodiment, a LiDAR is provided that is configured for installation in a mobile platform. The LiDAR includes a scanner and a light-intensity receiver. The scanner includes a light source configured to direct illumination in an illuminating direction. The light-intensity receiver includes one or more light-intensity sensors; and one or more lens assemblies configured with respect to the one or more light-intensity sensors, such that that at least one sensor plane from the one or more light-intensity sensors is tilted to form a non-zero angle with at least one equivalent lens plane from the one or more lens assemblies, transferring the sensor focal plane to be align with the main light illumination direction and be consistent with the direction of movement of a mobile platform.

公开(公告)号：US20230027275A1

公开(公告)日：2023-01-26

申请号：US17382459

申请日：2021-07-22

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Wei Tong ,  Shige Wang ,  Shuqing Zeng

IPC: G06K9/32 ,  G06K9/00 ,  G01S17/89 ,  G01S17/931 ,  B60W60/00 ,  B60W40/06 ,  B60W50/14

Abstract: A system for an attention-based perception includes a camera device configured to provide an image of an operating environment of a vehicle. The system further includes a computerized device monitoring the image, analyzing sensor data to identify a feature in the image as corresponding to an object in the operating environment and assign a score for the feature based upon an identification, a location, or a behavior of the object. The computerized device is further operable to define candidate regions of interest upon the image, correlate the score for the feature to the candidate regions of interest to accrue a total region score, select some of the candidate regions for analysis based upon the total region scores, and analyze the portion of the candidate regions to generate a path of travel output. The system further includes a device controlling the vehicle based upon the output.

公开(公告)号：US20230010239A1

公开(公告)日：2023-01-12

申请号：US17367847

申请日：2021-07-06

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Shuqing Zeng ,  Jordan B. Chipka ,  Thanura R. Elvitigala

IPC: G06K9/00 ,  G06K9/32 ,  G06T3/40 ,  G06N3/08 ,  B60R11/04

Abstract: A perception system is adapted to receive visual data from a camera and includes a controller having a processor and tangible, non-transitory memory on which instructions are recorded. A subsampling module, an object detection module and an attention module are each selectively executable by the controller. The controller is configured to sample an input image from the visual data to generate a rescaled whole image frame, via the subsampling module. The controller is configured to extract feature data from the rescaled whole image frame, via the object detection module. A region of interest in the rescaled whole image frame is identified, based on an output of the attention module. The controller is configured to generate a first image based on the rescaled whole image frame and a second image based on the region of interest, the second image having a higher resolution than the first image.

公开(公告)号：US20220253635A1

公开(公告)日：2022-08-11

申请号：US17190663

申请日：2021-03-03

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Bo YU ,  Sycamore Zhang ,  Shuqing Zeng ,  Kamran Ali ,  Vivek Vijaya Kumar ,  Donald K. Grimm

IPC: G06K9/00 ,  G06K9/62 ,  G06K9/32 ,  B60W60/00 ,  B60W30/08 ,  G06K9/68

Abstract: An attention-driven streaming system includes an adaptive-streaming module and a transceiver. The adaptive-streaming module includes filters, a compression module, an attention-driven strategy module and a fusion module. The filters filter sensor data received from sensors of a vehicle. The compression module compresses the filtered sensor data to generate compressed data. The attention-driven strategy module generates feedforward information based on a state of the vehicle and a state of an environment of the vehicle to adjust a region of interest. The fusion module generates an adaptive streaming strategy to adaptively adjust operations of each of the filters. The transceiver streams the compressed data to at least one of an edge computing device or a cloud-based network device and in response receive feedback information and pipeline monitoring information. The fusion module generates the adaptive streaming strategy based on the feedforward information, the feedback information and the pipeline monitoring information.

公开(公告)号：US20210245743A1

公开(公告)日：2021-08-12

申请号：US16785771

申请日：2020-02-10

Applicant: GM Global Technology Operations LLC

Inventor： Shengbing Jiang ,  Shuqing Zeng ,  Prakash Mohan Peranandam ,  Meng Jiang ,  Jiyu Zhang ,  Mohamed A. Layouni

IPC: B60W30/095 ,  B60W30/09 ,  G01S13/931 ,  G01S17/931 ,  B60W50/16

Abstract: Methods and systems to implement sensor fusion to determine collision potential for a vehicle include identifying a specific intersection that the vehicle is approaching, and identifying collision potential scenarios associated with one or more paths through the specific intersection. Each collision potential scenario defines a risk of a collision between the vehicle and an object in a specified area. A weight with which one or more information sources of the vehicle are considered is adjusted for each collision potential scenario such that a highest weight is given to one or more of the one or more information sources that provide most relevant and reliable information about the specified area. Sensor fusion is implemented based on the adjusting the weight of the one or more information sources and performing detection based on the sensor fusion, and an alert is provided or actions are implemented according to the detection.

公开(公告)号：US20210239449A1

公开(公告)日：2021-08-05

申请号：US16776812

申请日：2020-01-30

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Suresh Gopalakrishnan ,  Shuqing Zeng ,  Chandra S. Namuduri

IPC: G01B7/30 ,  G08C23/04 ,  B60L15/06 ,  B60W10/08

Abstract: An electric powertrain includes a sensor-controller interface, an inverter-controller electrically connected to the battery pack, and an electric machine connected to the inverter-controller and having a rotor with an angular position. The rotor powers a driven load at a torque and/or speed level controlled by the inverter-controller in response to position signals indicative of the angular position. A rotary position sensor is operatively connected to the rotor to generate and output the position signals. The sensor derives the position signals from unmodulated sine and cosine signals, and communicates the position signals and a binary sensor state of health (SOH) to the inverter-controller over the interface. The inverter-controller also decodes the position signals and the binary sensor SOH to generate decoded control data, and controls the torque and/or speed level using the decoded control data.

公开(公告)号：US20210181350A1

公开(公告)日：2021-06-17

申请号：US16711724

申请日：2019-12-12

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Wei Zeng ,  Shuqing Zeng ,  Scott E. Parrish

IPC: G01S17/931 ,  G01S7/481

Abstract: In an exemplary embodiment, a LiDAR is provided that is configured for installation in a mobile platform. The LiDAR includes a scanner and a light-intensity receiver. The scanner includes a light source configured to direct illumination in an illuminating direction. The light-intensity receiver includes one or more light-intensity sensors; and one or more lens assemblies configured with respect to the one or more light-intensity sensors, such that that at least one sensor plane from the one or more light-intensity sensors is tilted to form a non-zero angle with at least one equivalent lens plane from the one or more lens assemblies, transferring the sensor focal plane to be align with the main light illumination direction and be consistent with the direction of movement of a mobile platform.

公开(公告)号：US11035945B2

公开(公告)日：2021-06-15

申请号：US16387998

申请日：2019-04-18

Applicant: GM Global Technology Operations LLC

Inventor： Tzvi Philipp ,  Shahar Villeval ,  Igal Bilik ,  Jeremy A. Salinger ,  Shuqing Zeng

IPC: G01S13/58 ,  G05D1/02 ,  G01S13/86 ,  G01S13/931 ,  G01S13/02 ,  G01S13/44 ,  G01S13/00

Abstract: System and method of controlling operation of a device in real-time. The system includes an optical sensor having a steerable optical field of view for obtaining image data and a radar unit having a steerable radar field of view for obtaining radar data. A controller may be configured to steer a first one of the optical sensor and the radar unit to a first region of interest and a second one of the optical sensor and the radar unit to the second region of interest. The controller may be configured to steer both the optical sensor and the radar unit to the first region of interest. The radar data and the image data are fused to obtain a target location and a target velocity. The controller is configured to control operation of the device based in part on at least one of the target location and the target velocity.

公开(公告)号：US20210129842A1

公开(公告)日：2021-05-06

申请号：US16671727

申请日：2019-11-01

Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC

Inventor： Shige Wang ,  Wei Tong ,  Stephen N. McKinnie ,  Shuqing Zeng

IPC: B60W30/14 ,  B60W30/09 ,  B60W30/17 ,  H04L12/403 ,  H04J3/06 ,  H04L29/08

Abstract: Presented are embedded control systems with logic for computation and data sharing, methods for making/using such systems, and vehicles with distributed sensors and embedded processing hardware for provisioning automated driving functionality. A method for operating embedded controllers connected with distributed sensors includes receiving a first data stream from a first sensor via a first embedded controller, and storing the first data stream with a first timestamp and data lifespan via a shared data buffer in a memory device. A second data stream is received from a second sensor via a second embedded controller. A timing impact of the second data stream is calculated based on the corresponding timestamp and data lifespan. Upon determining that the timing impact does not violate a timing constraint, the first data stream is purged from memory and the second data stream is stored with a second timestamp and data lifespan in the memory device.