-
公开(公告)号:US20220121889A1
公开(公告)日:2022-04-21
申请号:US17072095
申请日:2020-10-16
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Mohannad Murad , Wende Zhang , Kevin K. Hoang
Abstract: A system and method are provided for aiding an operator in operating a vehicle. In one embodiment, a system includes a sensor system configured to generate sensor data sensed from an environment of the vehicle. The system further includes a control module configured to, by a processor, generate a bowl view image of the environment based on the sensor data, identify at least one of a double object and a missing object in the bowl view image, generate a second bowl view image of the environment by re-stitching the sensor data based on the at least one of double object and missing object, and generate display data based on the second bowl view image.
-
公开(公告)号:US20220035014A1
公开(公告)日:2022-02-03
申请号:US16944253
申请日:2020-07-31
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Yousef A. Omar , Hao Yu , Wende Zhang
IPC: G01S7/497 , G01S17/931 , G01S17/86
Abstract: Systems and method are provided for controlling a vehicle. In one embodiment, a method includes: receiving, by a controller onboard the vehicle, lidar data from the lidar device; receiving, by the controller, image data from the camera device; computing, by the controller, an edge map based on the lidar data; computing, by the controller, an inverse distance transformation (IDT) edge map based on the image data; aligning, by the controller, points of the IDT edge map with points of the lidar edge map to determine extrinsic parameters; storing, by the controller, extrinsic parameters as calibrations in a data storage device; and controlling, by the controller, the vehicle based on the stored calibrations.
-
公开(公告)号:US20200380725A1
公开(公告)日:2020-12-03
申请号:US16423821
申请日:2019-05-28
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Brian J. Hufnagel , Hao Yu , Wende Zhang
Abstract: In various embodiments, methods and systems are provided for calibrating vehicle cameras. In certain embodiments, a method includes obtaining a plurality of camera images from the camera based on a target positioned at a plurality of locations relative to the vehicle, wherein the target includes a plurality of dots arranged in rows and columns according to a random spacing, wherein the target further includes a plurality of enlarged dots arranged in an L shaped pattern in relation to a center of the target; estimating, by a processor, at least one of intrinsic parameters and extrinsic parameters based on the plurality of camera images; and storing, by a processor and in a data storage device, the at least one of intrinsic parameters and extrinsic parameters as calibration parameters associated with the camera.
-
114.
公开(公告)号:US20190318041A1
公开(公告)日:2019-10-17
申请号:US15950917
申请日:2018-04-11
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Fan Bai , Mohannad Murad , Joseph G. Machak , Wende Zhang
Abstract: In various embodiments, methods, systems, and vehicles are provided that include obtaining first camera images from a first camera onboard a first vehicle; generating, via one or more computer processors, a first situation awareness graph with respect to objects near the first vehicle, using the first camera images; obtaining second camera images from a second camera of a second device that is in proximity to the first vehicle; generating, via one or more computer processors, a second situation awareness graph with the respect to the objects, using the second camera images; and generating, via one or more computer processor, a global situation awareness graph with respect to the objects, by merging the first situation awareness graph with the second situation awareness graph, using respective first and second weights for the first and second situation awareness graphs.
-
公开(公告)号:US10318824B2
公开(公告)日:2019-06-11
申请号:US14803894
申请日:2015-07-20
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Wende Zhang , Zhencheng Hu
Abstract: A system and method on a vehicle for providing extended detection range of a stop line on a roadway. The system and method includes a front view camera on the vehicle that provides images of the roadway in front of the vehicle and a controller that receives images from the front view camera. The controller is programmed to extract an upper portion of a front view image that is remapped onto an extended bird's eye view image such that the detection range of the stop line is detected.
-
公开(公告)号:US10162360B2
公开(公告)日:2018-12-25
申请号:US15366948
申请日:2016-12-01
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Xiujie Gao , Jinsong Wang , Wende Zhang , Paul E. Krajewski , Nancy L. Johnson , Timothy J. Canner , Donald K. Grimm
Abstract: A vehicle includes at least one image capture device and a user display configured to display images receive from the at least one image capture device. The vehicle also includes a controller programmed to generate a user prompt to set a home vehicle position in response the vehicle entering a first parked state. The controller is also programmed to store at least one reference image indicative of an area in a vicinity of the vehicle corresponding to the home vehicle position. The controller is further programmed to collect a current image corresponding to a current vehicle position in response to a subsequent approach toward the vicinity, and compare the current image to the reference image. The controller is further programmed to generate a user display depicting the vicinity, the current vehicle position, and the home vehicle position.
-
公开(公告)号:US09986173B2
公开(公告)日:2018-05-29
申请号:US14710289
申请日:2015-05-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Wende Zhang , Bakhtiar Brian Litkouhi
CPC classification number: H04N5/247 , B60R1/00 , B60R2300/102 , B60R2300/105 , B60R2300/303 , G06T7/80 , G06T7/85 , G06T2207/10021 , G06T2207/30261 , G06T2207/30264 , H04N17/002
Abstract: A system and method for providing online calibration of a plurality of cameras in a surround-view camera system on a vehicle. The method provides consecutive images from each of the cameras in the surround-view system and identifies overlap image areas for adjacent cameras. The method identifies matching feature points in the overlap areas of the images and estimates camera parameters in world coordinates for each of the cameras. The method then estimates a vehicle pose of the vehicle in world coordinates and calculates the camera parameters in vehicle coordinates using the estimated camera parameters in the world coordinates and the estimated vehicle pose to provide the calibration.
-
公开(公告)号:US09981605B2
公开(公告)日:2018-05-29
申请号:US14710322
申请日:2015-05-12
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jinsong Wang , Wende Zhang , Bakhtiar B. Litkouhi
IPC: H04N7/18 , H04N9/47 , B60R1/00 , H04N13/02 , B60R11/04 , H04N5/247 , H04N17/00 , G06T7/80 , H04N13/00 , B60R11/00
CPC classification number: B60R1/00 , B60R11/04 , B60R2011/004 , B60R2011/0089 , B60R2300/402 , G06T7/85 , G06T2207/10004 , G06T2207/10012 , G06T2207/30232 , G06T2207/30252 , H04N5/247 , H04N13/243 , H04N13/246 , H04N13/282 , H04N17/002 , H04N2013/0085 , H04N2013/0088
Abstract: A system and method for correcting the calibration of a plurality of cameras on a mobile platform such as in a surround-view camera system on a vehicle based on changes in vehicle dynamics. The method includes reading measurement values from one or more sensors on the vehicle that identify a change in vehicle dynamics and defining the plurality of cameras and a vehicle body as a single reference coordinate system. The method also includes identifying the measured values as a rotation matrix and a translation vector in the coordinate system, and integrating the rotation matrix and the translation vector into a relationship between a vehicle coordinate system and a camera coordinate system to provide the calibration correction of the cameras.
-
公开(公告)号:US09979897B2
公开(公告)日:2018-05-22
申请号:US15175248
申请日:2016-06-07
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Veronique C. Prinet , Caroline Chung , Wende Zhang
CPC classification number: H04N5/2357 , G06K9/00791 , G06K9/4609 , G06K9/6267 , G06T5/002 , G06T7/11 , G06T7/215 , G06T2207/10016 , G06T2207/20182 , H04N5/2351 , H04N5/2354
Abstract: A method of detecting and correcting flicker. A video stream of a scene at various instances of time is captured by an image capture device. A local spatio-temporal feature extraction technique is applied, by a processor, to regions of the capture scene within each frame. Candidate flickering region detection is applied, by a classifier, to identify candidate regions. Corresponding candidate regions are tracked over time to detect illumination differences within each analyzed region. An illumination correction technique is applied to the candidate regions where flickering is detected. A flicker-free video is output on a display device.
-
公开(公告)号:US20170322560A1
公开(公告)日:2017-11-09
申请号:US15492339
申请日:2017-04-20
Applicant: GM Global Technology Operations LLC
Inventor: Wende Zhang , Adrienne M. Williamson , Esther Anderson , Jinsong Wang
Abstract: A vehicle guidance system facilitates maneuvering of an autonomous vehicle with respect to an object in a scene. The vehicle includes a steering apparatus having a range of angular positions and a multitude of actuators for controlling the dynamics of the vehicle. The system includes a steering angle sensor, a camera device, and a video processing module. The sensor is configured to monitor the angular position of the wheel. The device is configured to capture an original image of a scene having the object. The module is configured to receive and process the original image from the device, detect the object in the original image, receive and process the angular position from the sensor, generate a dynamic trajectory based on at least the angular position, orientate the dynamic trajectory with regard to the object, and operate at least one of the actuators to guide the vehicle along the dynamic trajectory.
-
-
-
-
-
-
-
-
-