-
公开(公告)号:US10558868B2
公开(公告)日:2020-02-11
申请号:US15845381
申请日:2017-12-18
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Qingrong Zhao , Jinsong Wang , Bakhtiar B. Litkouhi , Jingfu Jin , Tianyu Wang
Abstract: A vehicle includes a plurality of on-vehicle cameras, and a controller executes a method to evaluate a travel surface by capturing images for fields of view of the respective cameras. Corresponding regions of interest for the images are identified, wherein each of the regions of interest is associated with the portion of the field of view of the respective camera that includes the travel surface. Portions of the images are extracted, wherein each extracted portion is associated with the region of interest in the portion of the field of view of the respective camera that includes the travel surface and wherein one extracted portion of the respective image includes the sky. The extracted portions of the images are compiled into a composite image datafile, and an image analysis of the composite image datafile is executed to determine a travel surface state. The travel surface state is communicated to another controller.
-
公开(公告)号:US10528056B2
公开(公告)日:2020-01-07
申请号:US15492339
申请日:2017-04-20
Applicant: GM Global Technology Operations LLC
Inventor: Wende Zhang , Adrienne M. Williamson , Esther Anderson , Jinsong Wang
Abstract: A vehicle guidance system facilitates maneuvering of an autonomous vehicle with respect to an object in a scene. The vehicle includes a steering apparatus having a range of angular positions and a multitude of actuators for controlling the dynamics of the vehicle. The system includes a steering angle sensor, a camera device, and a video processing module. The sensor is configured to monitor the angular position of the wheel. The device is configured to capture an original image of a scene having the object. The module is configured to receive and process the original image from the device, detect the object in the original image, receive and process the angular position from the sensor, generate a dynamic trajectory based on at least the angular position, orientate the dynamic trajectory with regard to the object, and operate at least one of the actuators to guide the vehicle along the dynamic trajectory.
-
公开(公告)号:US10293664B2
公开(公告)日:2019-05-21
申请号:US15434649
申请日:2017-02-16
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Xiujie Gao , Jinsong Wang , Wende Zhang , Xinhua Xiao , Jie Yin , Donald K. Grimm , Jeffrey A. Bozeman
Abstract: A vehicle includes a vision system configured to output a signal indicative of exterior conditions in a vicinity of the vehicle and a temperature sensor configured to output a signal indicative of an interior temperature of the vehicle. The vehicle also includes a plurality of articulable openings arranged to allow fluid flow communication between an interior and an exterior of the vehicle. The vehicle further includes a controller programmed to adjust at least one articulable opening toward an open position in response to the interior temperature exceeding a temperature threshold. The controller is also programmed to adjust at least one articulable opening toward a closed position in response to detection via the vision system of a threat condition in the vicinity of the vehicle.
-
公开(公告)号:US10259390B2
公开(公告)日:2019-04-16
申请号:US15592913
申请日:2017-05-11
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Wende Zhang , Jinsong Wang , Esther Anderson
Abstract: Systems and method are provided for a towing vehicle towing a trailer having at least one imaging device. A method includes: receiving, from a first imaging device coupled to the trailer, a first image stream having a plurality of first images; receiving, from a second imaging device coupled to the vehicle, a second image stream having a plurality of second images; determining, at least one common feature between a first image of the first images and a second image of the second images; determining a first distance from the first imaging device to the at least one common feature and a second distance from the second imaging device to the at least one common feature; and determining, a position of the first imaging device relative to the vehicle based on the first distance, the second distance and a known position and pose of the second imaging device.
-
公开(公告)号:US20190057272A1
公开(公告)日:2019-02-21
申请号:US15681008
申请日:2017-08-18
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Qingrong Zhao , Bakhtiar B. Litkouhi , Qi Zhang , Jinsong Wang , Wende Zhang , Jingfu Jin
Abstract: A method of identifying a snow covered road includes creating a forward image of a road surface. The forward image is analyzed to detect a tire track in the forward image. When a tire track is detected in the forward image, a message indicating a snow covered road surface is signaled. When a tire track is not detected in the forward image, a rearward image, a left side image, and a right side image are created. The rearward image, the left side image, and the right side image are analyzed to detect a tire track in at least one of the rearward image, the right side image, and the left side image. A message indicating a snow covered road surface is signaled when a tire track is detected in one of the rearward image, the left side image, or the right side image.
-
公开(公告)号:US10093247B2
公开(公告)日:2018-10-09
申请号:US14280395
申请日:2014-05-16
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Wende Zhang , Jinsong Wang , Kent S. Lybecker , Jeffrey S. Piasecki , Bakhtiar Brian Litkouhi , Ryan M. Frakes
Abstract: A system and method for determining when to display frontal curb view images to a driver of a vehicle, and what types of images to display. A variety of factors—such as vehicle speed, GPS/location data, the existence of a curb in forward-view images, and vehicle driving history—are evaluated as potential triggers for the curb view display, which is intended for situations where the driver is pulling the vehicle into a parking spot which is bounded in front by a curb or other structure. When forward curb-view display is triggered, a second evaluation is performed to determine what image or images to display which will provide the best view of the vehicle's position relative to the curb. The selected images are digitally synthesized or enhanced, and displayed on a console-mounted or in-dash display device.
-
公开(公告)号:US10013617B2
公开(公告)日:2018-07-03
申请号:US14957968
申请日:2015-12-03
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Qingrong Zhao , Jinsong Wang , Qi Zhang , Bakhtiar B. Litkouhi , Wende Zhang
CPC classification number: G06K9/00798 , B60Q9/00 , B60R1/00 , B60R11/04 , B60R2300/8053 , G06K9/00791 , G06K9/4661 , H04N7/181
Abstract: A method for determining a snow covered surface condition of a path of travel. A beam of light is emitted at a surface of the path of travel by a light emitting source. An image of a path of travel surface is captured by an image capture device. The image capture device is mounted on the vehicle and captures an image in a downward direction. The captured image captures the beam of light emitted on the path of travel surface. Analyzing a subsurface scattering of the light generated on the path of travel surface by a processor. A determination is made whether snow is present on the path of travel. A snow covered path of travel surface signal is generated in response to the identification of snow on the path of travel.
-
公开(公告)号:US20180113331A1
公开(公告)日:2018-04-26
申请号:US15334136
申请日:2016-10-25
Applicant: GM Global Technology Operations LLC
Inventor: Jinsong Wang , Allan K. Lewis , Qingrong Zhao , Michael T. Chaney, JR. , Robert D. Sims, III , Wende Zhang , Xiaosong Huang
CPC classification number: G02F1/0102 , B60S1/56 , G02B27/0006 , G02F1/0136 , G02F2203/055
Abstract: A smart sensor-cover apparatus for covering a sensor, such as a vehicle sensor, includes controllable layers, responsive to inputs, such as a wavelength-filtering controllable layer to selectively filter out select wavelengths of light; a polarizing layer controllable layer to selectively polarize or allow through light; a concealing controllable layer to change between a visible state and a concealed state; and an outermost, cleaning, layer configured to melt incident ice. The outermost layer in various embodiments has an outer surface positioned generally flush with an outer vehicle surface for operation of the apparatus, to promote the concealing effect when the concealing layer is not activate. The outermost layer may be configured to self-mend when scratched, and in some cases is hydrophobic, hydrophilic, or super hydrophilic outer surface. An insulating component, such as a glass or polycarbonate layer, is positioned between each adjacent controllable layer.
-
公开(公告)号:US09858639B2
公开(公告)日:2018-01-02
申请号:US14944409
申请日:2015-11-18
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Wende Zhang , Jinsong Wang , Bakhtiar B. Litkouhi , Kent S. Lybecker , Ryan M. Frakes
IPC: H04N7/18 , H04N7/00 , H04N13/02 , B60R11/04 , G06F17/17 , G06K9/36 , G06K9/54 , G06T3/00 , B60R1/00 , H04N5/232 , G06T7/73
CPC classification number: G06T3/0062 , B60R1/00 , B60R2300/10 , B60R2300/306 , B60R2300/802 , B60R2300/8093 , G06T3/0018 , G06T7/75 , G06T2207/30244 , G06T2207/30264 , H04N5/23238 , H04N7/18
Abstract: A method of displaying a captured image on a display device. A real image is captured by an image capture device. The image capture device uses a field-of-view lens that distorts the real image. A camera model is applied to the captured real image. The camera model maps objects in the captured real image to an image sensor plane of the image capture device to generate a virtual image. The image sensor plane is reconfigurable to virtually alter a shape of the image sensor plane to a non-planar surface. The virtual image formed on the non-planar image surface of the image sensor is projected to the display device.
-
公开(公告)号:US20170297488A1
公开(公告)日:2017-10-19
申请号:US15487521
申请日:2017-04-14
Applicant: GM Global Technology Operations LLC
Inventor: Jinsong Wang , Upali P. Mudalige , Xinhua Xiao , Jie Yin , Wende Zhang , Guangyu J. Zou
CPC classification number: B60R1/00 , B60R11/04 , B60R2011/004 , B60R2300/105 , B60R2300/8066 , B60R2300/8093 , G01S19/13 , G06K9/00791 , G06K9/00805 , G06T5/006 , H04N5/217 , H04N5/2258 , H04N5/247 , H04N7/18 , H04N7/181
Abstract: A method to equip a vehicle to perform object detection and tracking and a surround view camera system to perform the object detection and tracking involve two or more cameras arranged respectively at two or more locations of the vehicle. The cameras capture images within a field of view of the two or more cameras. A processing system obtains the images from the two or more cameras and performs image processing to detect and track objects in the field of view of the two or more cameras.
-
-
-
-
-
-
-
-
-