-
公开(公告)号:US12243328B2
公开(公告)日:2025-03-04
申请号:US17820317
申请日:2022-08-17
Applicant: GM Global Technology Operations LLC
Inventor: Jiejun Xu , Kenji Yamada , Michael J. Daily , Alireza Esna Ashari Esfahani , Hyukseong Kwon , Darren Michael Chan , Alan Perry , Joshua Lampkins
IPC: G06V20/58 , G06N3/045 , G06V10/82 , G06V20/62 , G06V30/262
Abstract: A road sign interpretation system includes a front-facing camera mounted on or in a vehicle collecting image data of multiple road signs. A first convolutional neural network (CNN) receives the image data from the front-facing camera and yields a set of sign predictions including one or more sign text instances. A second CNN defining a text extractor receives the image data from the front-facing camera and extracts text candidates including the multiple sign text instances. Sign and sign data localization is provided in the second CNN to compute a text order from the multiple sign text instances. A sign text synthesizer module receives individual sign text instances from the first CNN and individual ones of the sign text instances in digitized forms from an optical character recognizer (OCR). A semantic encoding and interpretation module receives the sign text instances and identifies semantics of the multiple road signs.
-
公开(公告)号:US11747164B2
公开(公告)日:2023-09-05
申请号:US17147745
申请日:2021-01-13
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Meena Nagappan , Hyukseong Kwon , Joshua Lampkins , Rajan Bhattacharyya
CPC classification number: G01C21/3819 , B60W10/04 , B60W10/10 , B60W10/18 , B60W10/20 , G01C21/3833 , B60W2552/05 , B60W2552/30 , B60W2552/53 , B60W2556/40 , B60W2556/45 , B60W2710/1005 , B60W2710/18 , B60W2710/20 , B60W2720/106 , B60W2720/125 , G05D1/0212
Abstract: A method for updating a localization of an autonomous vehicle includes receiving perception input data from a sensor of the autonomous vehicle and receiving map data including road lane information in a vicinity of the autonomous vehicle. The method includes processing the perception input data to extract perceived road lane information including a perceived x position, a perceived y position, a perceived z position, a perceived lane type, a perceived lane color, and a perceived lane curvature and processing the map data to extract map road lane information including a map x position, a map y position, a map z position, a map lane type, a map lane color, and a map lane curvature. The method includes calculating a transformation matrix from the perceived road lane information and the map road lane information and updating the map data and a localization of the vehicle based on the transformation matrix.
-
公开(公告)号:US20230184928A1
公开(公告)日:2023-06-15
申请号:US17551666
申请日:2021-12-15
Applicant: GM Global Technology Operations LLC
Inventor: Yuri Owechko , Qin Jiang , Hyukseong Kwon
CPC classification number: G01S13/9029 , G01S13/9011 , G01S13/9027 , G01S13/505 , G06V10/62 , G06V10/761 , G06V10/443
Abstract: A radar anti-spoofing system for an autonomous vehicle includes a plurality of radar sensors that generate a plurality of input detection points representing radio frequency (RF) signals reflected from objects and a controller in electronic communication with the plurality of radar sensors. The one or more controllers execute instructions to determine a signal to noise ratio (SNR) distance ratio for the input detection points generated by the plurality of radar sensors, where a value of the SNR distance ratio is indicative of an object being a ghost vehicle. The one or more controllers also determine an effective particle number indicating a degree of particle degradation for the importance sampling for each variable that is part of the state variable. In response to determining the effective particle number is equal to or less than a predetermined threshold, the one or more controllers estimate a ghost position for the ghost vehicle.
-
公开(公告)号:US20220219685A1
公开(公告)日:2022-07-14
申请号:US17147782
申请日:2021-01-13
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Hyukseong Kwon , Rajan Bhattacharyya , Michael J. Daily
IPC: B60W30/095 , B60W30/09 , B60W60/00 , B60W40/04
Abstract: A method of using perception-inspired event generation for situation awareness for a vehicle, including receiving perception input data from a sensor of the vehicle and processing the perception input data to classify and generate parameters related to an external entity in a vicinity of the vehicle. The method includes generating a hierarchical event structure that classifies and prioritizes the perception input data by classifying the external entity into an attention zone and prioritizing the external entity within the attention zone according to a risk level value for the external entity. A higher risk level value indicates a higher priority within the attention zone. The method further includes developing a behavior plan for the vehicle based on the hierarchical event structure.
-
公开(公告)号:US11364913B2
公开(公告)日:2022-06-21
申请号:US16365447
申请日:2019-03-26
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Aashish N. Patel , Hyukseong Kwon , Amir M. Rahimi , Rajan Bhattacharyya
IPC: B60W30/182 , G05D1/00 , G05D1/02
Abstract: A method, autonomous vehicle and system for operating an autonomous vehicle. A sensor obtains data of an agent. A processor determines a measure of complexity of the environment in which the autonomous vehicle is operating from the sensor data, selects a control scheme for operating the autonomous vehicle based on the determined complexity, and operates the autonomous vehicle using the selected control scheme.
-
公开(公告)号:US20220155455A1
公开(公告)日:2022-05-19
申请号:US17098702
申请日:2020-11-16
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Jacqueline Staiger , Hyukseong Kwon , Amit Agarwal , Rajan Bhattacharyya
Abstract: A system ground surface projection for autonomous driving of a host vehicle is provided. The system includes a LIDAR device of the host vehicle and a computerized device. The computerized device is operable to monitor data from the LIDAR device including a total point cloud. The total point cloud describes an actual ground surface in the operating environment of the host vehicle. The device is further operable to segment the total point cloud into a plurality of local point cloud and, for each of the local point clouds, determine a local polygon estimating a portion of the actual ground surface. The device is further operable to assemble the local polygons into a total estimated ground surface and navigate the host vehicle based upon the total estimated ground surface.
-
公开(公告)号:US20240416929A1
公开(公告)日:2024-12-19
申请号:US18335758
申请日:2023-06-15
Applicant: GM Global Technology Operations LLC
Inventor: Rodolfo Valiente Romero , Hyukseong Kwon , Marcus James Huber , Alireza Esna Ashari Esfahani , Michael Cui
Abstract: An end-to-end perception perturbation modeling system for a vehicle includes one or more controllers storing a detection model in memory. The detection model includes a plurality of detection model plots that each indicate a probability value that an object in an environment surrounding the vehicle is detected based on a current weather condition and a distance measured between the vehicle and the object detected in the environment surrounding the vehicle. The one or more controllers execute instructions to receive an input state of the vehicle that is observed during non-inclement weather conditions and indicates one or more vehicle states, the current weather condition, and the distance. The controllers determine a perturbed state of the vehicle observed during the current weather condition.
-
公开(公告)号:US11921194B2
公开(公告)日:2024-03-05
申请号:US17551666
申请日:2021-12-15
Applicant: GM Global Technology Operations LLC
Inventor: Yuri Owechko , Qin Jiang , Hyukseong Kwon
CPC classification number: G01S13/9029 , G01S13/505 , G01S13/9011 , G01S13/9027 , G06V10/443 , G06V10/62 , G06V10/761
Abstract: A radar anti-spoofing system for an autonomous vehicle includes a plurality of radar sensors that generate a plurality of input detection points representing radio frequency (RF) signals reflected from objects and a controller in electronic communication with the plurality of radar sensors. The one or more controllers execute instructions to determine a signal to noise ratio (SNR) distance ratio for the input detection points generated by the plurality of radar sensors, where a value of the SNR distance ratio is indicative of an object being a ghost vehicle. The one or more controllers also determine an effective particle number indicating a degree of particle degradation for the importance sampling for each variable that is part of the state variable. In response to determining the effective particle number is equal to or less than a predetermined threshold, the one or more controllers estimate a ghost position for the ghost vehicle.
-
公开(公告)号:US11858507B2
公开(公告)日:2024-01-02
申请号:US17147782
申请日:2021-01-13
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Hyukseong Kwon , Rajan Bhattacharyya , Michael J. Daily
IPC: B60W30/095 , B60W30/09 , B60W60/00 , B60W40/04
CPC classification number: B60W30/0956 , B60W30/09 , B60W40/04 , B60W60/0027 , B60W2420/42 , B60W2554/4041 , B60W2554/4045
Abstract: A method of using perception-inspired event generation for situation awareness for a vehicle, including receiving perception input data from a sensor of the vehicle and processing the perception input data to classify and generate parameters related to an external entity in a vicinity of the vehicle. The method includes generating a hierarchical event structure that classifies and prioritizes the perception input data by classifying the external entity into an attention zone and prioritizing the external entity within the attention zone according to a risk level value for the external entity. A higher risk level value indicates a higher priority within the attention zone. The method further includes developing a behavior plan for the vehicle based on the hierarchical event structure.
-
公开(公告)号:US20220221301A1
公开(公告)日:2022-07-14
申请号:US17147745
申请日:2021-01-13
Applicant: GM GLOBAL TECHNOLOGY OPERATIONS LLC
Inventor: Meena Nagappan , Hyukseong Kwon , Joshua Lampkins , Rajan Bhattacharyya
Abstract: A method for updating a localization of an autonomous vehicle includes receiving perception input data from a sensor of the autonomous vehicle and receiving map data including road lane information in a vicinity of the autonomous vehicle. The method includes processing the perception input data to extract perceived road lane information including a perceived x position, a perceived y position, a perceived z position, a perceived lane type, a perceived lane color, and a perceived lane curvature and processing the map data to extract map road lane information including a map x position, a map y position, a map z position, a map lane type, a map lane color, and a map lane curvature. The method includes calculating a transformation matrix from the perceived road lane information and the map road lane information and updating the map data and a localization of the vehicle based on the transformation matrix.
-
-
-
-
-
-
-
-
-