Methods and systems for object detection

    公开(公告)号:US11604272B2

    公开(公告)日:2023-03-14

    申请号:US16904835

    申请日:2020-06-18

    IPC分类号: G01S13/931 G01S13/89

    摘要: A computer implemented method for object detection includes: determining a grid, the grid comprising a plurality of grid cells; determining, for a plurality of time steps, for each grid cell, a plurality of respective radar detection data, each radar detection data indicating a plurality of radar properties; determining, for each time step, a respective radar map indicating a pre-determined radar map property in each grid cell; converting the respective radar detection data of the plurality of grid cells for the plurality of time steps to a point representation of pre-determined first dimensions; converting the radar maps for the plurality of time steps to a map representation of pre-determined second dimensions, wherein the pre-determined first dimensions and the pre-determined second dimensions are at least partially identical; concatenating the point representation and the map representation to obtain concatenated data; and carrying out object detection based on the concatenated data.

    Device and a method for processing data sequences using a convolutional neural network

    公开(公告)号:US11521059B2

    公开(公告)日:2022-12-06

    申请号:US16373939

    申请日:2019-04-03

    摘要: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

    Object Detection with Multiple Ranges and Resolutions

    公开(公告)号:US20220244383A1

    公开(公告)日:2022-08-04

    申请号:US17649666

    申请日:2022-02-01

    发明人: Yu Su Mirko Meuter

    摘要: Provided is a method for object detection in a surrounding of a vehicle using a deep neural network, comprising: inputting a first set of sensor-based data for a first Cartesian grid having a first spatial dimension and a first spatial resolution into a first branch of the deep neural network; inputting a second set of sensor-based data for a second Cartesian grid having a second spatial dimension and a second spatial resolution into a second branch of the deep neural network; providing an interaction between the first branch of the deep neural network and the second branch of the deep neural network at an intermediate stage of the deep neural network; and fusing a first output of the first branch of the deep neural network and a second output of the second branch of the deep neural network to detect the object in the surrounding of the vehicle.

    Street marking color recognition
    4.
    发明授权

    公开(公告)号:US10977500B2

    公开(公告)日:2021-04-13

    申请号:US16369914

    申请日:2019-03-29

    发明人: Kun Zhao Yu Su

    IPC分类号: G06K9/00 G06T7/90 B60R11/04

    摘要: The present invention relates to a method and an image processing system for determining the color of a street marking, by: capturing an image of a street, detecting a street marking as a set of pixels provided by the image, wherein the pixels include at least two different pieces of color information, determining a color score for the street marking by comparing said at least two different pieces of color information, and determining the color of the street marking by comparing the color score to at least one threshold value.

    DEVICE AND A METHOD FOR SEARCHING FOR A LANE ON WHICH A VEHICLE CAN DRIVE

    公开(公告)号:US20190354779A1

    公开(公告)日:2019-11-21

    申请号:US16383858

    申请日:2019-04-15

    发明人: Kun Zhao Yu Su

    IPC分类号: G06K9/00 G06T7/70

    摘要: A device for searching for a lane on which a vehicle can drive, wherein the device is configured to receive an image captured by a camera, the image showing an area in front of the vehicle, detect lane markings in the image, determine for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type, create lane candidates from the lane markings, divide the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, and search the classes of lane candidates for a lane on which the vehicle can drive.

    DEVICE AND A METHOD FOR PROCESSING DATA SEQUENCES USING A CONVOLUTIONAL NEURAL NETWORK

    公开(公告)号:US20190325306A1

    公开(公告)日:2019-10-24

    申请号:US16373939

    申请日:2019-04-03

    IPC分类号: G06N3/08

    摘要: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

    Device and a method for extracting dynamic information on a scene using a convolutional neural network

    公开(公告)号:US11195038B2

    公开(公告)日:2021-12-07

    申请号:US16374138

    申请日:2019-04-03

    IPC分类号: G06K9/00

    摘要: A device for extracting dynamic information comprises a convolutional neural network, wherein the device is configured to receive a sequence of data blocks acquired over time, each of said data blocks comprising a multi-dimensional representation of a scene. The convolutional neural network is configured to receive the sequence as input and to output dynamic information on the scene in response, wherein the convolutional neural network comprises a plurality of modules, and wherein each of said modules is configured to carry out a specific processing task for extracting the dynamic information.

    Device and a method for searching for a lane on which a vehicle can drive

    公开(公告)号:US11010619B2

    公开(公告)日:2021-05-18

    申请号:US16383858

    申请日:2019-04-15

    发明人: Kun Zhao Yu Su

    IPC分类号: G06K9/00 G06T7/70

    摘要: A device for searching for a lane on which a vehicle can drive, wherein the device is configured to receive an image captured by a camera, the image showing an area in front of the vehicle, detect lane markings in the image, determine for each of the lane markings if the respective lane marking is of a first type indicating a road condition of a first type or a second type indicating a road condition of a second type, create lane candidates from the lane markings, divide the lane candidates into classes of lane candidates depending on the type of the lane markings of the lane candidates, and search the classes of lane candidates for a lane on which the vehicle can drive.

    Image based lane marking classification

    公开(公告)号:US10943131B2

    公开(公告)日:2021-03-09

    申请号:US16409035

    申请日:2019-05-10

    IPC分类号: G06K9/00 B60W30/12

    摘要: An image processing method includes: determining a candidate track in an image of a road, wherein the candidate track is modelled as a parameterized line or curve corresponding to a candidate lane marking in the image of a road; dividing the candidate track into a plurality of cells, each cell corresponding to a segment of the candidate track; determining at least one marklet for a plurality of said cells, wherein each marklet of a cell corresponds to a line or curve connecting left and right edges of the candidate lane marking; determining at least one local feature of each of said plurality of cells based on characteristics of said marklets; determining at least one global feature of the candidate track by aggregating the local features of the plurality of cells; and determining if the candidate lane marking represents a lane marking based on the at least one global feature.