Device and a method for extracting dynamic information on a scene using a convolutional neural network

    公开(公告)号:US11195038B2

    公开(公告)日:2021-12-07

    申请号:US16374138

    申请日:2019-04-03

    IPC分类号: G06K9/00

    摘要: A device for extracting dynamic information comprises a convolutional neural network, wherein the device is configured to receive a sequence of data blocks acquired over time, each of said data blocks comprising a multi-dimensional representation of a scene. The convolutional neural network is configured to receive the sequence as input and to output dynamic information on the scene in response, wherein the convolutional neural network comprises a plurality of modules, and wherein each of said modules is configured to carry out a specific processing task for extracting the dynamic information.

    Method of Processing Image Data in a Connectionist Network

    公开(公告)号:US20220261653A1

    公开(公告)日:2022-08-18

    申请号:US17661912

    申请日:2022-05-03

    摘要: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

    Method of processing image data in a connectionist network

    公开(公告)号:US11386329B2

    公开(公告)日:2022-07-12

    申请号:US16202688

    申请日:2018-11-28

    摘要: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

    Methods and systems for object detection

    公开(公告)号:US11604272B2

    公开(公告)日:2023-03-14

    申请号:US16904835

    申请日:2020-06-18

    IPC分类号: G01S13/931 G01S13/89

    摘要: A computer implemented method for object detection includes: determining a grid, the grid comprising a plurality of grid cells; determining, for a plurality of time steps, for each grid cell, a plurality of respective radar detection data, each radar detection data indicating a plurality of radar properties; determining, for each time step, a respective radar map indicating a pre-determined radar map property in each grid cell; converting the respective radar detection data of the plurality of grid cells for the plurality of time steps to a point representation of pre-determined first dimensions; converting the radar maps for the plurality of time steps to a map representation of pre-determined second dimensions, wherein the pre-determined first dimensions and the pre-determined second dimensions are at least partially identical; concatenating the point representation and the map representation to obtain concatenated data; and carrying out object detection based on the concatenated data.

    Device and a method for processing data sequences using a convolutional neural network

    公开(公告)号:US11521059B2

    公开(公告)日:2022-12-06

    申请号:US16373939

    申请日:2019-04-03

    摘要: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

    DEVICE AND A METHOD FOR PROCESSING DATA SEQUENCES USING A CONVOLUTIONAL NEURAL NETWORK

    公开(公告)号:US20190325306A1

    公开(公告)日:2019-10-24

    申请号:US16373939

    申请日:2019-04-03

    IPC分类号: G06N3/08

    摘要: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

    METHOD OF PROCESSING IMAGE DATA IN A CONNECTIONIST NETWORK

    公开(公告)号:US20190171939A1

    公开(公告)日:2019-06-06

    申请号:US16202688

    申请日:2018-11-28

    摘要: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

    Method of multi-sensor data fusion

    公开(公告)号:US11552778B2

    公开(公告)日:2023-01-10

    申请号:US16801296

    申请日:2020-02-26

    摘要: A method of multi-sensor data fusion includes determining a plurality of first data sets using a plurality of sensors, each of the first data sets being associated with a respective one of a plurality of sensor coordinate systems, and each of the sensor coordinate systems being defined in dependence of a respective one of a plurality of mounting positions for the sensors; transforming the first data sets into a plurality of second data sets using a transformation rule, each of the second data sets being associated with a unified coordinate system, the unified coordinate system being defined in dependence of at least one predetermined reference point; and determining at least one fused data set by fusing the second data sets.

    Method for Classifying a Tracked Object

    公开(公告)号:US20220188582A1

    公开(公告)日:2022-06-16

    申请号:US17643586

    申请日:2021-12-09

    IPC分类号: G06K9/62 G06N3/04 G01S13/88

    摘要: A method is provided for classifying a tracked object in an environment of a vehicle. The vehicle includes a plurality of radar sensors and a processing device configured to establish a neural network. According to the method, local radar detections are captured from an object in the environment of the vehicle via the radar sensors. Based on the local radar detections, point features and tracker features are determined. The point features are encoded via point encoding layers of the neural network, whereas the tracker features are encoded via track encoding layers of the neural network. A temporal fusion of the encoded point features and the encoded tracker features is performed via temporal fusion layers of the neural network. The tracked object is classified based on the fused encoded point and tracker features via classifying layers of the neural network.