公开(公告)号：US11195038B2

公开(公告)日：2021-12-07

申请号：US16374138

申请日：2019-04-03

Applicant: Aptiv Technologies Limited

Inventor： Christian Nunn ,  Weimeng Zhu ,  Yu Su

IPC: G06K9/00

Abstract: A device for extracting dynamic information comprises a convolutional neural network, wherein the device is configured to receive a sequence of data blocks acquired over time, each of said data blocks comprising a multi-dimensional representation of a scene. The convolutional neural network is configured to receive the sequence as input and to output dynamic information on the scene in response, wherein the convolutional neural network comprises a plurality of modules, and wherein each of said modules is configured to carry out a specific processing task for extracting the dynamic information.

公开(公告)号：US11804026B2

公开(公告)日：2023-10-31

申请号：US18047680

申请日：2022-10-19

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Yu Su ,  Christian Nunn

IPC: G06T7/70 ,  G06V10/44 ,  G06N3/08 ,  G06V10/82 ,  G06T7/73 ,  G06N3/044 ,  G06N3/045 ,  G06V10/70

CPC classification number: G06V10/454 ,  G06N3/044 ,  G06N3/045 ,  G06N3/08 ,  G06T7/70 ,  G06T7/75 ,  G06V10/70 ,  G06V10/82

Abstract: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

公开(公告)号：US11645851B2

公开(公告)日：2023-05-09

申请号：US17661912

申请日：2022-05-03

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Jan Siegemund

IPC: G06V20/58 ,  G06N3/084 ,  G06N20/00 ,  G06V10/44 ,  G06N3/045 ,  G06V10/82

CPC classification number: G06V20/582 ,  G06N3/045 ,  G06N3/084 ,  G06N20/00 ,  G06V10/454 ,  G06V10/82 ,  G06V20/58

Abstract: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

公开(公告)号：US20220261653A1

公开(公告)日：2022-08-18

申请号：US17661912

申请日：2022-05-03

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Jan Siegemund

IPC: G06N3/08 ,  G06N3/04 ,  G06N20/00 ,  G06V10/44 ,  G06V20/58

Abstract: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

公开(公告)号：US11386329B2

公开(公告)日：2022-07-12

申请号：US16202688

申请日：2018-11-28

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Jan Siegemund

IPC: G06N3/00 ,  G06N3/08 ,  G06N3/04 ,  G06N20/00 ,  G06V10/44 ,  G06V20/58

Abstract: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

公开(公告)号：US11604272B2

公开(公告)日：2023-03-14

申请号：US16904835

申请日：2020-06-18

Applicant: APTIV TECHNOLOGIES LIMITED

Inventor： Yu Su ,  Weimeng Zhu ,  Florian Kästner ,  Adrian Becker

IPC: G01S13/931 ,  G01S13/89

Abstract: A computer implemented method for object detection includes: determining a grid, the grid comprising a plurality of grid cells; determining, for a plurality of time steps, for each grid cell, a plurality of respective radar detection data, each radar detection data indicating a plurality of radar properties; determining, for each time step, a respective radar map indicating a pre-determined radar map property in each grid cell; converting the respective radar detection data of the plurality of grid cells for the plurality of time steps to a point representation of pre-determined first dimensions; converting the radar maps for the plurality of time steps to a map representation of pre-determined second dimensions, wherein the pre-determined first dimensions and the pre-determined second dimensions are at least partially identical; concatenating the point representation and the map representation to obtain concatenated data; and carrying out object detection based on the concatenated data.

公开(公告)号：US11521059B2

公开(公告)日：2022-12-06

申请号：US16373939

申请日：2019-04-03

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Yu Su ,  Christian Nunn

IPC: G06T7/70 ,  G06N3/08 ,  G06N3/04 ,  G06V10/44 ,  G06V10/82 ,  G06T7/73

Abstract: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

公开(公告)号：US20190325306A1

公开(公告)日：2019-10-24

申请号：US16373939

申请日：2019-04-03

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Yu Su ,  Christian Nunn

IPC: G06N3/08

Abstract: A device for processing data sequences by means of a convolutional neural network is configured to carry out the following steps: receiving an input sequence comprising a plurality of data items captured over time using a sensor, each of said data items comprising a multi-dimensional representation of a scene, generating an output sequence representing the input sequence processed item-wise by the convolutional neural network, wherein generating the output sequence comprises: generating a grid-generation sequence based on a combination of the input sequence and an intermediate grid-generation sequence representing a past portion of the output sequence or the grid-generation sequence, generating a sampling grid on the basis of the grid-generation sequence, generating an intermediate output sequence by sampling from the past portion of the output sequence according to the sampling grid, and generating the output sequence based on a weighted combination of the intermediate output sequence and the input sequence.

公开(公告)号：US20190171939A1

公开(公告)日：2019-06-06

申请号：US16202688

申请日：2018-11-28

Applicant: Aptiv Technologies Limited

Inventor： Weimeng Zhu ,  Jan Siegemund

IPC: G06N3/08 ,  G06N3/04 ,  G06K9/00 ,  G06N20/00

Abstract: A method of processing image data in a connectionist network includes: determining, a plurality of offsets, each offset representing an individual location shift of an underlying one of the plurality of output picture elements, determining, from the plurality of offsets, a grid for sampling from the plurality of input picture elements, wherein the grid comprises a plurality of sampling locations, each sampling location being defined by means of a respective pair of one of the plurality of offsets and the underlying one of the plurality of output picture elements, sampling from the plurality of input picture elements in accordance with the grid, and transmitting, as output data for at least a subsequent one of the plurality of units of the connectionist network, a plurality of sampled picture elements resulting from the sampling, wherein the plurality of sampled picture elements form the plurality of output picture elements.

公开(公告)号：US11552778B2

公开(公告)日：2023-01-10

申请号：US16801296

申请日：2020-02-26

Applicant: APTIV TECHNOLOGIES LIMITED

Inventor： Yu Su ,  Weimeng Zhu ,  Mirko Meuter

IPC: H04L1/00 ,  H04L7/00 ,  G06N3/04 ,  G06N3/08 ,  B60W50/00

Abstract: A method of multi-sensor data fusion includes determining a plurality of first data sets using a plurality of sensors, each of the first data sets being associated with a respective one of a plurality of sensor coordinate systems, and each of the sensor coordinate systems being defined in dependence of a respective one of a plurality of mounting positions for the sensors; transforming the first data sets into a plurality of second data sets using a transformation rule, each of the second data sets being associated with a unified coordinate system, the unified coordinate system being defined in dependence of at least one predetermined reference point; and determining at least one fused data set by fusing the second data sets.