REMOTE SEGMENTATION UNDER LIMITED COMPUTATIONAL RESOURCES AND RATE CONSTRAINTS

    公开(公告)号:US20220215199A1

    公开(公告)日:2022-07-07

    申请号:US17141527

    申请日:2021-01-05

    Abstract: A vehicle communication and control system includes a first vehicle in signal communication with a remote computing system and/or a second vehicle. The first vehicle includes a sensor configured to capture a raw image having a first image volume and including at least one target object. An image encoder included in the vehicle converts the raw image into a masked image having a second image volume that is less than the first image volume. A segmentation unit included in the remote computing system and/or the second vehicle determines the at least one target object from the masked image, generates a masked segmented image including a sparse segmentation of the at least one target object, and converts the sparse segmentation of the at least one target object into at least one recovered segmented target object indicative of the at least one target object.

    Generation of artificial color images from narrow spectral band data aboard a camera-equipped vehicle

    公开(公告)号:US12223741B2

    公开(公告)日:2025-02-11

    申请号:US17557448

    申请日:2021-12-21

    Abstract: A visual perception system includes a scanning camera, color sensor with color filter array (CFA), and a classifier node. The camera captures full color pixel images of a target object, e.g., a traffic light, and processes the pixel images through a narrow band pass filter (BPF), such that the narrow BPF outputs monochromatic images of the target object. The color sensor and CFA receive the monochromatic images. The color sensor has at least three color channels each corresponding to different colors of spectral data in the monochromatic images. The classifier node uses a predetermined classification decision tree to classify constituent pixels of the monochromatic images into different color bins as a corresponding color of interest. The color of interest may be used to perform a control action, e.g., via an automated driver assist system (ADAS) control unit or an indicator device.

    SYSTEM AND METHOD FOR VEHICLE PATH PLANNING

    公开(公告)号:US20240391497A1

    公开(公告)日:2024-11-28

    申请号:US18324308

    申请日:2023-05-26

    Abstract: A method of planning a path for a vehicle is disclosed herein. The method includes receiving a plurality of perception images. At least one perception task is detected from the plurality of perception images including identifying a neighboring vehicle. A plurality of vehicle descriptors of the neighboring vehicle is recognized, and a plurality of predetermined vehicle descriptor sets are associated with a corresponding one of a plurality of cluster values with each cluster value being associated with a risk factor. The risk factor is determined based on mapping the plurality of vehicle descriptors recognized for the neighboring vehicle onto one of the plurality of predetermined vehicle descriptor sets and assigning the risk factor associated with the cluster value to the neighboring vehicle. The path for the vehicle is planned based on the at least one perception task and the risk factor and the path is executed for the vehicle.

    Remote segmentation under limited computational resources and rate constraints

    公开(公告)号:US11625925B2

    公开(公告)日:2023-04-11

    申请号:US17141527

    申请日:2021-01-05

    Abstract: A vehicle communication and control system includes a first vehicle in signal communication with a remote computing system and/or a second vehicle. The first vehicle includes a sensor configured to capture a raw image having a first image volume and including at least one target object. An image encoder included in the vehicle converts the raw image into a masked image having a second image volume that is less than the first image volume. A segmentation unit included in the remote computing system and/or the second vehicle determines the at least one target object from the masked image, generates a masked segmented image including a sparse segmentation of the at least one target object, and converts the sparse segmentation of the at least one target object into at least one recovered segmented target object indicative of the at least one target object.

    FLAGMAN TRAFFIC GESTURE RECOGNITION

    公开(公告)号:US20220318560A1

    公开(公告)日:2022-10-06

    申请号:US17223473

    申请日:2021-04-06

    Abstract: A vehicle and a system and method of operating the vehicle based on a gesture made by a traffic director. The system includes a camera and at least one neural network. The camera obtains an image of a flag operator. The at least one neural network is to generates an encoded hand vector based on a configuration of a hand of the traffic director from the image, combines a skeleton of the traffic director generated from the image and the encoded hand vector to generate a representation vector, and predicts a gesture of the traffic director from the representation vector.

    Rate adaptive encoding decoding scheme for prioritized segmented data

    公开(公告)号:US11438627B2

    公开(公告)日:2022-09-06

    申请号:US17131740

    申请日:2020-12-22

    Abstract: A method in a rate adaptive system includes categorizing, by an encoder, a plurality of clusters of data in a segmented image into one of a plurality of categories corresponding to a different predetermined label with a predetermined priority level; vectorizing, by the encoder, the data to generate a sparse vector xi for its corresponding label; encoding, by the encoder, a plurality of the sparse vectors xi by multiplying a measurement matrix Ai(t) with the sparse vector xi to generate a set of encoded information yi; transmitting, by the encoder to the decoder, the plurality of sets of the encoded information yi in a prioritized order; decoding, by the decoder, the plurality of sets of encoded information yi to determine the plurality of the sparse vectors xi based on determining measurement matrix Ai(t); and uniting the plurality of the sparse vectors xi into a single image frame.

    RATE ADAPTIVE ENCODING DECODING SCHEME FOR PRIORITIZED SEGMENTED DATA

    公开(公告)号:US20220201333A1

    公开(公告)日:2022-06-23

    申请号:US17131740

    申请日:2020-12-22

    Abstract: A method in a rate adaptive system includes categorizing, by an encoder, a plurality of clusters of data in a segmented image into one of a plurality of categories corresponding to a different predetermined label with a predetermined priority level; vectorizing, by the encoder, the data to generate a sparse vector xi for its corresponding label; encoding, by the encoder, a plurality of the sparse vectors xi by multiplying a measurement matrix Ai(t) with the sparse vector xi to generate a set of encoded information yi; transmitting, by the encoder to the decoder, the plurality of sets of the encoded information yi in a prioritized order; decoding, by the decoder, the plurality of sets of encoded information yi to determine the plurality of the sparse vectors xi based on determining measurement matrix Ai(t); and uniting the plurality of the sparse vectors xi into a single image frame.

Patent Agency Ranking