-
公开(公告)号:US20230237807A1
公开(公告)日:2023-07-27
申请号:US17738678
申请日:2022-05-06
发明人: Pavel Tokmakov , Allan Jabri , Adrien D. Gaidon
CPC分类号: G06V20/58 , G06T7/536 , B60W30/08 , B60W2420/42 , B60W2554/4049
摘要: A method for tracking occluded objects includes encoding locations of a plurality of objects in an environment, determining a target object, receiving a first end point corresponding to a position of the target object before occlusion behind an occlusion object, distributing a hypothesis between both sides of the occlusion object during occlusion from a subsequent frame of the sequence of frames, receiving a second end point corresponding to a position of the target object after emerging from occlusion from another subsequent frame of the sequence of frames, and determining a trajectory of the target object when occluded by the occlusion object by performing inferences using a spatio-temporal probabilistic graph based on the current frame and the subsequent frames of the sequence of frames. The trajectory of the target object when occluded is used as a learning model for future target objects that are occluded by the occlusion object.
-
公开(公告)号:US20220036650A1
公开(公告)日:2022-02-03
申请号:US16940701
申请日:2020-07-28
摘要: The embodiments disclosed herein describe vehicles, systems and methods for multi-resolution fusion of pseudo-LiDAR features. In one aspect, a method for multi-resolution fusion of pseudo-LiDAR features includes receiving image data from one or more image sensors, generating a point cloud from the image data, generating, from the point cloud, a first bird's eye view map having a first resolution, generating, from the point cloud, a second bird's eye view map having a second resolution, and generating a combined bird's eye view map by combining features of the first bird's eye view map with features from the second bird's eye view map.
-
3.
公开(公告)号:US20200159231A1
公开(公告)日:2020-05-21
申请号:US16192627
申请日:2018-11-15
发明人: Felipe Codevilla , Eder Santana , Adrien D. Gaidon
摘要: Exemplary implementations may: generate output signals conveying contextual information and vehicle information; determine, based on the output signals, the contextual information; determine, based on the output signals, the vehicle information, determine, in an ongoing manner, based on the contextual information and/or the vehicle information, values of a complexity metric, the complexity metric quantifying predicted complexity of a current contextual environment and/or predicted complexity of a likely needed response to a change in the contextual information; filter, based on the values of the complexity metric, the contextual information spatially; and control, based on the vehicle information and the spatially filtered contextual information, the vehicle such that the likely needed response is satisfied.
-
公开(公告)号:US10824909B2
公开(公告)日:2020-11-03
申请号:US15979911
申请日:2018-05-15
发明人: German Ros Sanchez , Adrien D. Gaidon , Kuan-Hui Lee , Jie Li
摘要: System, methods, and other embodiments described herein relate to conditionally generating custom images by sampling latent space of a generator. In one embodiment, a method includes, in response to receiving a request to generate a custom image, generating a component instruction by translating a description about requested characteristics for the object instance into a vector that identifies a portion of a latent space within a respective generator. The method includes computing the object instance by controlling the respective one of the generators according to the component instruction to produce the object instance. The respective one of the generators being configured to generate objects within a semantic object class. The method includes generating the custom image from at least the object instance to produce the custom image from the description as a photorealistic image approximating a real image corresponding to the description.
-
公开(公告)号:US10713569B2
公开(公告)日:2020-07-14
申请号:US15994217
申请日:2018-05-31
发明人: German Ros Sanchez , Adrien D. Gaidon , Kuan-Hui Lee , Jie Li
摘要: System, methods, and other embodiments described herein relate to improving the generation of realistic images. In one embodiment, a method includes acquiring a synthetic image including identified labels of simulated components within the synthetic image. The synthetic image is a simulated visualization and the identified labels distinguish between the components within the synthetic image. The method includes computing, from the simulated components, translated components that visually approximate real instances of the simulated components by using a generative module comprised of neural networks that are configured to separately generate the translated components. The method includes blending the translated components together to produce a new image from the simulated components of the synthetic image.
-
公开(公告)号:US20190370666A1
公开(公告)日:2019-12-05
申请号:US15994217
申请日:2018-05-31
发明人: German Ros Sanchez , Adrien D. Gaidon , Kuan-Hui Lee , Jie Li
摘要: System, methods, and other embodiments described herein relate to improving the generation of realistic images. In one embodiment, a method includes acquiring a synthetic image including identified labels of simulated components within the synthetic image. The synthetic image is a simulated visualization and the identified labels distinguish between the components within the synthetic image. The method includes computing, from the simulated components, translated components that visually approximate real instances of the simulated components by using a generative module comprised of neural networks that are configured to separately generate the translated components. The method includes blending the translated components together to produce a new image from the simulated components of the synthetic image.
-
公开(公告)号:US20240013409A1
公开(公告)日:2024-01-11
申请号:US18202632
申请日:2023-05-26
发明人: Colton Stearns , Jie Li , Rares A. Ambrus , Vitor Campagnolo Guizilini , Sergey Zakharov , Adrien D. Gaidon , Davis Rempe , Tolga Birdal , Leonidas J. Guibas
IPC分类号: G06T7/246
CPC分类号: G06T7/248 , G06T2207/10028 , G06T2207/20084 , G06T2207/20081
摘要: A method for multiple object tracking includes receiving, with a computing device, a point cloud dataset, detecting one or more objects in the point cloud dataset, each of the detected one or more objects defined by points of the point cloud dataset and a bounding box, querying one or more historical tracklets for historical tracklet states corresponding to each of the one or more detected objects, implementing a 4D encoding backbone comprising two branches: a first branch configured to compute per-point features for each of the one or more objects and the corresponding historical tracklet states, and a second branch configured to obtain 4D point features, concatenating the per-point features and the 4D point features, and predicting, with a decoder receiving the concatenated per-point features, current tracklet states for each of the one or more objects.
-
公开(公告)号:US11378965B2
公开(公告)日:2022-07-05
申请号:US16192627
申请日:2018-11-15
发明人: Felipe Codevilla , Eder Santana , Adrien D. Gaidon
摘要: Exemplary implementations may: generate output signals conveying contextual information and vehicle information; determine, based on the output signals, the contextual information; determine, based on the output signals, the vehicle information, determine, in an ongoing manner, based on the contextual information and/or the vehicle information, values of a complexity metric, the complexity metric quantifying predicted complexity of a current contextual environment and/or predicted complexity of a likely needed response to a change in the contextual information; filter, based on the values of the complexity metric, the contextual information spatially; and control, based on the vehicle information and the spatially filtered contextual information, the vehicle such that the likely needed response is satisfied.
-
公开(公告)号:US20220024048A1
公开(公告)日:2022-01-27
申请号:US17147935
申请日:2021-01-13
发明人: Rares A. Ambrus , Vitor Guizilini , Naveen Suresh Kuppuswamy , Andrew M. Beaulieu , Adrien D. Gaidon , Alexander Alspach
摘要: A deformable sensor comprises an enclosure comprising a deformable membrane, the enclosure configured to be filled with a medium, and an imaging sensor, disposed within the enclosure, having a field of view configured to be directed toward a bottom surface of the deformable membrane. The imaging sensor is configured to capture an image of the deformable membrane. The deformable sensor is configured to determine depth values for a plurality of points on the deformable membrane based on the image captured by the imaging sensor and a trained neural network.
-
公开(公告)号:US20200034871A1
公开(公告)日:2020-01-30
申请号:US16047801
申请日:2018-07-27
摘要: The systems and methods described herein disclose providing compensation for data transmission during a refill event. As described here, a vehicle collects operation data sets during movement in the vehicular environment. Vehicles can then transfer one or more of the operation data sets during the refill of the collecting vehicle. Thus, operator can determine the desirability and value of trading the upload time for compensation. The systems and methods can include detecting a refill event for a collecting vehicle. A data analysis can then be received for one or more operation data sets produced by the collecting vehicle. A data value can then be determined from the data analysis, with the operator determining transfer one or more operation data sets from the collecting vehicle during the refill event. Once received, compensation can be provided to the collecting vehicle for the received operation data sets based on the data value.
-
-
-
-
-
-
-
-
-