-
公开(公告)号:US11842495B2
公开(公告)日:2023-12-12
申请号:US17689396
申请日:2022-03-08
发明人: Agastya Kalra , Vage Taamazyan , Supreeth Krishna Rao , Kartik Venkataraman , Ramesh Raskar , Achuta Kadambi
IPC分类号: G06T7/11 , B25J9/16 , G05B13/02 , G06F18/214 , G06F18/25 , G06N3/045 , G06V10/82 , G06V10/44 , G06V10/60 , G06V10/147
CPC分类号: G06T7/11 , B25J9/1697 , G05B13/027 , G06F18/214 , G06F18/253 , G06N3/045 , G06V10/147 , G06V10/454 , G06V10/60 , G06V10/82 , G06T2207/10024 , G06T2207/20081 , G06T2207/20084
摘要: A computer-implemented method for computing a prediction on images of a scene includes: receiving one or more polarization raw frames of a scene, the polarization raw frames being captured with a polarizing filter at a different linear polarization angle; extracting one or more first tensors in one or more polarization representation spaces from the polarization raw frames; and computing a prediction regarding one or more optically challenging objects in the scene based on the one or more first tensors in the one or more polarization representation spaces.
-
公开(公告)号:US12067746B2
公开(公告)日:2024-08-20
申请号:US17314929
申请日:2021-05-07
发明人: Vage Taamazyan , Guy Michael Stoppi , Bradley Craig Anderson Brown , Agastya Kalra , Achuta Kadambi , Kartik Venkataraman
CPC分类号: G06T7/75 , B25J9/1697 , B25J13/08 , G05B19/4155 , G06T7/269 , G06T7/55 , G05B2219/50391 , G06T2207/10024
摘要: A method for estimating a pose of an object includes: receiving, by a processor, an observed image depicting the object from a viewpoint; computing, by the processor, an instance segmentation map identifying a class of the object depicted in the observed image; loading, by the processor, a 3-D model corresponding to the class of the object; computing, by the processor, a rendered image of the 3-D model in accordance with an initial pose estimate of the object and the viewpoint of the observed image; computing, by the processor, a plurality of dense image-to-object correspondences between the observed image of the object and the 3-D model based on the observed image and the rendered image; and computing, by the processor, the pose of the object based on the dense image-to-object correspondences.
-
公开(公告)号:US12020455B2
公开(公告)日:2024-06-25
申请号:US17198094
申请日:2021-03-10
CPC分类号: G06T7/80 , H04N9/646 , G06T2207/10141 , G06T2207/20084 , G06T2207/20208
摘要: Systems and method for expanding a dynamic range associated with an image are disclosed. The method includes capturing an image of a scene via an imaging device using a single exposure. The image of the scene includes a plurality of polarization images corresponding to different angles of polarization, and each of the polarization images comprise a plurality of color channels. The method further includes determining a criterion for each of the plurality of color channels; selecting one color channel of the plurality of color channels based on determining of the criterion; generating a reconstructed image irradiance for the one color channel based on pixels in two or more of the plurality of polarization images obtained for the one color channel; and outputting a reconstructed image with the reconstructed image irradiance.
-
公开(公告)号:US11689813B2
公开(公告)日:2023-06-27
申请号:US17365511
申请日:2021-07-01
IPC分类号: H04N23/74 , H04N23/55 , G02B5/30 , H04N23/741
CPC分类号: H04N23/741 , G02B5/3025 , H04N23/55
摘要: According to one embodiment of the present disclosure, an imaging system includes: an image sensor including a plurality of subpixels grouped into a plurality of pixels; a polarization system including: a rotatable linear polarizer; and a polarizer mask including a plurality of polarizer filters, the polarizer filters being aligned with corresponding ones of the subpixels, the subpixels of a pixel of the plurality of pixels being located behind polarizer filters at different angles of linear polarization; and imaging optics configured to focus light from a scene onto the image sensor.
-
公开(公告)号:US20240221344A1
公开(公告)日:2024-07-04
申请号:US18395090
申请日:2023-12-22
发明人: Achuta Kadambi , Raghav Khanna , Agastya Kalra , Kerim Doruk Karinca , Tomas Gerlich , Vage Taamazyan
CPC分类号: G06V10/34 , G06T15/04 , G06V10/751 , G06V10/993
摘要: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for detection of pixel correspondences in stereo imaging through the use of polarization data. One of the methods include: obtaining a first image from a first viewpoint of a stereo pair and a second image from a second viewpoint of the stereo pair; obtaining an angle of linear polarization (AOLP) map and a degree of linear polarization (DOLP) map having a field of view overlapping the first image and the second image; computing a surface normal map based on the AOLP map and the DOLP map; and detecting corresponding pixels between the first image and the second image by computing a disparity map that minimizes an energy function comprising a pixel matching cost term and a polarized smoothness regularization term computed based on pixels in a local neighborhood and based on the surface normal map.
-
公开(公告)号:US12008796B2
公开(公告)日:2024-06-11
申请号:US17588098
申请日:2022-01-28
IPC分类号: G06V10/82 , G06T7/73 , G06V10/44 , G06V10/764 , G06V10/774 , G06V20/64
CPC分类号: G06V10/454 , G06T7/75 , G06V10/764 , G06V10/774 , G06V10/82 , G06V20/647
摘要: A method for estimating a pose of an object includes: receiving a plurality of images of the object captured from multiple viewpoints with respect to the object; initializing a current pose of the object based on computing an initial estimated pose of the object from at least one of the plurality of images; predicting a plurality of 2-D keypoints associated with the object from each of the plurality of images; and computing an updated pose that minimizes a cost function based on a plurality of differences between the 2-D keypoints and a plurality of 3-D keypoints associated with a 3-D model of the object as arranged in accordance with the current pose, and as projected to each of the viewpoints.
-
公开(公告)号:US11954886B2
公开(公告)日:2024-04-09
申请号:US17232084
申请日:2021-04-15
IPC分类号: G06T7/73 , G06F18/214 , G06V10/40
CPC分类号: G06T7/75 , G06F18/214 , G06V10/40 , G06T2207/20081 , G06T2207/20084
摘要: A method for estimating a pose of a deformable object includes: receiving, by a processor, a plurality of images depicting the deformable object from multiple viewpoints; computing, by the processor, one or more object-level correspondences and a class of the deformable object depicted in the images; loading, by the processor, a 3-D model corresponding to the class of the deformable object; aligning, by the processor, the 3-D model to the deformable object depicted in the plurality of images to compute a six-degree of freedom (6-DoF) pose of the object; and outputting, by the processor, the 3-D model and the 6-DoF pose of the object.
-
-
-
-
-
-