-
公开(公告)号:US12131529B2
公开(公告)日:2024-10-29
申请号:US18098625
申请日:2023-01-18
发明人: Jeremy Ma , Josh Petersen , Umashankar Nagarajan , Michael Laskey , Daniel Helmick , James Borders , Krishna Shankar , Kevin Stone , Max Bajracharya
IPC分类号: B25J9/16 , G06F18/214 , G06F18/28 , G06N3/08 , G06T7/246 , G06T7/33 , G06T7/55 , G06T7/73 , G06T19/20 , G06V10/75 , G06V10/764 , G06V10/774 , G06V10/82 , G06V20/10 , G06V20/20
CPC分类号: G06V20/10 , B25J9/1605 , B25J9/1661 , B25J9/1664 , B25J9/1671 , B25J9/1697 , G06F18/214 , G06F18/28 , G06N3/08 , G06T7/248 , G06T7/33 , G06T7/55 , G06T7/74 , G06T19/20 , G06V10/751 , G06V10/764 , G06V10/774 , G06V10/82 , G06V20/20 , B25J9/163 , G05B2219/37567 , G05B2219/40543 , G05B2219/40564 , G06T2200/04 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028 , G06T2207/20081 , G06T2207/20104
摘要: A method for performing a task by a robotic device includes mapping a group of task image pixel descriptors associated with a first group of pixels in a task image of a task environment to a group of teaching image pixel descriptors associated with a second group of pixels in a teaching image based on positioning the robotic device within the task environment. The method also includes determining a relative transform between the task image and the teaching image based on mapping the plurality of task image pixel descriptors. The relative transform indicates a change in one or more of points of 3D space between the task image and the teaching image. The method also includes performing the task associated with the set of parameterized behaviors based on updating one or more parameters of a set of parameterized behaviors associated with the teaching image based on determining the relative transform.
-
公开(公告)号:US11113526B2
公开(公告)日:2021-09-07
申请号:US16570813
申请日:2019-09-13
发明人: Kevin Stone , Krishna Shankar , Michael Laskey
摘要: A method for training a deep neural network of a robotic device is described. The method includes constructing a 3D model using images captured via a 3D camera of the robotic device in a training environment. The method also includes generating pairs of 3D images from the 3D model by artificially adjusting parameters of the training environment to form manipulated images using the deep neural network. The method further includes processing the pairs of 3D images to form a reference image including embedded descriptors of common objects between the pairs of 3D images. The method also includes using the reference image from training of the neural network to determine correlations to identify detected objects in future images.
-
公开(公告)号:US11741701B2
公开(公告)日:2023-08-29
申请号:US17667217
申请日:2022-02-08
发明人: Jeremy Ma , Kevin Stone , Max Bajracharya , Krishna Shankar
IPC分类号: G06V20/10 , G06T7/73 , G06T7/55 , B25J9/16 , G06N3/08 , G06T19/20 , G06T7/246 , G06T7/33 , G06V20/20 , G06F18/28 , G06F18/214 , G06V10/764 , G06V10/774 , G06V10/82 , G06V10/75
CPC分类号: G06V20/10 , B25J9/1605 , B25J9/1661 , B25J9/1664 , B25J9/1671 , B25J9/1697 , G06F18/214 , G06F18/28 , G06N3/08 , G06T7/248 , G06T7/33 , G06T7/55 , G06T7/74 , G06T19/20 , G06V10/751 , G06V10/764 , G06V10/774 , G06V10/82 , G06V20/20 , B25J9/163 , G05B2219/37567 , G05B2219/40543 , G05B2219/40564 , G06T2200/04 , G06T2207/10016 , G06T2207/10024 , G06T2207/10028 , G06T2207/20081 , G06T2207/20104
摘要: A method for controlling a robotic device is presented. The method includes capturing an image corresponding to a current view of the robotic device. The method also includes identifying a keyframe image comprising a first set of pixels matching a second set of pixels of the image. The method further includes performing, by the robotic device, a task corresponding to the keyframe image.
-
公开(公告)号:US20210081724A1
公开(公告)日:2021-03-18
申请号:US16697290
申请日:2019-11-27
发明人: Jeremy Ma , Krishna Shankar , Kevin Stone
摘要: A system includes a memory module configured to store image data captured by a camera and an electronic controller communicatively coupled to the memory module. The electronic controller is configured to receive image data captured by the camera, implement a neural network trained to predict a drivable portion in the image data of an environment. The neural network predicts the drivable portion in the image data of the environment. The electronic controller is configured to implement a support vector machine. The support vector machine determines whether the predicted drivable portion of the environment output by the neural network is classified as drivable based on a hyperplane of the support vector machine and output an indication of the drivable portion of the environment.
-
公开(公告)号:US11586861B2
公开(公告)日:2023-02-21
申请号:US16697290
申请日:2019-11-27
发明人: Jeremy Ma , Krishna Shankar , Kevin Stone
摘要: A system includes a memory module configured to store image data captured by a camera and an electronic controller communicatively coupled to the memory module. The electronic controller is configured to receive image data captured by the camera, implement a neural network trained to predict a drivable portion in the image data of an environment. The neural network predicts the drivable portion in the image data of the environment. The electronic controller is configured to implement a support vector machine. The support vector machine determines whether the predicted drivable portion of the environment output by the neural network is classified as drivable based on a hyperplane of the support vector machine and output an indication of the drivable portion of the environment.
-
公开(公告)号:US11580724B2
公开(公告)日:2023-02-14
申请号:US16570852
申请日:2019-09-13
发明人: Jeremy Ma , Josh Petersen , Umashankar Nagarajan , Michael Laskey , Daniel Helmick , James Borders , Krishna Shankar , Kevin Stone , Max Bajracharya
IPC分类号: B25J9/16 , G06V20/10 , G06T7/73 , G06T7/55 , G06K9/62 , G06N3/08 , G06T19/20 , G06T7/246 , G06T7/33 , G06V10/75 , G06V20/20
摘要: A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.
-
公开(公告)号:US11328170B2
公开(公告)日:2022-05-10
申请号:US16795242
申请日:2020-02-19
发明人: Krishna Shankar
摘要: A method for identifying objects includes generating a feature vector of an unknown object from an image of an environment. The method also includes comparing the feature vector of the unknown object to feature vectors of known objects. The method further includes determining whether a similarity between the feature vector of the unknown object and the feature vector of one of the known objects satisfies a threshold. Furthermore, the method includes identifying the unknown object based on the determination.
-
公开(公告)号:US11288883B2
公开(公告)日:2022-03-29
申请号:US16570618
申请日:2019-09-13
发明人: Jeremy Ma , Kevin Stone , Max Bajracharya , Krishna Shankar
IPC分类号: G06K9/00 , G06V20/10 , G06T7/73 , G06T7/55 , B25J9/16 , G06K9/62 , G06N3/08 , G06T19/20 , G06T7/246 , G06T7/33 , G06V10/75 , G06V20/20
摘要: A method for controlling a robotic device is presented. The method includes capturing an image corresponding to a current view of the robotic device. The method also includes identifying a keyframe image comprising a first set of pixels matching a second set of pixels of the image. The method further includes performing, by the robotic device, a task corresponding to the keyframe image.
-
-
-
-
-
-
-