公开(公告)号：US11580724B2

公开(公告)日：2023-02-14

申请号：US16570852

申请日：2019-09-13

申请人： TOYOTA RESEARCH INSTITUTE, INC.

发明人： Jeremy Ma ,  Josh Petersen ,  Umashankar Nagarajan ,  Michael Laskey ,  Daniel Helmick ,  James Borders ,  Krishna Shankar ,  Kevin Stone ,  Max Bajracharya

IPC分类号： B25J9/16 ,  G06V20/10 ,  G06T7/73 ,  G06T7/55 ,  G06K9/62 ,  G06N3/08 ,  G06T19/20 ,  G06T7/246 ,  G06T7/33 ,  G06V10/75 ,  G06V20/20

摘要： A method for controlling a robotic device is presented. The method includes positioning the robotic device within a task environment. The method also includes mapping descriptors of a task image of a scene in the task environment to a teaching image of a teaching environment. The method further includes defining a relative transform between the task image and the teaching image based on the mapping. Furthermore, the method includes updating parameters of a set of parameterized behaviors based on the relative transform to perform a task corresponding to the teaching image.

公开(公告)号：US11262887B2

公开(公告)日：2022-03-01

申请号：US16692272

申请日：2019-11-22

申请人： Toyota Research Institute, Inc.

发明人： Josh Petersen

IPC分类号： G06F3/0482 ,  B25J13/00 ,  B25J13/06 ,  G06F3/01 ,  G06F3/04847 ,  G06T11/00 ,  B25J5/00 ,  H04L67/131

摘要： A system is disclosed and includes an electronic controller configured to generate a virtual reality representation of an environment. The electronic controller is configured to generate a menu within the virtual reality representation of the environment comprising at least one task user interface element and determine when an option for configuring a force parameter is selected from the at least one task user interface element in the menu. The electronic controller is configured to prompt a user to configure the force parameter for a virtual robot manipulation task and assign at least one of a force magnitude or a force direction to the virtual robot manipulation task in response to an input received from the prompt to configure the force parameter.

公开(公告)号：US20210081081A1

公开(公告)日：2021-03-18

申请号：US16692272

申请日：2019-11-22

申请人： Toyota Research Institute, Inc.

发明人： Josh Petersen

IPC分类号： G06F3/0482 ,  G06F3/01 ,  G06T11/00 ,  G06F3/0484 ,  B25J13/00 ,  B25J13/06

摘要： A system is disclosed and includes an electronic controller configured to generate a virtual reality representation of an environment. The electronic controller is configured to generate a menu within the virtual reality representation of the environment comprising at least one task user interface element and determine when an option for configuring a force parameter is selected from the at least one task user interface element in the menu. The electronic controller is configured to prompt a user to configure the force parameter for a virtual robot manipulation task and assign at least one of a force magnitude or a force direction to the virtual robot manipulation task in response to an input received from the prompt to configure the force parameter.

公开(公告)号：US12131529B2

公开(公告)日：2024-10-29

申请号：US18098625

申请日：2023-01-18

申请人： TOYOTA RESEARCH INSTITUTE, INC.

发明人： Jeremy Ma ,  Josh Petersen ,  Umashankar Nagarajan ,  Michael Laskey ,  Daniel Helmick ,  James Borders ,  Krishna Shankar ,  Kevin Stone ,  Max Bajracharya

IPC分类号： B25J9/16 ,  G06F18/214 ,  G06F18/28 ,  G06N3/08 ,  G06T7/246 ,  G06T7/33 ,  G06T7/55 ,  G06T7/73 ,  G06T19/20 ,  G06V10/75 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V20/10 ,  G06V20/20

CPC分类号： G06V20/10 ,  B25J9/1605 ,  B25J9/1661 ,  B25J9/1664 ,  B25J9/1671 ,  B25J9/1697 ,  G06F18/214 ,  G06F18/28 ,  G06N3/08 ,  G06T7/248 ,  G06T7/33 ,  G06T7/55 ,  G06T7/74 ,  G06T19/20 ,  G06V10/751 ,  G06V10/764 ,  G06V10/774 ,  G06V10/82 ,  G06V20/20 ,  B25J9/163 ,  G05B2219/37567 ,  G05B2219/40543 ,  G05B2219/40564 ,  G06T2200/04 ,  G06T2207/10016 ,  G06T2207/10024 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20104

摘要： A method for performing a task by a robotic device includes mapping a group of task image pixel descriptors associated with a first group of pixels in a task image of a task environment to a group of teaching image pixel descriptors associated with a second group of pixels in a teaching image based on positioning the robotic device within the task environment. The method also includes determining a relative transform between the task image and the teaching image based on mapping the plurality of task image pixel descriptors. The relative transform indicates a change in one or more of points of 3D space between the task image and the teaching image. The method also includes performing the task associated with the set of parameterized behaviors based on updating one or more parameters of a set of parameterized behaviors associated with the teaching image based on determining the relative transform.