公开(公告)号：US20220172107A1

公开(公告)日：2022-06-02

申请号：US17108761

申请日：2020-12-01

Applicant: X Development LLC

Inventor： Ryan Butterfoss ,  Adam Nicholas Ruxton

IPC: G06N20/00 ,  B25J9/16 ,  G05B19/4155 ,  G05B13/02 ,  G06K9/00

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for generating a robotic control plan. One of the methods includes obtaining, from a user device, image data depicting an instruction manual for assembling a plurality of assembly components; processing the image data using a machine learning model to generate instruction data representing a sequence of instructions for assembling the plurality of assembly components, wherein the machine learning model has been configured through training to process images depicting instruction manuals and to generate instruction data characterizing sequences of instructions identified in the instruction manuals; processing the instruction data to generate a robotic control plan to be executed by one or more robotic components for assembling the plurality of assembly components; and providing the robotic control plan to a robotic control system for executing the robotic control plan using the one or more robotic components.

公开(公告)号：US20220016772A1

公开(公告)日：2022-01-20

申请号：US16932481

申请日：2020-07-17

Applicant: X Development LLC

Inventor： Michael Barrett Hill ,  Adam Nicholas Ruxton

IPC: B25J9/16 ,  B64C39/02 ,  G08G5/00 ,  B25J11/00 ,  B25J19/02

Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, for robot motion planning using unmanned aerial vehicles (UAVs). One of the methods includes determining that a current plan for performing a particular task with a robot requires modification; in response, generating one or more flight plans for an unmanned aerial vehicle (UAV) based on a robotic operating environment comprising the robot; obtaining, using the UAV in accordance with the one or more flight plans, a new measurement of the robotic operating environment comprising the robot; and generating, based at least on a difference between the new measurement of the robotic operating environment and a previous measurement of the robotic operating environment, a modified plan for performing the particular task with the robot.