公开(公告)号：US20240326243A1

公开(公告)日：2024-10-03

申请号：US18622571

申请日：2024-03-29

Applicant: Medra Inc.

Inventor： Michelle A. Lee ,  Jamie Delton ,  Albert Tung ,  Thomas Randolph ,  Russell Ohnemus

IPC: B25J9/16 ,  B01L1/00 ,  B25J9/00 ,  G01N35/00

CPC classification number: B25J9/163 ,  B01L1/00 ,  B25J9/0081 ,  B25J9/1679 ,  B25J9/1697 ,  G01N35/0099

Abstract: An automation system includes a robotic arm with an end effector configured to learn from demonstrations. The automation system receives a demonstration of a lab protocol for operating a type of machine from a user and records a sequence of actions associated with operating the type of machine based on the demonstration. For each action, computer vision is used to derive information associated with the action. The automation system extracts semantic meanings of the action based in part on the information and generates a machine-executable protocol for operating the type of machine by a robot based in part on the semantic meanings of the actions. In some embodiments, the automation system further includes a closed-loop control subsystem that uses computer vision and/or other sensors (e.g., force torque sensors) to automatically maintain a desired state or set point associated with operation of the type of machine.