公开(公告)号：US12002007B2

公开(公告)日：2024-06-04

申请号：US17944117

申请日：2022-09-13

Applicant: MUJIN, Inc.

Inventor： Rosen Nikolaev Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: G06Q10/08 ,  B25J9/16 ,  B65B43/46 ,  B65G61/00 ,  G05B19/4093 ,  G06Q10/087 ,  G06T7/11 ,  G06T7/13 ,  G06T7/50 ,  G06T7/62 ,  G06T7/73 ,  G06T19/20 ,  G06V10/20 ,  G06V10/25 ,  G06V20/64 ,  G06V10/44

CPC classification number: G06Q10/087 ,  B25J9/1676 ,  B25J9/1687 ,  B25J9/1697 ,  B65B43/46 ,  B65G61/00 ,  G05B19/40935 ,  G06T7/11 ,  G06T7/13 ,  G06T7/50 ,  G06T7/62 ,  G06T7/73 ,  G06T19/20 ,  G06V10/25 ,  G06V10/255 ,  G06V20/64 ,  G05B2219/40006 ,  G05B2219/40607 ,  G06T2200/04 ,  G06T2207/10028 ,  G06T2207/20164 ,  G06T2207/30108 ,  G06V10/44

Abstract: A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.

公开(公告)号：US11501445B2

公开(公告)日：2022-11-15

申请号：US16667857

申请日：2019-10-29

Applicant: MUJIN, Inc.

Inventor： Rosen Nikolaev Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: B25J9/16 ,  G06T7/13 ,  G06T7/73 ,  G06T7/50 ,  G06T7/62 ,  B65G61/00 ,  G05B19/4093 ,  G06Q10/08 ,  G06T19/20 ,  G06T7/11 ,  B65B43/46 ,  G06V10/25 ,  G06V20/64

Abstract: A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.

公开(公告)号：US20220314440A1

公开(公告)日：2022-10-06

申请号：US17573447

申请日：2022-01-11

Applicant: MUJIN, Inc.

Inventor： Hironori Mizoguchi ,  Yoshiki Kanemoto

IPC: B25J9/16 ,  B25J13/08

Abstract: End effectors for use with a robotic object-gripping system, and related systems and methods, are disclosed herein. In some embodiments, the end effector includes a first mounting structure, a force sensor coupled to the first mounting structure, a second mounting structure coupled to the force sensor, and a gripper assembly coupled to the second mounting structure. The force sensor is beneath the longitudinal plane and is configured to measure forces along a vertical axis. The end effector also includes a first bracket coupled to the first mounting structure and a second bracket coupled to the second mounting structure. The first and second brackets are configured to connect to the connection tubes to isolate the connection tubes, and any forces therein, to a longitudinal direction between the first bracket and the second bracket, thereby reducing the noise on the force sensor from the connection tubes during operation.

公开(公告)号：US20220284216A1

公开(公告)日：2022-09-08

申请号：US17193253

申请日：2021-03-05

Applicant: MUJIN, INC.

Inventor： Jose Jeronimo MOREIRA RODRIGUES ,  Rosen Nikolaev Diankov ,  Jinze Yu ,  Ahmed Abouelela ,  Yoshiki Kanemoto

IPC: G06K9/00 ,  G06K9/62 ,  G06K9/46 ,  G06K9/32 ,  B25J9/16 ,  B25J13/08

Abstract: A method and computing system for performing the method are presented. The method may include receiving image information representing an object; identifying a set of one or more matching object recognition templates associated with a set of one or more detection hypotheses. The method may further include selecting a primary detection hypothesis associated with a matching object recognition template; generating a primary candidate region based on the matching object recognition template; determining at least one of: (i) whether the set of one or more matching object recognition templates has a subset of one or more remaining matching templates, or (ii) whether the image information has a portion representing an unmatched region; and generating a safety volume list based on at least one of: (i) the unmatched region, or (ii) one or more additional candidate regions that are generated based on the subset of one or more remaining matching templates.

公开(公告)号：US20210260771A1

公开(公告)日：2021-08-26

申请号：US17313921

申请日：2021-05-06

Applicant: MUJIN, Inc.

Inventor： Rosen Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: B25J9/16 ,  G06T7/13 ,  G06T7/50 ,  G06K9/62 ,  B25J13/08 ,  G06T7/00 ,  G06K9/46 ,  G06K9/00 ,  G06T7/66 ,  B25J9/00 ,  B25J15/06 ,  B65G47/91 ,  B65G61/00 ,  G06T1/00

Abstract: A method of operating a robotic system includes: receiving first image data representative of a package surface; identifying a pair of edges based on the first image data; determining a minimum viable region based on the pair of edges; receiving second image data representative of the package after the lift; and creating registration data based on the first and second image data.

公开(公告)号：US11034025B2

公开(公告)日：2021-06-15

申请号：US16736667

申请日：2020-01-07

Applicant: MUJIN, Inc.

Inventor： Rosen Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: B25J9/16 ,  G06T7/13 ,  G06T7/50 ,  G06K9/62 ,  B25J13/08 ,  G06T7/00 ,  G06K9/46 ,  G06K9/00

Abstract: A method of operating a robotic system includes: receiving first image data representative of a package surface; identifying a pair of edges based on the first image data; determining a minimum viable region based on the pair of edges; receiving second image data representative of the package after the lift; and creating registration data based on the first and second image data.

公开(公告)号：US20200130961A1

公开(公告)日：2020-04-30

申请号：US16539790

申请日：2019-08-13

Applicant: MUJIN, Inc.

Inventor： Rosen Nikolaev Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: B65G61/00 ,  B25J9/16 ,  G05B19/4093 ,  G06Q10/08

Abstract: A method for operating a robotic system includes obtaining and processing first data representative of an object at a start location; obtaining additional data as the object is transferred to a task location, wherein the additional data includes information regarding one or more edges and/or one or more surfaces separate from portions of the object captured in the first data; and creating registration data representative of the object based on the additional data.

公开(公告)号：US10562188B1

公开(公告)日：2020-02-18

申请号：US16443743

申请日：2019-06-17

Applicant: MUJIN, Inc.

Inventor： Rosen Diankov ,  Huan Liu ,  Xutao Ye ,  Jose Jeronimo Moreira Rodrigues ,  Yoshiki Kanemoto ,  Jinze Yu ,  Russell Islam

IPC: B25J9/16 ,  G06T7/00 ,  B25J13/08 ,  G06T7/50 ,  G06T7/13 ,  G06K9/62

Abstract: A method of operating a package handling system includes: receiving first image data representative of a first surface image of a package surface; identifying a pair of intersecting edges for the package surface based on the first image; determining a minimum viable region based on the pair of edges, the minimum viable region for gripping and lifting the package; receiving second image data representative of the package after the lift; and creating registration data based on the third image data.

公开(公告)号：US12194638B2

公开(公告)日：2025-01-14

申请号：US18465101

申请日：2023-09-11

Applicant: MUJIN, Inc.

Inventor： Rosen Nikolaev Diankov ,  Yoshiki Kanemoto ,  Denys Kanunikov

IPC: B25J9/00 ,  B25J9/16 ,  G01S17/89 ,  G06T7/73

Abstract: The present disclosure provides a control method of a robotic system. The control method includes: deriving an approach location at which the end effector grips an operation object; deriving a scan location for scanning an identifier of the operation object; and based on the approach location and the scan location, creating or deriving a control sequence to instruct the robot to execute the control sequence. The control sequence includes (1) gripping the operation object from a start location; (2) scanning an identifier of the operation object with a scanner located between the start location and a task location; (3) temporarily releasing the operation object from the end effector and regripping the operation object by the end effector to be shifted, at a shift location, when a predetermined condition is satisfied; and (4) moving the operation object to the task location.

公开(公告)号：US12136223B2

公开(公告)日：2024-11-05

申请号：US17746524

申请日：2022-05-17

Applicant: MUJIN, INC.

Inventor： Jinze Yu ,  Yoshiki Kanemoto ,  Jose Jeronimo Moreira Rodrigues ,  Rosen Nikolaev Diankov

IPC: G06T7/13 ,  B25J9/16 ,  G06T1/00 ,  G06T7/60 ,  G06K15/02 ,  G06V10/44 ,  H04N1/409

Abstract: A computing system including a processing circuit in communication with a camera having a field of view. The processing circuit obtains image information based on the objects in the field of view and defines a minimum viable region for a target open corner. Potential minimum viable regions are defined by identifying candidate edges of an object and determining potential intersection points based on the candidate edges. The minimum viable region may then be identified and validated from the potential minimum viable regions.