-
51.
公开(公告)号:US12002007B2
公开(公告)日:2024-06-04
申请号:US17944117
申请日:2022-09-13
Applicant: MUJIN, Inc.
Inventor: Rosen Nikolaev Diankov , Huan Liu , Xutao Ye , Jose Jeronimo Moreira Rodrigues , Yoshiki Kanemoto , Jinze Yu , Russell Islam
IPC: G06Q10/08 , B25J9/16 , B65B43/46 , B65G61/00 , G05B19/4093 , G06Q10/087 , G06T7/11 , G06T7/13 , G06T7/50 , G06T7/62 , G06T7/73 , G06T19/20 , G06V10/20 , G06V10/25 , G06V20/64 , G06V10/44
CPC classification number: G06Q10/087 , B25J9/1676 , B25J9/1687 , B25J9/1697 , B65B43/46 , B65G61/00 , G05B19/40935 , G06T7/11 , G06T7/13 , G06T7/50 , G06T7/62 , G06T7/73 , G06T19/20 , G06V10/25 , G06V10/255 , G06V20/64 , G05B2219/40006 , G05B2219/40607 , G06T2200/04 , G06T2207/10028 , G06T2207/20164 , G06T2207/30108 , G06V10/44
Abstract: A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.
-
公开(公告)号:US11924559B2
公开(公告)日:2024-03-05
申请号:US17228783
申请日:2021-04-13
Applicant: MUJIN, INC.
Inventor: Jinze Yu , Jose Jeronimo Moreira Rodrigues , Xutao Ye
IPC: H04N23/80 , B25J9/16 , H04N23/698 , H04N23/81
CPC classification number: H04N23/80 , H04N23/698 , H04N23/81 , B25J9/1612
Abstract: A system and method for determining occlusion are presented. The system receives camera data generated by at least one camera, which includes a first camera having a first camera field of view. The camera data is generated when a stack having a plurality of objects is in the first camera field of view, and describes a stack structure formed from at least an object structure for a first object of the plurality of objects. The system identifies a target feature of or disposed on the object structure, and determines a 2D region that is co-planar with and surrounds the target feature. The system determines a 3D region defined by connecting a location of the first camera and the 2D region. The system determines, based on the camera data and the 3D region, a size of an occluding region, and determines a value of an object recognition confidence parameter.
-
公开(公告)号:US11836939B2
公开(公告)日:2023-12-05
申请号:US17188160
申请日:2021-03-01
Applicant: MUJIN, INC.
Inventor: Rosen Diankov , Xutao Ye , Ziyan Zhou
IPC: G06T7/55 , G06T7/593 , B25J9/00 , B25J9/16 , B65G59/02 , B65G67/04 , B65G67/24 , G06T5/50 , G06T7/50
CPC classification number: G06T7/55 , B25J9/0093 , B25J9/1697 , B65G59/02 , B65G67/04 , B65G67/24 , G06T5/50 , G06T7/50 , G06T7/593 , B65G2201/0235 , B65G2814/0311 , G06T2207/10028
Abstract: A control apparatus includes a first information acquiring section that acquires three-dimensional information of a first region of surfaces of a plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a first location; a second information acquiring section that acquires three-dimensional information of a second region of surfaces of the plurality of objects, the information being obtained by imaging or scanning the plurality of objects from a second location; and a combining section that generates information indicating three-dimensional shapes of at least a portion of the surfaces of the plurality of objects, based on the three-dimensional information of the first region acquired by the first information acquiring section and the three-dimensional information of the second region acquired by the second information acquiring section.
-
公开(公告)号:US20230321846A1
公开(公告)日:2023-10-12
申请号:US18296762
申请日:2023-04-06
Applicant: MUJIN, Inc.
Inventor: Lei Lei , Xutao Ye , Xu Chen , Yixuan Zhang , Zhili Lai , Long Du , Pai Zheng , Rosen Nikolaev Diankov
CPC classification number: B25J15/0616 , B25J9/1612 , B25J19/023
Abstract: Robotic systems with griping mechanisms, and related systems and methods are disclosed herein. In some embodiments, the robotic system includes a robotic arm and an end-of-arm tool coupled to the robotic arm. The end-of-arm tool can include a frame and an actuator system coupled to the frame. The end-of-arm tool can also include a first clamping component, a second clamping component, and a third clamping component each coupled to the frame. The third clamping component is positioned peripheral to the second clamping component with respect to the first clamping component and includes one or more extension portions extending toward the first clamping component. The actuator system can be coupled to the first, second, and/or third clamping components to move the first, second, and/or third clamping components along a transverse axis of the end-of-arm tool.
-
55.
公开(公告)号:US11636605B2
公开(公告)日:2023-04-25
申请号:US17344720
申请日:2021-06-10
Applicant: MUJIN, Inc.
Inventor: Jinze Yu , Jose Jeronimo Moreira Rodrigues , Rosen Nikolaev Diankov , Xutao Ye
IPC: G06K9/00 , G06T7/13 , B25J9/16 , G06T7/73 , G06T7/50 , G06T7/62 , B65G61/00 , G05B19/4093 , G06Q10/087 , G06T19/20 , G06T7/11 , B65B43/46 , G06V10/25 , G06V20/64
Abstract: The present disclosure relates to methods and systems for generating a verified minimum viable range (MVR) of an object. An exposed outer corner and exposed edges of an object may be identified by processing one or more image data. An initial MVR may be generated by identifying opposing parallel edges opposing the exposed edges. The initial MVR may be adjusted, and the adjusted result may be tested to generate a verified MVR.
-
公开(公告)号:US11508088B2
公开(公告)日:2022-11-22
申请号:US16871361
申请日:2020-05-11
Applicant: MUJIN, INC.
Inventor: Russell Islam , Xutao Ye
Abstract: A system and method for performing automatic camera calibration is provided. The system receives a calibration image, and determines a plurality of image coordinates for representing respective locations at which a plurality of pattern elements of a calibration pattern appear in a calibration image. The system determines, based on the plurality of image coordinates and defined pattern element coordinates, an estimate for a first lens distortion parameter of a set of lens distortion parameters, wherein the estimate for the first lens distortion parameter is determined while estimating a second lens distortion parameter of the set of lens distortion parameters to be zero, or is determined without estimating the second lens distortion parameter. The system determines, after the estimate of the first lens distortion parameter is determined, an estimate for the second lens distortion parameter based on the estimate for the first lens distortion parameter.
-
57.
公开(公告)号:US11501445B2
公开(公告)日:2022-11-15
申请号:US16667857
申请日:2019-10-29
Applicant: MUJIN, Inc.
Inventor: Rosen Nikolaev Diankov , Huan Liu , Xutao Ye , Jose Jeronimo Moreira Rodrigues , Yoshiki Kanemoto , Jinze Yu , Russell Islam
IPC: B25J9/16 , G06T7/13 , G06T7/73 , G06T7/50 , G06T7/62 , B65G61/00 , G05B19/4093 , G06Q10/08 , G06T19/20 , G06T7/11 , B65B43/46 , G06V10/25 , G06V20/64
Abstract: A system and method for operating a robotic system to scan and register unrecognized objects is disclosed. The robotic system may use an image data representative of an unrecognized object located at a start location to implement operations for transferring the unrecognized object from the start location. While implementing the operations, the robotic system may obtain additional data, including scanning results of one or more portions of the unrecognized object not included in the image data. The robotic system may use the additional data to register the unrecognized object.
-
58.
公开(公告)号:US20210304416A1
公开(公告)日:2021-09-30
申请号:US17344720
申请日:2021-06-10
Applicant: MUJIN, Inc.
Inventor: Jinze Yu , Jose Jeronimo Moreira Rodrigues , Rosen Nikolaev Diankov , Xutao Ye
IPC: G06T7/13 , B25J9/16 , G06T7/73 , G06T7/50 , G06T7/62 , B65G61/00 , G05B19/4093 , G06Q10/08 , G06T19/20 , G06T7/11 , B65B43/46 , G06K9/00 , G06K9/32
Abstract: The present disclosure relates to methods and systems for generating a verified minimum viable range (MVR) of an object. An exposed outer corner and exposed edges of an object may be identified by processing one or more image data. An initial MVR may be generated by identifying opposing parallel edges opposing the exposed edges. The initial MVR may be adjusted, and the adjusted result may be tested to generate a verified MVR.
-
公开(公告)号:US11130237B1
公开(公告)日:2021-09-28
申请号:US16929854
申请日:2020-07-15
Applicant: MUJIN, INC.
Inventor: Xutao Ye , Kazuto Murase
Abstract: A system and method for performing object detection are presented. The system receives spatial structure information associated with an object which is or has been in a camera field of view of a spatial structure sensing camera. The spatial structure information is generated by the spatial structure sensing camera, and includes depth information for an environment in the camera field of view. The system determines a container pose based on the spatial structure information, wherein the container pose is for describing at least one of an orientation for the container or a depth value for at least a portion of the container. The system further determines an object pose based on the container pose, wherein the object pose is for describing at least one of an orientation for the object or a depth value for at least a portion of the object.
-
公开(公告)号:US20210260771A1
公开(公告)日:2021-08-26
申请号:US17313921
申请日:2021-05-06
Applicant: MUJIN, Inc.
Inventor: Rosen Diankov , Huan Liu , Xutao Ye , Jose Jeronimo Moreira Rodrigues , Yoshiki Kanemoto , Jinze Yu , Russell Islam
IPC: B25J9/16 , G06T7/13 , G06T7/50 , G06K9/62 , B25J13/08 , G06T7/00 , G06K9/46 , G06K9/00 , G06T7/66 , B25J9/00 , B25J15/06 , B65G47/91 , B65G61/00 , G06T1/00
Abstract: A method of operating a robotic system includes: receiving first image data representative of a package surface; identifying a pair of edges based on the first image data; determining a minimum viable region based on the pair of edges; receiving second image data representative of the package after the lift; and creating registration data based on the first and second image data.
-
-
-
-
-
-
-
-
-