-
公开(公告)号:US20230294291A1
公开(公告)日:2023-09-21
申请号:US17654909
申请日:2022-03-15
Applicant: FANUC CORPORATION
Inventor: Kaimeng Wang , Yongxiang Fan
CPC classification number: B25J9/1697 , B25J9/1664 , B25J9/1607 , B25J9/1653 , B25J9/1684 , G06T7/0004 , G06T7/60 , G06T2207/30164
Abstract: A method for line matching during image-based visual servoing control of a robot performing a workpiece installation. The method uses a target image from human demonstration and a current image of a robotic execution phase. A plurality of lines are identified in the target and current images, and an initial pairing of target-current lines is defined based on distance and angle. An optimization computation determines image transposes which minimize a cost function formulated to include both direction and distance between target lines and current lines using 2D data in the camera image plane, and constraint equations which relate the lines in the image plane to the 3D workpiece pose. The rotational and translational transposes which minimize the cost function are used to update the line pair matching, and the best line pairs are used to compute a difference signal for controlling robot motion during visual servoing.
-
公开(公告)号:US20230173674A1
公开(公告)日:2023-06-08
申请号:US17457777
申请日:2021-12-06
Applicant: FANUC CORPORATION
Inventor: Hsien-Chung Lin , Yongxiang Fan , Tetsuaki Kato
CPC classification number: B25J9/1664 , B25J9/1605 , G06F30/10
Abstract: A robot interference checking motion planning technique using point sets. The technique uses CAD models of robot arms and obstacles and converts the CAD models to 3D point sets. The 3D point set coordinates are updated at each time step based on robot and obstacle motion. The 3D points are then converted to 3D grid space indices indicating space occupied by any point on any part. The 3D grid space indices are converted to 1D indices and the 1D indices are stored as sets per object and per time step. Interference checking is performed by computing an intersection of the 1D index sets for a given time step. Swept volumes are created by computing a union of the 1D index sets across multiple time steps. The 1D indices are converted back to 3D coordinates to define the 3D shapes of the swept volumes and the 3D locations of any interferences.
-
公开(公告)号:US11654564B2
公开(公告)日:2023-05-23
申请号:US17016731
申请日:2020-09-10
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan
IPC: G05B19/04 , B25J9/16 , G06N3/08 , G06T7/593 , G06T7/70 , G06N5/04 , G06V20/10 , G06V20/64 , B25J15/00
CPC classification number: B25J9/1669 , B25J9/161 , B25J9/1605 , B25J9/1612 , B25J9/1671 , B25J9/1697 , G06N3/08 , G06N5/04 , G06T7/593 , G06T7/70 , G06V20/10 , G06V20/64 , B25J9/163 , B25J15/0028 , G06T2207/10028
Abstract: A grasp generation technique for robotic pick-up of parts. A database of solid or surface models is provided for all objects and grippers which are to be evaluated. A gripper is selected and a random initialization is performed, where random objects and poses are selected from the object database. An iterative optimization computation is then performed, where many hundreds of grasps are computed for each part with surface contact between the part and the gripper, and sampling for grasp diversity and global optimization. Finally, a physical environment simulation is performed, where the grasps for each part are mapped to simulated piles of objects in a bin scenario. The grasp points and approach directions from the physical environment simulation are then used to train neural networks for grasp learning in real-world robotic operations, where the simulation results are correlated to camera depth image data to identify a high quality grasp.
-
公开(公告)号:US20230124599A1
公开(公告)日:2023-04-20
申请号:US17502230
申请日:2021-10-15
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan
Abstract: A robotic grasp generation technique for machine tending applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. Preferred and prohibited grasp locations on the part may also be defined as inputs, to ensure that the computed grasp candidates enable the robot to load the part into a machining station such that the machining station can grasp a particular location on the part. An optimization solver is used to compute a quality grasp with stable surface contact between the part and the gripper, with no interference between the gripper and the part, and allowing for the preferred and prohibited grasp locations which were defined as inputs. All surfaces of the gripper fingers are considered for grasping and collision avoidance. A loop with random initialization is used to automatically compute many hundreds of diverse grasps for the part.
-
公开(公告)号:US12017356B2
公开(公告)日:2024-06-25
申请号:US17538380
申请日:2021-11-30
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan , Hsien-Chung Lin
IPC: B25J9/16
CPC classification number: B25J9/1612 , B25J9/1607 , B25J9/163 , B25J9/1653 , B25J9/1666 , B25J9/1669 , B25J9/1697
Abstract: A robotic grasp generation technique for part picking applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. A set of candidate grasps is provided using any known preliminary grasp generation tool. A point model of the part and a model of the gripper contact surfaces with a clearance margin are used in an optimization computation applied to each of the candidate grasps, resulting in an adjusted grasp database. The adjusted grasps optimize grasp quality using a virtual gripper surface, which positions the actual gripper surface a small distance away from the part. A signed distance field calculation is then performed on each of the adjusted grasps, and those with any collision between the gripper and the part are discarded. The resulting grasp database includes high quality collision-free grasps for use in a robotic part pick-and-place operation.
-
公开(公告)号:US20240198524A1
公开(公告)日:2024-06-20
申请号:US18067157
申请日:2022-12-16
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan
IPC: B25J9/16
CPC classification number: B25J9/1666 , B25J9/1612
Abstract: A system and method for providing deep collision avoidance between objects in a robotic system. For a collision between a part and an object, the method decomposes the part into a union of part balls having a known radius and center location and decomposes the object into a union of object balls having a known radius and center location. The method obtains a Minkowski difference between each pair of the part balls and the object balls, converts each Minkowski difference into a Minkowski ball having a known center location and radius, and combines the Minkowski balls into a union of overlapping Minkowski balls. The method determines an outer boundary of the union of the overlapping Minkowski balls, extracts boundary points on the boundary as escape vectors, and maps each of the escape vectors into collision-free part pose.
-
公开(公告)号:US20240123618A1
公开(公告)日:2024-04-18
申请号:US18540175
申请日:2023-12-14
Applicant: FANUC CORPORATION
Inventor: Hsien-Chung Lin , Yongxiang Fan , Tetsuaki Kato
CPC classification number: B25J9/1664 , B25J9/1605 , G06F30/10
Abstract: A robot interference checking motion planning technique using point sets. The technique uses CAD models of robot arms and obstacles and converts the CAD models to 3D point sets. The 3D point set coordinates are updated at each time step based on robot and obstacle motion. The 3D points are then converted to 3D grid space indices indicating space occupied by any point on any part. The 3D grid space indices are converted to 1D indices and the 1D indices are stored as sets per object and per time step. Interference checking is performed by computing an intersection of the 1D index sets for a given time step. Swept volumes are created by computing a union of the 1D index sets across multiple time steps. The 1D indices are converted back to 3D coordinates to define the 3D shapes of the swept volumes and the 3D locations of any interferences.
-
公开(公告)号:US20230166398A1
公开(公告)日:2023-06-01
申请号:US17538380
申请日:2021-11-30
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan , Hsien-Chung Lin
IPC: B25J9/16
CPC classification number: B25J9/1612 , B25J9/163 , B25J9/1669 , B25J9/1666 , B25J9/1653 , B25J9/1607 , B25J9/1697
Abstract: A robotic grasp generation technique for part picking applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. A set of candidate grasps is provided using any known preliminary grasp generation tool. A point model of the part and a model of the gripper contact surfaces with a clearance margin are used in an optimization computation applied to each of the candidate grasps, resulting in an adjusted grasp database. The adjusted grasps optimize grasp quality using a virtual gripper surface, which positions the actual gripper surface a small distance away from the part. A signed distance field calculation is then performed on each of the adjusted grasps, and those with any collision between the gripper and the part are discarded. The resulting grasp database includes high quality collision-free grasps for use in a robotic part pick-and-place operation.
-
公开(公告)号:US20220388162A1
公开(公告)日:2022-12-08
申请号:US17342069
申请日:2021-06-08
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan
IPC: B25J9/16 , G06N3/08 , G06N3/04 , H04N13/271
Abstract: A method for modularizing high dimensional neural networks into neural networks of lower input dimensions. The method is suited to generating full-DOF robot grasping actions based on images of parts to be picked. In one example, a first network encodes grasp positional dimensions and a second network encodes rotational dimensions. The first network is trained to predict a position at which a grasp quality is maximized for any value of the grasp rotations. The second network is trained to identify the maximum grasp quality while searching only at the position from the first network. Thus, the two networks collectively identify an optimal grasp, while each network's searching space is reduced. Many grasp positions and rotations can be evaluated in a search quantity of the sum of the evaluated positions and rotations, rather than the product. Dimensions may be separated in any suitable fashion, including three neural networks in some applications.
-
公开(公告)号:US20220072707A1
公开(公告)日:2022-03-10
申请号:US17016731
申请日:2020-09-10
Applicant: FANUC CORPORATION
Inventor: Yongxiang Fan
Abstract: A grasp generation technique for robotic pick-up of parts. A database of solid or surface models is provided for all objects and grippers which are to be evaluated. A gripper is selected and a random initialization is performed, where random objects and poses are selected from the object database. An iterative optimization computation is then performed, where many hundreds of grasps are computed for each part with surface contact between the part and the gripper, and sampling for grasp diversity and global optimization. Finally, a physical environment simulation is performed, where the grasps for each part are mapped to simulated piles of objects in a bin scenario. The grasp points and approach directions from the physical environment simulation are then used to train neural networks for grasp learning in real-world robotic operations, where the simulation results are correlated to camera depth image data to identify a high quality grasp.
-
-
-
-
-
-
-
-
-