EFFICIENT AND ROBUST LINE MATCHING APPROACH
    11.
    发明公开

    公开(公告)号:US20230294291A1

    公开(公告)日:2023-09-21

    申请号:US17654909

    申请日:2022-03-15

    Abstract: A method for line matching during image-based visual servoing control of a robot performing a workpiece installation. The method uses a target image from human demonstration and a current image of a robotic execution phase. A plurality of lines are identified in the target and current images, and an initial pairing of target-current lines is defined based on distance and angle. An optimization computation determines image transposes which minimize a cost function formulated to include both direction and distance between target lines and current lines using 2D data in the camera image plane, and constraint equations which relate the lines in the image plane to the 3D workpiece pose. The rotational and translational transposes which minimize the cost function are used to update the line pair matching, and the best line pairs are used to compute a difference signal for controlling robot motion during visual servoing.

    POINT SET INTERFERENCE CHECK
    12.
    发明公开

    公开(公告)号:US20230173674A1

    公开(公告)日:2023-06-08

    申请号:US17457777

    申请日:2021-12-06

    CPC classification number: B25J9/1664 B25J9/1605 G06F30/10

    Abstract: A robot interference checking motion planning technique using point sets. The technique uses CAD models of robot arms and obstacles and converts the CAD models to 3D point sets. The 3D point set coordinates are updated at each time step based on robot and obstacle motion. The 3D points are then converted to 3D grid space indices indicating space occupied by any point on any part. The 3D grid space indices are converted to 1D indices and the 1D indices are stored as sets per object and per time step. Interference checking is performed by computing an intersection of the 1D index sets for a given time step. Swept volumes are created by computing a union of the 1D index sets across multiple time steps. The 1D indices are converted back to 3D coordinates to define the 3D shapes of the swept volumes and the 3D locations of any interferences.

    GRASP GENERATION FOR MACHINE TENDING

    公开(公告)号:US20230124599A1

    公开(公告)日:2023-04-20

    申请号:US17502230

    申请日:2021-10-15

    Inventor: Yongxiang Fan

    Abstract: A robotic grasp generation technique for machine tending applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. Preferred and prohibited grasp locations on the part may also be defined as inputs, to ensure that the computed grasp candidates enable the robot to load the part into a machining station such that the machining station can grasp a particular location on the part. An optimization solver is used to compute a quality grasp with stable surface contact between the part and the gripper, with no interference between the gripper and the part, and allowing for the preferred and prohibited grasp locations which were defined as inputs. All surfaces of the gripper fingers are considered for grasping and collision avoidance. A loop with random initialization is used to automatically compute many hundreds of diverse grasps for the part.

    Collision handling methods in grasp generation

    公开(公告)号:US12017356B2

    公开(公告)日:2024-06-25

    申请号:US17538380

    申请日:2021-11-30

    Abstract: A robotic grasp generation technique for part picking applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. A set of candidate grasps is provided using any known preliminary grasp generation tool. A point model of the part and a model of the gripper contact surfaces with a clearance margin are used in an optimization computation applied to each of the candidate grasps, resulting in an adjusted grasp database. The adjusted grasps optimize grasp quality using a virtual gripper surface, which positions the actual gripper surface a small distance away from the part. A signed distance field calculation is then performed on each of the adjusted grasps, and those with any collision between the gripper and the part are discarded. The resulting grasp database includes high quality collision-free grasps for use in a robotic part pick-and-place operation.

    DEEP COLLISION AVOIDANCE
    16.
    发明公开

    公开(公告)号:US20240198524A1

    公开(公告)日:2024-06-20

    申请号:US18067157

    申请日:2022-12-16

    Inventor: Yongxiang Fan

    CPC classification number: B25J9/1666 B25J9/1612

    Abstract: A system and method for providing deep collision avoidance between objects in a robotic system. For a collision between a part and an object, the method decomposes the part into a union of part balls having a known radius and center location and decomposes the object into a union of object balls having a known radius and center location. The method obtains a Minkowski difference between each pair of the part balls and the object balls, converts each Minkowski difference into a Minkowski ball having a known center location and radius, and combines the Minkowski balls into a union of overlapping Minkowski balls. The method determines an outer boundary of the union of the overlapping Minkowski balls, extracts boundary points on the boundary as escape vectors, and maps each of the escape vectors into collision-free part pose.

    POINT SET INTERFERENCE CHECK METHOD AND SYSTEM

    公开(公告)号:US20240123618A1

    公开(公告)日:2024-04-18

    申请号:US18540175

    申请日:2023-12-14

    CPC classification number: B25J9/1664 B25J9/1605 G06F30/10

    Abstract: A robot interference checking motion planning technique using point sets. The technique uses CAD models of robot arms and obstacles and converts the CAD models to 3D point sets. The 3D point set coordinates are updated at each time step based on robot and obstacle motion. The 3D points are then converted to 3D grid space indices indicating space occupied by any point on any part. The 3D grid space indices are converted to 1D indices and the 1D indices are stored as sets per object and per time step. Interference checking is performed by computing an intersection of the 1D index sets for a given time step. Swept volumes are created by computing a union of the 1D index sets across multiple time steps. The 1D indices are converted back to 3D coordinates to define the 3D shapes of the swept volumes and the 3D locations of any interferences.

    COLLISION HANDLING METHODS IN GRASP GENERATION

    公开(公告)号:US20230166398A1

    公开(公告)日:2023-06-01

    申请号:US17538380

    申请日:2021-11-30

    Abstract: A robotic grasp generation technique for part picking applications. Part and gripper geometry are provided as inputs, typically from CAD files. Gripper kinematics are also defined as an input. A set of candidate grasps is provided using any known preliminary grasp generation tool. A point model of the part and a model of the gripper contact surfaces with a clearance margin are used in an optimization computation applied to each of the candidate grasps, resulting in an adjusted grasp database. The adjusted grasps optimize grasp quality using a virtual gripper surface, which positions the actual gripper surface a small distance away from the part. A signed distance field calculation is then performed on each of the adjusted grasps, and those with any collision between the gripper and the part are discarded. The resulting grasp database includes high quality collision-free grasps for use in a robotic part pick-and-place operation.

    GRASP LEARNING USING MODULARIZED NEURAL NETWORKS

    公开(公告)号:US20220388162A1

    公开(公告)日:2022-12-08

    申请号:US17342069

    申请日:2021-06-08

    Inventor: Yongxiang Fan

    Abstract: A method for modularizing high dimensional neural networks into neural networks of lower input dimensions. The method is suited to generating full-DOF robot grasping actions based on images of parts to be picked. In one example, a first network encodes grasp positional dimensions and a second network encodes rotational dimensions. The first network is trained to predict a position at which a grasp quality is maximized for any value of the grasp rotations. The second network is trained to identify the maximum grasp quality while searching only at the position from the first network. Thus, the two networks collectively identify an optimal grasp, while each network's searching space is reduced. Many grasp positions and rotations can be evaluated in a search quantity of the sum of the evaluated positions and rotations, rather than the product. Dimensions may be separated in any suitable fashion, including three neural networks in some applications.

    EFFICIENT DATA GENERATION FOR GRASP LEARNING WITH GENERAL GRIPPERS

    公开(公告)号:US20220072707A1

    公开(公告)日:2022-03-10

    申请号:US17016731

    申请日:2020-09-10

    Inventor: Yongxiang Fan

    Abstract: A grasp generation technique for robotic pick-up of parts. A database of solid or surface models is provided for all objects and grippers which are to be evaluated. A gripper is selected and a random initialization is performed, where random objects and poses are selected from the object database. An iterative optimization computation is then performed, where many hundreds of grasps are computed for each part with surface contact between the part and the gripper, and sampling for grasp diversity and global optimization. Finally, a physical environment simulation is performed, where the grasps for each part are mapped to simulated piles of objects in a bin scenario. The grasp points and approach directions from the physical environment simulation are then used to train neural networks for grasp learning in real-world robotic operations, where the simulation results are correlated to camera depth image data to identify a high quality grasp.

Patent Agency Ranking