Action imitation method and robot and computer readable medium using the same

    公开(公告)号:US11850747B2

    公开(公告)日:2023-12-26

    申请号:US17112569

    申请日:2020-12-04

    CPC classification number: B25J9/161 B25J9/1697 B25J19/023 G06N3/08

    Abstract: The present disclosure provides an action imitation method as well as a robot and a computer readable storage medium using the same. The method includes: collecting a plurality of action images of a to-be-imitated object; processing the action images through a pre-trained convolutional neural network to obtain a position coordinate set of position coordinates of a plurality of key points of each of the action images; calculating a rotational angle of each of the linkages of the to-be-imitated object based on the position coordinate sets of the action images; and controlling a robot to move according to the rotational angle of each of the linkages of the to-be-imitated object. In the above-mentioned manner, the rotational angle of each linkage of the to-be-imitated object can be obtained by just analyzing and processing the images collected by an ordinary camera without the help of high-precision depth camera.

    Robot climbing control method and device and storage medium and robot

    公开(公告)号:US11631192B2

    公开(公告)日:2023-04-18

    申请号:US17107860

    申请日:2020-11-30

    Abstract: A robot climbing control method is disclosed. The method obtains an RGB color image and a depth image of stairs, extracts an outline of a target object of a target step on the stairs from the RGB color image, determines relative position information of the robot and the target step according to the depth image and the outline of the target object, and controls the robot to climb the target step according to the relative position information. The embodiment of the present disclosure allows the robot to effectively adjust postures and forward directions on any size of and non-standardized stairs and avoids the deviation of the walking direction, thereby improving the effectiveness and safety of the stair climbing of the robot.

    MULTI-TARGET TRACKING METHOD, DEVICE AND COMPUTER-READABLE STORAGE MEDIUM

    公开(公告)号:US20220375106A1

    公开(公告)日:2022-11-24

    申请号:US17866574

    申请日:2022-07-18

    Abstract: A method includes: performing target detection on a current image to obtain detection information of a plurality of detected targets; obtaining position prediction information of each of a plurality of tracked targets and a number of times of tracking losses of targets from tracking information of each of the tracked targets, and determining a first matching threshold for each of the tracked targets according to the number of times of tracking losses of targets; calculating a motion matching degree between each of the tracked targets and each of the detected targets according to the position detection information and the position prediction information; for each of the tracked targets, obtaining a motion matching result according to the motion matching degree and the first matching threshold corresponding to the tracked target; and matching the detected targets and the tracked targets according to the motion matching results to obtain a tracking result.

    ACTION IMITATION METHOD AND ROBOT AND COMPUTER READABLE STORAGE MEDIUM USING THE SAME

    公开(公告)号:US20210200190A1

    公开(公告)日:2021-07-01

    申请号:US17115735

    申请日:2020-12-08

    Abstract: The present disclosure provides action imitation method as well as a robot and a computer readable storage medium using the same. The method includes: collecting at least a two-dimensional image of a to-be-imitated object; obtaining two-dimensional coordinates of each key point of the to-be-imitated object in the two-dimensional image and a pairing relationship between the key points of the to-be-imitated object; converting the two-dimensional coordinates of the key points of the to-be-imitated object in the two-dimensional image into space three-dimensional coordinates corresponding to the key points of the to-be-imitated object through a pre-trained first neural network model, and generating an action control instruction of a robot based on the space three-dimensional coordinates corresponding to the key points of the to-be-imitated object and the pairing relationship between the key points, where the action control instruction is for controlling the robot to imitate an action of the to-be-imitated object.

    ROBERT CLIMBING CONTROL METHOD AND DEVICE AND STORAGE MEDIUM AND ROBOT

    公开(公告)号:US20210166416A1

    公开(公告)日:2021-06-03

    申请号:US17107860

    申请日:2020-11-30

    Abstract: A robot climbing control method is disclosed. The method obtains an RGB color image and a depth image of stairs, extracts an outline of a target object of a target step on the stairs from the RGB color image, determines relative position information of the robot and the target step according to the depth image and the outline of the target object, and controls the robot to climb the target step according to the relative position information. The embodiment of the present disclosure allows the robot to effectively adjust postures and forward directions on any size of and non-standardized stairs and avoids the deviation of the walking direction, thereby improving the effectiveness and safety of the stair climbing of the robot.

Patent Agency Ranking