-
公开(公告)号:US20240375287A1
公开(公告)日:2024-11-14
申请号:US18659595
申请日:2024-05-09
Inventor: Taozheng YANG , Ya JING , Hongtao WU , Kuankuan SIMA , Qie SIMA , Tao KONG
IPC: B25J9/16
Abstract: Embodiments of the disclosure relate to a method and apparatus for controlling a robot, a device, a robot, and a medium. The method for controlling a robot according to the embodiments of the disclosure includes determining, based on a real-time image captured by the robot at a first moment, a reference motion parameter and a reference control force corresponding to the real-time image. The method further includes determining a target pose and a target control force of the robot at a second moment after the first moment according to the reference motion parameter and the reference control force. The method further includes determining a target action of the robot at the second moment according to the target pose and the target control force.
-
公开(公告)号:US20250108507A1
公开(公告)日:2025-04-03
申请号:US18774064
申请日:2024-07-16
Inventor: Hongtao WU , Ya JING , Chilam CHEANG , Guangzeng CHEN , Jiafeng XU , Tao KONG
IPC: B25J9/16
Abstract: Methods, devices, and media for operating a robot arm are provided. In one method, receive a language description for specifying a target implemented by the robot arm; obtain a current state of the robot arm; and determine, according to an action model, an action to be performed by the robot arm based on the language description and the current state. With the example implementation of the present disclosure, the problem of insufficient training data of the robot arm may be alleviated. Further, the pre-trained action model may obtain the basic knowledge about the association relationship between the language description and the person action, may obtain a more accurate action model, and further obtain the action of the robot arm matching the language description in a more efficient manner.
-
公开(公告)号:US20250018567A1
公开(公告)日:2025-01-16
申请号:US18900502
申请日:2024-09-27
Inventor: Hanbo ZHANG , Xinghang LI , Minghuan LIU , Jie XU , Hongtao WU , Ya JING , Chilam CHEANG , Tao KONG , Hang LI
IPC: B25J9/16 , G06F40/284 , G06V10/80
Abstract: The present application discloses an information processing method, a task execution method, an apparatus, a device and a medium. The method includes: processing, through a target visual encoding model in a target analysis model, obtained image information to be analyzed, to obtain a corresponding target sequence; fusing, through a target feature fusion model in the target analysis model, the target sequence and obtained text information to be analyzed, to obtain a target fusion result; processing the target fusion result through a target task analysis model in the target analysis model to obtain target task information; and controlling the action execution apparatus to perform an action corresponding to the target task information. The target analysis model is obtained by training an initial analysis model and the initial analysis model comprises an initial visual encoding model and an initial feature fusion model.
-
-