-
公开(公告)号:US11625852B1
公开(公告)日:2023-04-11
申请号:US17114083
申请日:2020-12-07
Applicant: X Development LLC
Inventor: Mrinal Kalakrishnan , Adrian Ling Hin Li , Nicolas Hudson
IPC: G06T7/73 , G06T7/60 , G06T7/11 , G06V10/42 , G06V30/194
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium for predicting object pose. In one aspect, a method includes receiving an image of an object having one or more feature points; providing the image as an input to a neural network subsystem trained to receive images of objects and to generate an output including a heat map for each feature point; applying a differentiable transformation on each heat map to generate respective one or more feature coordinates for each feature point; providing the feature coordinates for each feature point as input to an object pose solver configured to compute a predicted object pose for the object, wherein the predicted object pose for the object specifies a position and an orientation of an object; and receiving, at the output of the object pose solver, a predicted object pose for the object in the image.
-
公开(公告)号:US10861184B1
公开(公告)日:2020-12-08
申请号:US15410702
申请日:2017-01-19
Applicant: X Development LLC
Inventor: Mrinal Kalakrishnan , Adrian Ling Hin Li , Nicolas Hudson
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium for predicting object pose. In one aspect, a method includes receiving an image of an object having one or more feature points; providing the image as an input to a neural network subsystem trained to receive images of objects and to generate an output including a heat map for each feature point; applying a differentiable transformation on each heat map to generate respective one or more feature coordinates for each feature point; providing the feature coordinates for each feature point as input to an object pose solver configured to compute a predicted object pose for the object, wherein the predicted object pose for the object specifies a position and an orientation of an object; and receiving, at the output of the object pose solver, a predicted object pose for the object in the image.
-
公开(公告)号:US10960539B1
公开(公告)日:2021-03-30
申请号:US15705655
申请日:2017-09-15
Applicant: X Development LLC
Inventor: Mrinal Kalakrishnan , Ali Hamid Yahya Valdovinos , Adrian Ling Hin Li , Yevgen Chebotar , Sergey Vladimir Levine
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, of training a global policy neural network. One of the methods includes initializing a plurality of instances of the robotic task. For each instance of the robotic task, the method includes generating a trajectory of state-action pairs by selecting actions to be performed by the robotic agent while performing the instance of the robotic task in accordance with current values of the parameters of the global policy neural network, and optimizing a local policy controller that is specific to the instance on the trajectory of state-action pairs for the instance. The method further includes generating training data for the global policy neural network using the local policy controllers, and training the global policy neural network on the training data to adjust the current values of the parameters of the global policy neural network.
-
公开(公告)号:US20240078683A1
公开(公告)日:2024-03-07
申请号:US18295998
申请日:2023-04-05
Applicant: X Development LLC
Inventor: Mrinal Kalakrishnan , Adrian Ling Hin Li , Nicolas Hudson
IPC: G06T7/246 , G06T7/11 , G06T7/60 , G06T7/73 , G06V10/42 , G06V10/75 , G06V10/82 , G06V20/10 , G06V30/186 , G06V30/19 , G06V30/194
CPC classification number: G06T7/246 , G06T7/11 , G06T7/60 , G06T7/73 , G06V10/42 , G06V10/758 , G06V10/82 , G06V20/10 , G06V30/186 , G06V30/19173 , G06V30/194 , G06T2207/10004 , G06T2207/20084 , G06T2207/30244
Abstract: Methods, systems, and apparatus, including computer programs encoded on a computer storage medium for predicting object pose. In one aspect, a method includes receiving an image of an object having one or more feature points; providing the image as an input to a neural network subsystem trained to receive images of objects and to generate an output including a heat map for each feature point; applying a differentiable transformation on each heat map to generate respective one or more feature coordinates for each feature point; providing the feature coordinates for each feature point as input to an object pose solver configured to compute a predicted object pose for the object, wherein the predicted object pose for the object specifies a position and an orientation of an object; and receiving, at the output of the object pose solver, a predicted object pose for the object in the image.
-
公开(公告)号:US11188821B1
公开(公告)日:2021-11-30
申请号:US15705601
申请日:2017-09-15
Applicant: X Development LLC
Inventor: Mrinal Kalakrishnan , Ali Hamid Yahya Valdovinos , Adrian Ling Hin Li , Yevgen Chebotar , Sergey Vladimir Levine
Abstract: Methods, systems, and apparatus, including computer programs encoded on computer storage media, of training a global policy neural network. One of the methods includes initializing an instance of the robotic task for multiple local workers, generating a trajectory of state-action pairs by selecting actions to be performed by the robotic agent while performing the instance of the robotic task, optimizing a local policy controller on the trajectory, generating an optimized trajectory using the optimized local controller, and storing the optimized trajectory in a replay memory associated with the local worker. The method includes sampling, for multiple global workers, an optimized trajectory from one of one or more replay memories associated with the global worker, and training the replica of the global policy neural network maintained by the global worker on the sampled optimized trajectory to determine delta values for the parameters of the global policy neural network.
-
-
-
-