公开(公告)号：US10737389B1

公开(公告)日：2020-08-11

申请号：US15864870

申请日：2018-01-08

Applicant: X Development LLC

Inventor： Kyle Moore ,  Vincent Dureau ,  Nareshkumar Rajkumar

IPC: B25J9/16 ,  B25J11/00 ,  B25J13/00 ,  B25J13/06

Abstract: Methods, apparatus, systems, and computer-readable media are provided for visually annotating rendered multi-dimensional representations of robot environments. In various implementations, an entity may be identified that is present with a telepresence robot in an environment. A measure of potential interest of a user in the entity may be calculated based on a record of one or more interactions between the user and one or more computing devices. In some implementations, the one or more interactions may be for purposes other than directly operating the telepresence robot. In various implementations, a multi-dimensional representation of the environment may be rendered as part of a graphical user interface operable by the user to control the telepresence robot. In various implementations, a visual annotation may be selectively rendered within the multi-dimensional representation of the environment in association with the entity based on the measure of potential interest.

公开(公告)号：US10730181B1

公开(公告)日：2020-08-04

申请号：US15855393

申请日：2017-12-27

Applicant: X Development LLC

Inventor： Nareshkumar Rajkumar ,  Patrick Leger ,  Abhinav Gupta

IPC: B25J9/16 ,  B25J9/00 ,  G06N20/00

Abstract: Methods, systems, and apparatus, including computer-readable media storing executable instructions, for enhancing robot learning. In some implementations, a robot stores first embeddings generated using a first machine learning model, and the first embeddings include one or more first private embeddings that are not shared with other robots. The robot receives a second machine learning model from a server system over a communication network. The robot generates a second private embedding for each of the one or more first private embeddings using the second machine learning model. The robot adds the second private embeddings to the cache of the robot and removes the one or more first private embeddings from the cache of the robot.

公开(公告)号：US10671874B2

公开(公告)日：2020-06-02

申请号：US16042877

申请日：2018-07-23

Applicant: X Development LLC

Inventor： Kurt Konolige ,  Nareshkumar Rajkumar ,  Stefan Hinterstoisser

IPC: G06K9/32 ,  B25J9/16 ,  G06T7/73 ,  G06K9/00 ,  G06T17/00 ,  G06T7/33 ,  G06T7/70

Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.

公开(公告)号：US20180349725A1

公开(公告)日：2018-12-06

申请号：US16042877

申请日：2018-07-23

Applicant: X Development LLC

Inventor： Kurt Konolige ,  Nareshkumar Rajkumar ,  Stefan Hinterstoisser

IPC: G06K9/32 ,  G06T7/33 ,  G06K9/00 ,  B25J9/16 ,  G06T17/00

Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.

公开(公告)号：US20180039848A1

公开(公告)日：2018-02-08

申请号：US15227612

申请日：2016-08-03

Applicant: X Development LLC

Inventor： Kurt Konolige ,  Nareshkumar Rajkumar ,  Stefan Hinterstoisser

IPC: G06K9/32 ,  G06T17/00 ,  G06K9/00 ,  G06T7/00

CPC classification number: G06K9/3241 ,  B25J9/161 ,  B25J9/1692 ,  G05B2219/33038 ,  G05B2219/39046 ,  G05B2219/39543 ,  G05B2219/40564 ,  G06K9/00664 ,  G06T7/0046 ,  G06T7/344 ,  G06T17/00 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/20081 ,  G06T2207/20084 ,  G06T2207/30244

Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.