-
公开(公告)号:US11691273B2
公开(公告)日:2023-07-04
申请号:US17520152
申请日:2021-11-05
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
CPC classification number: B25J9/161 , B25J9/1692 , G06T7/344 , G06T7/70 , G06T7/75 , G06T17/00 , G06V20/10 , G05B2219/33038 , G05B2219/39046 , G05B2219/39543 , G05B2219/40564 , G06T2207/10012 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
公开(公告)号:US09987746B2
公开(公告)日:2018-06-05
申请号:US15093118
申请日:2016-04-07
Applicant: X Development LLC
Inventor: Gary Bradski , Kurt Konolige , Ethan Rublee , Troy Straszheim , Hauke Strasdat , Stefan Hinterstoisser , Steve Croft , John Zevenbergen
IPC: G05B19/04 , G05B19/18 , B25J9/16 , G06T17/00 , B25J19/02 , B65G47/46 , B65G47/50 , G06K9/00 , G01B11/25 , G06K9/46 , G06K9/52 , G06T7/60 , H04N5/33 , H04N13/02 , B25J9/00 , B25J5/00 , B65G41/00 , G06T7/529 , G06T7/593 , G06T7/13 , B65G61/00 , B65H67/06 , H04N13/00
CPC classification number: B25J9/163 , B25J5/00 , B25J9/0093 , B25J9/1612 , B25J9/162 , B25J9/1664 , B25J9/1671 , B25J9/1687 , B25J9/1694 , B25J9/1697 , B25J19/00 , B25J19/021 , B65G41/008 , B65G47/46 , B65G47/50 , B65G61/00 , B65H67/065 , G01B11/254 , G05B2219/31312 , G05B2219/39391 , G05B2219/40053 , G05B2219/40298 , G05B2219/40442 , G05B2219/40543 , G06K9/00201 , G06K9/00664 , G06K9/3208 , G06K9/4604 , G06K9/4661 , G06K9/52 , G06K9/6202 , G06T7/0065 , G06T7/13 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/60 , G06T17/00 , G06T19/003 , G06T2200/04 , H04N5/33 , H04N13/239 , H04N2013/0081 , Y10S901/01 , Y10S901/02 , Y10S901/06 , Y10S901/09 , Y10S901/47
Abstract: Example embodiments may relate to methods and systems for selecting a grasp point on an object. In particular, a robotic manipulator may identify characteristics of a physical object within a physical environment. Based on the identified characteristics, the robotic manipulator may determine potential grasp points on the physical object corresponding to points at which a gripper attached to the robotic manipulator is operable to grip the physical object. Subsequently, the robotic manipulator may determine a motion path for the gripper to follow in order to move the physical object to a drop-off location for the physical object and then select a grasp point, from the potential grasp points, based on the determined motion path. After selecting the grasp point, the robotic manipulator may grip the physical object at the selected grasp point with the gripper and move the physical object through the determined motion path to the drop-off location.
-
公开(公告)号:US20180039835A1
公开(公告)日:2018-02-08
申请号:US15230412
申请日:2016-08-06
Applicant: X DEVELOPMENT LLC
Inventor: Nareshkumar Rajkumar , Stefan Hinterstoisser , Max Bajracharya
CPC classification number: G06K9/00664 , B25J9/1697 , G06K9/00979 , G06K9/00993 , G06K9/628 , G06T1/0014 , H04W4/025 , H04W4/60 , H04W4/80 , Y10S901/47
Abstract: Methods, apparatus, systems, and computer-readable media are provided for downloading targeted object recognition modules that are selected from a library of candidate targeted object recognition modules based on various signals. In some implementations, an object recognition client may be operated to facilitate object recognition for a robot. It may download targeted object recognition module(s). Each targeted object recognition module may facilitate inference of an object type or pose of an observed object. The targeted object module(s) may be selected from a library of targeted object recognition modules based on various signals, such as a task to be performed by the robot. The object recognition client may obtain vision data capturing at least a portion of an environment in which the robot operates. The object recognition client may determine, based on the vision data and the downloaded object recognition module(s), information about an observed object in the environment.
-
公开(公告)号:US09868212B1
公开(公告)日:2018-01-16
申请号:US15046870
申请日:2016-02-18
Applicant: X Development LLC
Inventor: Stefan Hinterstoisser
CPC classification number: B25J9/1671 , G05B2219/40564 , G06F17/50 , G06T1/0014
Abstract: Methods, apparatus, and computer readable media that are related to 3D object detection and pose determination and that may optionally increase the robustness and/or efficiency of the 3D object recognition and pose determination. Some implementations are generally directed to techniques for generating an object model of an object based on model point cloud data of the object. Some implementations of the present disclosure are additionally and/or alternatively directed to techniques for application of acquired 3D scene point cloud data to a stored object model of an object to detect the object and/or determine the pose of the object.
-
15.
公开(公告)号:US09659217B2
公开(公告)日:2017-05-23
申请号:US15219798
申请日:2016-07-26
Applicant: X Development LLC
Inventor: Stefan Hinterstoisser
IPC: G06K9/42 , G06K9/62 , G06K9/00 , B25J5/00 , B25J9/00 , B25J19/02 , B25J13/08 , G06K9/66 , G06K9/46
CPC classification number: G06K9/00664 , B25J5/007 , B25J9/0093 , B25J13/089 , B25J19/023 , G06K9/00201 , G06K9/00208 , G06K9/4671 , G06K9/6215 , G06K9/66 , G06K2009/4666 , G06K2209/29 , Y10S901/01 , Y10S901/09 , Y10S901/47
Abstract: An example method includes receiving a plurality of templates of a plurality of objects, where a template comprises feature values sampled at corresponding points of a two-dimensional grid of points positioned over a particular view of an object and scaled based on a depth of the object at the particular view. The method may further include receiving an image of an environment and determining a matrix representative of the image, where a row of the matrix comprises feature values sampled at a particular point of the two-dimensional grid positioned over one or more locations within the image and scaled based on depths of the one or more locations. The method may additionally include determining at least one similarity vector corresponding to at least one template and using the at least one similarity vector to identify at least one matching template for at least one object located within the image.
-
公开(公告)号:US20200151447A1
公开(公告)日:2020-05-14
申请号:US16742526
申请日:2020-01-14
Applicant: X Development LLC
Inventor: Nareshkumar Rajkumar , Stefan Hinterstoisser
Abstract: Methods, apparatus, systems, and computer-readable media are provided for delegating object type and/or pose detection to a plurality of “targeted object recognition modules.” In some implementations, a method may be provided that includes: operating an object recognition client to facilitate object recognition for a robot; receiving, by the object recognition client, sensor data indicative of an observed object in an environment; providing, by the object recognition client, to each of a plurality of remotely-hosted targeted object recognition modules, data indicative of the observed object; receiving, by the object recognition client, from one or more of the plurality of targeted object recognition modules, one or more inferences about an object type or pose of the observed object; and determining, by the object recognition client, information about the observed object, such as its object type and/or pose, based on the one or more inferences.
-
公开(公告)号:US10579874B2
公开(公告)日:2020-03-03
申请号:US16014311
申请日:2018-06-21
Applicant: X Development LLC
Inventor: Nareshkumar Rajkumar , Stefan Hinterstoisser
Abstract: Methods, apparatus, systems, and computer-readable media are provided for delegating object type and/or pose detection to a plurality of “targeted object recognition modules.” In some implementations, a method may be provided that includes: operating an object recognition client to facilitate object recognition for a robot; receiving, by the object recognition client, sensor data indicative of an observed object in an environment; providing, by the object recognition client, to each of a plurality of remotely-hosted targeted object recognition modules, data indicative of the observed object; receiving, by the object recognition client, from one or more of the plurality of targeted object recognition modules, one or more inferences about an object type or pose of the observed object; and determining, by the object recognition client, information about the observed object, such as its object type and/or pose, based on the one or more inferences.
-
公开(公告)号:US20190171881A1
公开(公告)日:2019-06-06
申请号:US16269183
申请日:2019-02-06
Applicant: X DEVELOPMENT LLC
Inventor: Nareshkumar Rajkumar , Stefan Hinterstoisser , Max Bajracharya
Abstract: Methods, apparatus, systems, and computer-readable media are provided for downloading targeted object recognition modules that are selected from a library of candidate targeted object recognition modules based on various signals. In some implementations, an object recognition client may be operated to facilitate object recognition for a robot. It may download targeted object recognition module(s). Each targeted object recognition module may facilitate inference of an object type or pose of an observed object. The targeted object module(s) may be selected from a library of targeted object recognition modules based on various signals, such as a task to be performed by the robot. The object recognition client may obtain vision data capturing at least a portion of an environment in which the robot operates. The object recognition client may determine, based on the vision data and the downloaded object recognition module(s), information about an observed object in the environment.
-
公开(公告)号:US10229317B2
公开(公告)日:2019-03-12
申请号:US15230412
申请日:2016-08-06
Applicant: X DEVELOPMENT LLC
Inventor: Nareshkumar Rajkumar , Stefan Hinterstoisser , Max Bajracharya
Abstract: Methods, apparatus, systems, and computer-readable media are provided for downloading targeted object recognition modules that are selected from a library of candidate targeted object recognition modules based on various signals. In some implementations, an object recognition client may be operated to facilitate object recognition for a robot. It may download targeted object recognition module(s). Each targeted object recognition module may facilitate inference of an object type or pose of an observed object. The targeted object module(s) may be selected from a library of targeted object recognition modules based on various signals, such as a task to be performed by the robot. The object recognition client may obtain vision data capturing at least a portion of an environment in which the robot operates. The object recognition client may determine, based on the vision data and the downloaded object recognition module(s), information about an observed object in the environment.
-
公开(公告)号:US10055667B2
公开(公告)日:2018-08-21
申请号:US15227612
申请日:2016-08-03
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
CPC classification number: G06K9/3241 , B25J9/161 , B25J9/1692 , G05B2219/33038 , G05B2219/39046 , G05B2219/39543 , G05B2219/40564 , G06K9/00664 , G06T7/344 , G06T7/70 , G06T7/75 , G06T17/00 , G06T2207/10012 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
-
-
-
-
-
-
-
-