-
公开(公告)号:US10466043B2
公开(公告)日:2019-11-05
申请号:US15608002
申请日:2017-05-30
Applicant: X Development LLC
Inventor: Kurt Konolige
IPC: G06K9/28 , G06T15/00 , G01B11/25 , H04N13/254 , H04N13/271 , B25J9/16 , G05D1/02 , G06K9/00 , G06T1/00 , G01B11/02 , G06T7/593 , G06T7/521 , H04N13/239 , G01B11/24 , H04N13/00
Abstract: Methods and systems for depth sensing are provided. A system includes a first and second optical sensor each including a first plurality of photodetectors configured to capture visible light interspersed with a second plurality of photodetectors configured to capture infrared light within a particular infrared band. The system also includes a computing device configured to (i) identify first corresponding features of the environment between a first visible light image captured by the first optical sensor and a second visible light image captured by the second optical sensor; (ii) identify second corresponding features of the environment between a first infrared light image captured by the first optical sensor and a second infrared light image captured by the second optical sensor; and (iii) determine a depth estimate for at least one surface in the environment based on the first corresponding features and the second corresponding features.
-
公开(公告)号:US10055667B2
公开(公告)日:2018-08-21
申请号:US15227612
申请日:2016-08-03
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
CPC classification number: G06K9/3241 , B25J9/161 , B25J9/1692 , G05B2219/33038 , G05B2219/39046 , G05B2219/39543 , G05B2219/40564 , G06K9/00664 , G06T7/344 , G06T7/70 , G06T7/75 , G06T17/00 , G06T2207/10012 , G06T2207/10028 , G06T2207/20081 , G06T2207/20084 , G06T2207/30244
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
公开(公告)号:US20180093377A1
公开(公告)日:2018-04-05
申请号:US15827321
申请日:2017-11-30
Applicant: X Development LLC
Inventor: Gary Bradski , Kurt Konolige , Ethan Rublee
CPC classification number: B25J9/163 , B25J5/00 , B25J9/0093 , B25J9/1612 , B25J9/162 , B25J9/1664 , B25J9/1671 , B25J9/1687 , B25J9/1694 , B25J9/1697 , B25J19/00 , B25J19/021 , B65G41/008 , B65G47/46 , B65G47/50 , B65G61/00 , B65H67/065 , G01B11/254 , G05B2219/31312 , G05B2219/39391 , G05B2219/40053 , G05B2219/40298 , G05B2219/40442 , G05B2219/40543 , G06K9/00201 , G06K9/00664 , G06K9/3208 , G06K9/4604 , G06K9/4661 , G06K9/52 , G06K9/6202 , G06T7/13 , G06T7/529 , G06T7/55 , G06T7/593 , G06T7/60 , G06T17/00 , G06T19/003 , G06T2200/04 , H04N5/33 , H04N13/239 , H04N2013/0081 , Y10S901/01 , Y10S901/02 , Y10S901/06 , Y10S901/09 , Y10S901/47
Abstract: Example methods and systems for determining 3D scene geometry by projecting patterns of light onto a scene are provided. In an example method, a first projector may project a first random texture pattern having a first wavelength and a second projector may project a second random texture pattern having a second wavelength. A computing device may receive sensor data that is indicative of an environment as perceived from a first viewpoint of a first optical sensor and a second viewpoint of a second optical sensor. Based on the received sensor data, the computing device may determine corresponding features between sensor data associated with the first viewpoint and sensor data associated with the second viewpoint. And based on the determined corresponding features, the computing device may determine an output including a virtual representation of the environment that includes depth measurements indicative of distances to at least one object.
-
公开(公告)号:US11195041B2
公开(公告)日:2021-12-07
申请号:US16864591
申请日:2020-05-01
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
公开(公告)号:US20200265260A1
公开(公告)日:2020-08-20
申请号:US16864591
申请日:2020-05-01
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
公开(公告)号:US20200078938A1
公开(公告)日:2020-03-12
申请号:US16687106
申请日:2019-11-18
Applicant: X Development LLC
Inventor: Gary Bradski , Steve Croft , Kurt Konolige , Ethan Rublee , Troy Straszheim , John Zevenbergen , Stefan Hinterstoisser , Hauke Strasdat
IPC: B25J9/16 , G06T7/55 , G06K9/62 , G06K9/32 , G06K9/00 , B25J19/00 , G06T19/00 , B65G41/00 , B25J5/00 , B25J9/00 , H04N5/33 , G06T7/60 , G06K9/52 , G06K9/46 , G01B11/25 , B65G47/50 , B65G47/46 , B25J19/02 , H04N13/239 , G06T17/00 , G06T7/13 , G06T7/593 , G06T7/529
Abstract: Example embodiments may relate to methods and systems for selecting a grasp point on an object. In particular, a robotic manipulator may identify characteristics of a physical object within a physical environment. Based on the identified characteristics, the robotic manipulator may determine potential grasp points on the physical object corresponding to points at which a gripper attached to the robotic manipulator is operable to grip the physical object. Subsequently, the robotic manipulator may determine a motion path for the gripper to follow in order to move the physical object to a drop-off location for the physical object and then select a grasp point, from the potential grasp points, based on the determined motion path. After selecting the grasp point, the robotic manipulator may grip the physical object at the selected grasp point with the gripper and move the physical object through the determined motion path to the drop-off location.
-
公开(公告)号:US10518410B2
公开(公告)日:2019-12-31
申请号:US15968323
申请日:2018-05-01
Applicant: X Development LLC
Inventor: Gary Bradski , Steve Croft , Kurt Konolige , Ethan Rublee , Troy Straszheim , John Zevenbergen , Stefan Hinterstoisser , Hauke Strasdat
IPC: G05B19/18 , G05B19/04 , B25J9/16 , G06T7/529 , G06T7/593 , G06T7/13 , G06T17/00 , G06K9/00 , H04N13/239 , B25J19/02 , B65G47/46 , B65G47/50 , G01B11/25 , G06K9/46 , G06K9/52 , G06T7/60 , H04N5/33 , B25J9/00 , B25J5/00 , B65G41/00 , G06T19/00 , B25J19/00 , G06K9/32 , G06K9/62 , B65G61/00 , B65H67/06 , H04N13/00
Abstract: Example embodiments may relate to methods and systems for selecting a grasp point on an object. In particular, a robotic manipulator may identify characteristics of a physical object within a physical environment. Based on the identified characteristics, the robotic manipulator may determine potential grasp points on the physical object corresponding to points at which a gripper attached to the robotic manipulator is operable to grip the physical object. Subsequently, the robotic manipulator may determine a motion path for the gripper to follow in order to move the physical object to a drop-off location for the physical object and then select a grasp point, from the potential grasp points, based on the determined motion path. After selecting the grasp point, the robotic manipulator may grip the physical object at the selected grasp point with the gripper and move the physical object through the determined motion path to the drop-off location.
-
公开(公告)号:US10417781B1
公开(公告)日:2019-09-17
申请号:US15396105
申请日:2016-12-30
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser , Paul Wohlhart
Abstract: Methods for annotating objects within image frames are disclosed. Information is obtained that represents a camera pose relative to a scene. The camera pose includes a position and a location of the camera relative to the scene. Data is obtained that represents multiple images, including a first image and a plurality of other images, being captured from different angles by the camera relative to the scene. A 3D pose of the object of interest is identified with respect to the camera pose in at least the first image. A 3D bounding region for the object of interest in the first image is defined, which indicates a volume that includes the object of interest. A location and orientation of the object of interest is determined in the other images based on the defined 3D bounding region of the object of interest and the camera pose in the other images.
-
公开(公告)号:US20180243904A1
公开(公告)日:2018-08-30
申请号:US15968323
申请日:2018-05-01
Applicant: X Development LLC
Inventor: Gary Bradski , Steve Croft , Kurt Konolige , Ethan Rublee , Troy Straszheim , John Zevenbergen , Stefan Hinterstoisser , Hauke Strasdat
Abstract: Example embodiments may relate to methods and systems for selecting a grasp point on an object. In particular, a robotic manipulator may identify characteristics of a physical object within a physical environment. Based on the identified characteristics, the robotic manipulator may determine potential grasp points on the physical object corresponding to points at which a gripper attached to the robotic manipulator is operable to grip the physical object. Subsequently, the robotic manipulator may determine a motion path for the gripper to follow in order to move the physical object to a drop-off location for the physical object and then select a grasp point, from the potential grasp points, based on the determined motion path. After selecting the grasp point, the robotic manipulator may grip the physical object at the selected grasp point with the gripper and move the physical object through the determined motion path to the drop-off location.
-
公开(公告)号:US20170261314A1
公开(公告)日:2017-09-14
申请号:US15608002
申请日:2017-05-30
Applicant: X Development LLC
Inventor: Kurt Konolige
Abstract: Methods and systems for depth sensing are provided. A system includes a first and second optical sensor each including a first plurality of photodetectors configured to capture visible light interspersed with a second plurality of photodetectors configured to capture infrared light within a particular infrared band. The system also includes a computing device configured to (i) identify first corresponding features of the environment between a first visible light image captured by the first optical sensor and a second visible light image captured by the second optical sensor; (ii) identify second corresponding features of the environment between a first infrared light image captured by the first optical sensor and a second infrared light image captured by the second optical sensor; and (iii) determine a depth estimate for at least one surface in the environment based on the first corresponding features and the second corresponding features.
-
-
-
-
-
-
-
-
-