-
公开(公告)号:US10455212B1
公开(公告)日:2019-10-22
申请号:US14583903
申请日:2014-12-29
Applicant: X Development LLC
Inventor: Kurt Konolige , Ethan Rublee
IPC: H04N13/00 , G06T7/00 , B25J9/00 , G01B11/25 , H04N13/122 , H04N13/167 , H04N13/282
Abstract: Example implementations relate to determining depth information using stereo sensor data. An example system may include at least one projector coupled to a robotic manipulator and configured to project a texture pattern onto an environment. The system may further include a displacer coupled to the at least one texture projector and configured to repeatedly change a position of the texture pattern within the environment. The system may also include at least two optical sensors configured to capture stereo sensor data for the environment. And the system may include a computing device configured to determine, using the stereo sensor data, an output including a virtual representation of the environment.
-
公开(公告)号:US20180107218A1
公开(公告)日:2018-04-19
申请号:US15841605
申请日:2017-12-14
Applicant: X Development LLC
Inventor: Kevin William Watts , Kurt Konolige
CPC classification number: G05D1/0088 , G01S17/88 , G05D1/0251 , G05D1/0276 , G05D2201/0216 , G06K9/00805
Abstract: An example method includes determining a target area of a ground plane in an environment of a mobile robotic device, where the target area of the ground plane is in front of the mobile robotic device in a direction of travel of the mobile robotic device. The method further includes receiving depth data from a depth sensor on the mobile robotic device. The method also includes identifying a portion of the depth data representative of the target area. The method additionally includes determining that the portion of the depth data lacks information representing at least one section of the target area. The method further includes providing an output signal identifying at least one zone of non-traversable space for the mobile robotic device in the environment, where the at least one zone of non-traversable space corresponds to the at least one section of the target area.
-
公开(公告)号:US09746852B1
公开(公告)日:2017-08-29
申请号:US14828437
申请日:2015-08-17
Applicant: X Development LLC
Inventor: Kevin William Watts , Kurt Konolige
CPC classification number: G01S17/936 , G01S17/023 , G01S17/87 , G05D1/0248 , G05D1/0251 , G05D2201/0216
Abstract: An example system includes one or more laser sensors on a robotic device, where the one or more laser sensors are configured to produce laser sensor data indicative of a first area within a first distance in front of the robotic device. The system further includes one or more stereo sensors on the robotic device, where the stereo sensors on the robotic device are configured to produce stereo sensor data indicative of a second area past a second distance in front of the robotic device. The system also includes a controller configured to receive the laser sensor data, receive the stereo sensor data, detect one or more objects in front of the robotic device based on at least one of the laser sensor data and the stereo sensor data, and provide instructions for the robotic device to navigate based on the one or more detected objects.
-
公开(公告)号:US09694498B2
公开(公告)日:2017-07-04
申请号:US14672369
申请日:2015-03-30
Applicant: X Development LLC
Inventor: Kurt Konolige
IPC: G06K9/28 , G06T15/00 , B25J9/16 , G05D1/02 , G06K9/00 , G06T1/00 , H04N13/02 , G01B11/02 , G01B11/25 , G06T7/593 , H04N13/00
CPC classification number: G01B11/2545 , B25J9/1697 , G01B11/026 , G05D1/0242 , G06K9/00201 , G06T1/0014 , G06T7/521 , G06T7/593 , G06T2207/10012 , G06T2207/10048 , G06T2207/30164 , H04N13/239 , H04N13/254 , H04N13/271 , H04N2013/0081 , Y10S901/09 , Y10S901/47
Abstract: Methods and systems for depth sensing are provided. A system includes a first and second optical sensor each including a first plurality of photodetectors configured to capture visible light interspersed with a second plurality of photodetectors configured to capture infrared light within a particular infrared band. The system also includes a computing device configured to (i) identify first corresponding features of the environment between a first visible light image captured by the first optical sensor and a second visible light image captured by the second optical sensor; (ii) identify second corresponding features of the environment between a first infrared light image captured by the first optical sensor and a second infrared light image captured by the second optical sensor; and (iii) determine a depth estimate for at least one surface in the environment based on the first corresponding features and the second corresponding features.
-
公开(公告)号:US09630316B2
公开(公告)日:2017-04-25
申请号:US15006264
申请日:2016-01-26
Applicant: X Development LLC
Inventor: Kurt Konolige , Ethan Rublee , Mrinal Kalakrishnan
CPC classification number: B25J9/1612 , B25J5/007 , B25J9/1633 , B25J9/1664 , B25J15/0616 , G05B2219/37345 , G05B2219/40006 , G05B2219/40512 , G05B2219/40513 , G05B2219/45056 , Y10S901/09 , Y10S901/27 , Y10S901/30 , Y10S901/46
Abstract: Example systems and methods may be used to determine a trajectory for moving an object using a robotic device. One example method includes determining a plurality of possible trajectories for moving an object with an end effector of a robotic manipulator based on a plurality of possible object measurements. The method may further include causing the robotic manipulator to pick up the object with the end effector. After causing the robotic manipulator to pick up the object with the end effector, the method may also include receiving sensor data from one or more sensors indicative of one or more measurements of the object. Based on the received sensor data, the method may additionally include selecting a trajectory for moving the object from the plurality of possible trajectories. The method may further include causing the robotic manipulator to move the object through the selected trajectory.
-
公开(公告)号:US09498887B1
公开(公告)日:2016-11-22
申请号:US14340398
申请日:2014-07-24
Applicant: X Development LLC
Inventor: John Zevenbergen , Ethan Rublee , Kurt Konolige , Troy Straszheim
CPC classification number: B25J15/0616 , B25J15/0052 , B65G47/918 , B65G59/04 , B65G2203/042
Abstract: An example two-faced linearly actuated suction gripper includes a first gripping surface having one or more first suction cups arranged to provide suction in a first direction. The suction gripper also includes a second gripping surface comprising one or more second suction cups arranged to provide suction in a second direction which is perpendicular to the first direction. The suction gripper further includes a linear actuator configured to provide movement of the second gripping surface parallel to the second direction towards a face of an object. The suction gripper includes a sensor configured to generate data indicating that the face of the object is adjacent to the second gripping surface; and an engageable brake that, when engaged, stops the movement of the linear actuator in response to the data from the sensor indicating that the second gripping surface is adjacent to the face of the object.
Abstract translation: 一个示例性的双面线性致动吸力夹持器包括具有一个或多个第一吸盘的第一夹紧表面,该第一吸盘布置成在第一方向上提供吸力。 抽吸夹持器还包括第二抓握表面,其包括一个或多个第二吸盘,其布置成在垂直于第一方向的第二方向上提供吸力。 抽吸夹持器还包括线性致动器,该线性致动器被配置为提供平行于第二方向的第二夹持表面朝向物体的表面的运动。 抽吸夹持器包括:传感器,被配置为产生指示物体的表面与第二夹持表面相邻的数据; 以及可接合的制动器,当接合时,响应于来自传感器的指示第二夹持表面与物体的表面相邻的数据,停止线性致动器的运动。
-
公开(公告)号:US20230090275A1
公开(公告)日:2023-03-23
申请号:US17820332
申请日:2022-08-17
Applicant: X Development LLC
Inventor: Kurt Konolige
Abstract: A method includes determining, based on a similarity measure, correlation scores between a target pixel and each of a candidate matching pixel, a left neighboring pixel of the candidate matching pixel, and a right neighboring pixel of the candidate matching pixel. When the correlation scores indicate that a neighboring pixel of the candidate matching pixel is better correlated to the target pixel than the candidate matching pixel, (i) a correlation score is determined between the target pixel and a second neighboring pixel of the neighboring pixel that is opposite the candidate matching pixel in the second image and (ii) an interpolation is fit to the correlation scores of the neighboring pixel, the second neighboring pixel, and the candidate matching pixel.
-
公开(公告)号:US11565401B1
公开(公告)日:2023-01-31
申请号:US17208683
申请日:2021-03-22
Applicant: X Development LLC
Inventor: Peter Pastor Sampedro , Mrinal Kalakrishnan , Ali Yahya Valdovinos , Adrian Li , Kurt Konolige , Vincent Dureau
Abstract: Methods and apparatus related to receiving a request that includes robot instructions and/or environmental parameters, operating each of a plurality of robots based on the robot instructions and/or in an environment configured based on the environmental parameters, and storing data generated by the robots during the operating. In some implementations, at least part of the stored data that is generated by the robots is provided in response to the request and/or additional data that is generated based on the stored data is provided in response to the request.
-
公开(公告)号:US11425353B1
公开(公告)日:2022-08-23
申请号:US15355285
申请日:2016-11-18
Applicant: X Development LLC
Inventor: Kurt Konolige
IPC: H04N13/128 , H04N13/111
Abstract: An example method includes receiving first and second images from a first and second imager. The method further includes determining first correlation scores between a target pixel from the first image and respective pixels from the second image based on a first similarity measure. The method also includes identifying a candidate matching pixel to the target pixel based on the first correlation scores. The method further includes determining second correlation scores between the target pixel and each of the candidate matching pixel, a left neighboring pixel, and a right neighboring pixel based on a second similarity measure. The method also includes determining whether the candidate matching pixel is better correlated to the target pixel than each of the neighboring pixels based on the second correlation scores. After determining that the candidate matching pixel is better correlated, the method further includes determining a disparity value by interpolating the second correlation scores.
-
公开(公告)号:US20220058419A1
公开(公告)日:2022-02-24
申请号:US17520152
申请日:2021-11-05
Applicant: X Development LLC
Inventor: Kurt Konolige , Nareshkumar Rajkumar , Stefan Hinterstoisser
Abstract: Methods and apparatus related to generating a model for an object encountered by a robot in its environment, where the object is one that the robot is unable to recognize utilizing existing models associated with the robot. The model is generated based on vision sensor data that captures the object from multiple vantages and that is captured by a vision sensor associated with the robot, such as a vision sensor coupled to the robot. The model may be provided for use by the robot in detecting the object and/or for use in estimating the pose of the object.
-
-
-
-
-
-
-
-
-