-
公开(公告)号:US20180130218A1
公开(公告)日:2018-05-10
申请号:US15348569
申请日:2016-11-10
Applicant: THE BOEING COMPANY
Inventor: Heiko Hoffmann
CPC classification number: G01B11/002 , G01J3/46 , G06T7/0004 , G06T7/70 , G06T7/90 , H01R43/20 , H04N7/183
Abstract: A method, system and computer program product are provided for identifying wire contact insertion holes of a connector to facilitate the automated insertion of the wire ends of a wire bundle assembly into the wire contact insertion holes of a connector. In the context of a method, each of a plurality of pixels of an image of the connector is analyzed to identify one or more candidate contact insertion holes for the connector. The method also determines whether the one or more candidate contact insertion holes are to be consolidated and, if so, consolidates the one or more candidate contact insertion holes. The method further includes assigning contact identification numbers of the connector to the one or more candidate contact insertion holes.
-
公开(公告)号:US20240394538A1
公开(公告)日:2024-11-28
申请号:US18324878
申请日:2023-05-26
Applicant: The Boeing Company
Inventor: Qin Jiang , Eric Clough , Navid Naderializadeh , Heiko Hoffmann
Abstract: Examples for detection of defects in an additively manufactured object are provided. In one aspect, a method is provided. The method comprises receiving in-situ spectral data measured from the additively manufactured object during an additive manufacturing process, constructing a graph data structure using the in-situ spectral data, and outputting a predicted defect region using the graph data structure and a trained graph-learning neural network.
-
3.
公开(公告)号:US11670894B2
公开(公告)日:2023-06-06
申请号:US16906536
申请日:2020-06-19
Applicant: The Boeing Company
Inventor: Heiko Hoffmann
IPC: B25J19/02 , B25J9/16 , H01R13/641 , G06T7/70
CPC classification number: H01R13/641 , B25J9/1633 , B25J9/1687 , B25J9/1697 , B25J19/023 , G06T7/70
Abstract: A method, system and computer program product are provided for correction of automated insertion of a wire contact into a target hole of a connector. Methods include controlling a robot having an end-effector to: align the wire contact with the target hole of the connector; advance the wire contact toward and into the target hole of the connector; cease insertion in response to a force between the wire contact and the connector exceeding a predefined value; determining a depth of insertion; in response to the depth of insertion being above a predefined depth, perform a pull test on the inserted wire contact; in response to the depth of insertion being below a predetermined depth, identify an error condition using visual feedback; determine a number of corrective operations performed and perform error correction if the number is below a predefined number, while withdrawing the wire contact otherwise.
-
公开(公告)号:US11374374B2
公开(公告)日:2022-06-28
申请号:US16536598
申请日:2019-08-09
Applicant: The Boeing Company
Inventor: Alexander Graber-Tilton , Richard J. Patrick , Heiko Hoffmann
Abstract: A method, system and computer program product are provided for aligning and inserting a wire contact within a target hole of a connector to facilitate the automated insertion of the wire ends of a wire bundle assembly into the wire contact insertion holes of a connector. Methods may include: obtaining captured images, from at least two image capture devices attached to an end-effector of a robot, of a wire gripper of the end-effector; causing the robot to advance the end-effector to move the wire contact within a predetermined distance of the connector; causing the robot to advance the end-effector to move the wire contact toward the connector a predetermined additional amount more; and identifying, based on movement of the wire contact the predetermined additional amount more, if alignment is correct from force feedback at the wire gripper.
-
公开(公告)号:US11151405B1
公开(公告)日:2021-10-19
申请号:US16906622
申请日:2020-06-19
Applicant: The Boeing Company
Inventor: Heiko Hoffmann
Abstract: A method, system and computer program product are provided for determining locations of seal plugs of a connector based on image analysis. Methods include: capturing an image of a connector having a plurality of openings and at least one seal plug received within at least one opening of the connector; detecting an area of the connector within the acquired image; performing a thresholding operation on the area within the acquired image of the connector to obtain a mask image; performing image post-processing on the mask image to obtain an output image; applying at least one of a blob detection or a tip detection to the output image; identifying locations of seal plugs within the output image based on the at least one of the blob detection or the tip detection; and identifying locations within the connector available for automated wire contact insertion based on the locations of the seal plugs.
-
公开(公告)号:US10825259B2
公开(公告)日:2020-11-03
申请号:US16238002
申请日:2019-01-02
Applicant: THE BOEING COMPANY
Inventor: Kyungnam Kim , Heiko Hoffmann
Abstract: An apparatus to generate a model of a surface of an object includes a data set pre-aligner configured to receive multiple sets of surface data that correspond to respective portions of a surface of an object and that include three-dimensional (3D) points. The data set pre-aligner is also configured to perform a pre-alignment of overlapping sets to generate pre-aligned sets, including performing a rotation operation on a second set of the surface data, relative to a first set of the surface data that overlaps the second set, to apply a rotation amount that is selected from among multiple discrete rotation amounts and based on a similarity metric. The apparatus includes a data set aligner configured to perform an iterative alignment of the pre-aligned sets to generate aligned sets. The apparatus also includes a 3D model generator configured to combine the aligned sets to generate a 3D model of the object.
-
公开(公告)号:US10288410B2
公开(公告)日:2019-05-14
申请号:US15348569
申请日:2016-11-10
Applicant: THE BOEING COMPANY
Inventor: Heiko Hoffmann
Abstract: A method, system and computer program product are provided for identifying wire contact insertion holes of a connector to facilitate the automated insertion of the wire ends of a wire bundle assembly into the wire contact insertion holes of a connector. In the context of a method, each of a plurality of pixels of an image of the connector is analyzed to identify one or more candidate contact insertion holes for the connector. The method also determines whether the one or more candidate contact insertion holes are to be consolidated and, if so, consolidates the one or more candidate contact insertion holes. The method further includes assigning contact identification numbers of the connector to the one or more candidate contact insertion holes.
-
8.
公开(公告)号:US11171459B2
公开(公告)日:2021-11-09
申请号:US16536622
申请日:2019-08-09
Applicant: The Boeing Company
Inventor: Heiko Hoffmann
Abstract: A method, system and computer program product are provided for aligning wire contacts with wire contact insertion holes of a connector to facilitate the automated insertion of the wire ends of a wire bundle assembly into the wire contact insertion holes of a connector. Methods may include: obtaining captured images from at least two image capture devices attached to an end-effector of a robot of a wire gripper of the end-effector; detecting, within at least one image from each of the at least two image capture devices, a wire contact; detecting, within at least one image from each of the at least two image capture devices, one or more insertion holes of the connector; identifying corrective movement for the robot end-effector that aligns a target hole of the one or more insertion holes of the connector with the wire connector; and causing the robot to move the end-effector according to the identified corrective movement.
-
9.
公开(公告)号:US10574967B2
公开(公告)日:2020-02-25
申请号:US15467615
申请日:2017-03-23
Applicant: The Boeing Company
Inventor: Hyukseong Kwon , Kyungnam Kim , Heiko Hoffmann
IPC: H04N13/00 , H04N13/204 , G06T17/00 , H04N13/156 , H04N13/122 , G06T7/579 , H04N13/221
Abstract: A method for performing an operation on an object includes capturing a plurality of images of the object. Each image is a different view of the object. The method also includes generating a sparse 3D point cloud from the plurality of images. The sparse 3D point cloud defines a 3D model of the object. The sparse 3D point cloud includes a multiplicity of missing points that each correspond to a hole in the 3D model that renders the 3D model unusable for performing the operation on the object. The method additionally includes performing curvature-based upsampling to generate a denser 3D point cloud. The denser 3D point cloud includes a plurality of filled missing points. The missing points are filled from performance of the curvature-based upsampling. The denser 3D point cloud defines a dense 3D model that is useable for performing the operation on the object.
-
公开(公告)号:US12237636B2
公开(公告)日:2025-02-25
申请号:US17660327
申请日:2022-04-22
Applicant: THE BOEING COMPANY
Inventor: Michael Cui , Heiko Hoffmann , Bradley J. Mitchell
Abstract: A method, system and computer program product are provided for determining wire contact insertion based on image analysis. Methods include: acquiring at least one image of a connector having a plurality of wire contact insertion holes; identifying a wire contact within a wire contact insertion hole of the plurality of wire contact insertion holes; determining that the wire contact insertion hole is a correct wire contact insertion hole; determining that the wire contact has been fully inserted into the correct wire contact insertion hole; and providing feedback indicating that the wire contact is fully inserted into the correct wire contact insertion hole. The feedback includes in some cases a first indicator indicating that the wire contact is in the correct wire contact insertion hole and a second indicator indicating that the wire contact is fully inserted into the correct wire contact insertion hole.
-
-
-
-
-
-
-
-
-