-
公开(公告)号:US10332272B2
公开(公告)日:2019-06-25
申请号:US15670108
申请日:2017-08-07
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Joseph Forcash , Tod Andrew Oblak , Jeffrey T. Stringer , Mark Hartman , Jeffrey J. Carter, Jr.
Abstract: A method for testing a perception system is disclosed. The method includes detecting, by a processor, one or more objects in a composite image, the composite image including a first image and at least a portion of a second image. A first set of objects are detected in the first image. Further, the method includes comparing, by the processor, a second set of objects of the one or more objects detected in the portion of the second image with a set of previously detected objects in the portion of the second image. Furthermore, the method includes validating, the performance of the processor in the detection of the first set of objects in the first image by ensuring the second set of objects detected in the at least a portion of a second image matches the set of previously detected objects in the portion of the second image.
-
公开(公告)号:US20180245316A1
公开(公告)日:2018-08-30
申请号:US15443479
申请日:2017-02-27
Applicant: Caterpillar Inc.
Inventor: Joseph Edward Forcash , Lawrence Andrew Mianzo , Paul Edmund Rybski
CPC classification number: E02F9/265 , E02F3/283 , E02F9/2041 , E02F9/2045
Abstract: A system for monitoring an implement of a work machine is provided. The system may include one or more image sensors mounted on the work machine configured to capture one or more images of a field of view associated with the implement, and an implement controller in electrical communication with the image sensors. The implement controller may be configured to receive the images from the image sensors, identify one or more interactive targets within the images, select one of the interactive targets based on proximity, and align the implement to the selected interactive target.
-
公开(公告)号:US11995157B2
公开(公告)日:2024-05-28
申请号:US17112932
申请日:2020-12-04
Applicant: CATERPILLAR INC.
Inventor: Tod Andrew Oblak , Shastri Ram , Jeff T. Stringer , Sri Sekharan , Lawrence Andrew Mianzo , Mark Edward Hartman
CPC classification number: G06F18/251 , G01S7/4817 , G01S7/497 , G01S13/89 , G01S17/89 , G06F18/214 , G06V10/22 , G06V20/56
Abstract: An intelligent three dimensional scanner system mountable on a movable machine, including three dimensional scanner, a camera, and control circuitry. The control circuitry is configured to receive three dimensional point data from the three dimensional scanner, receive two dimensional image data from the camera, input the two dimensional image data to a machine learning model, which identifies objects in the two dimensional image data, fuse the three dimensional point data with the identified objects in the two dimensional image data in order to identify the objects in the three dimensional point data, and control a scan pattern to direct scanning resolution of the three dimensional scanner based on the identified objects.
-
公开(公告)号:US20180165502A1
公开(公告)日:2018-06-14
申请号:US15376920
申请日:2016-12-13
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Bradley Scott Kriel
CPC classification number: G06K9/6202 , G06K9/00624 , G06T7/73 , G06T2207/10004 , G06T2207/30248
Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.
-
公开(公告)号:US11173785B2
公开(公告)日:2021-11-16
申请号:US15828571
申请日:2017-12-01
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Michael Hoffelder
Abstract: A vision system for assisting an operator of a machine is provided. An image capturing device, mounted on the machine, is configured to capture an image of an environment of the machine. The vision system includes a controller configured to apply an object detection process to detect an object in the image. The controller determines a bounding box comprising one or more pixels associated with the object. The controller determines a height and a range associated with the object based on the bounding box. The controller extracts the one or more pixels within the bounding box. The controller is further configured to generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device. The controller reinserts the one or more pixels as a vertical pop-up element with respect to a ground plane in the 3D view. A display is provided to display the 3D view to the operator of the machine.
-
公开(公告)号:US20190168609A1
公开(公告)日:2019-06-06
申请号:US15828571
申请日:2017-12-01
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Michael Hoffelder
Abstract: A vision system for assisting an operator of a machine is provided. An image capturing device, mounted on the machine, is configured to capture an image of an environment of the machine. The vision system includes a controller configured to apply an object detection process to detect an object in the image. The controller determines a bounding box comprising one or more pixels associated with the object. The controller determines a height and a range associated with the object based on the bounding box. The controller extracts the one or more pixels within the bounding box. The controller is further configured to generate a three-dimensional (3D) view comprising the object based on the image captured by the image capturing device. The controller reinserts the one or more pixels as a vertical pop-up element with respect to a ground plane in the 3D view. A display is provided to display the 3D view to the operator of the machine.
-
公开(公告)号:US20190043213A1
公开(公告)日:2019-02-07
申请号:US15670108
申请日:2017-08-07
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Joseph Forcash , Tod Andrew Oblak , Jeffrey T. Stringer , Mark Hartman , Jeffrey J. Carter, JR.
CPC classification number: G06T7/70 , G01V8/10 , G06K9/4604 , G06K9/6202 , G06K9/6269 , G06T7/246 , G06T7/251 , G06T11/60 , G06T2207/10016 , G06T2207/20081 , G06T2207/20084 , G06T2207/30196 , G06T2207/30261
Abstract: A method for testing a perception system is disclosed. The method includes detecting, by a processor, one or more objects in a composite image, the composite image including a first image and at least a portion of a second image. A first set of objects are detected in the first image. Further, the method includes comparing, by the processor, a second set of objects of the one or more objects detected in the portion of the second image with a set of previously detected objects in the portion of the second image. Furthermore, the method includes validating, the performance of the processor in the detection of the first set of objects in the first image by ensuring the second set of objects detected in the at least a portion of a second image matches the set of previously detected objects in the portion of the second image.
-
公开(公告)号:US10163033B2
公开(公告)日:2018-12-25
申请号:US15376920
申请日:2016-12-13
Applicant: Caterpillar Inc.
Inventor: Lawrence Andrew Mianzo , Bradley Scott Kriel
Abstract: A method of classifying a work machine within a worksite is provided. The method may include receiving one or more captured images of the work machine from one or more image capture devices, identifying at least two classifiers within the captured images of the work machine, determining spatial relationships between the classifiers within the captured images, determining a classification and a pose of the work machine based on the spatial relationships, and displaying analytics based on the classification and the pose of the work machine.
-
公开(公告)号:US10132060B2
公开(公告)日:2018-11-20
申请号:US15443479
申请日:2017-02-27
Applicant: Caterpillar Inc.
Inventor: Joseph Edward Forcash , Lawrence Andrew Mianzo , Paul Edmund Rybski
Abstract: A system for monitoring an implement of a work machine is provided. The system may include one or more image sensors mounted on the work machine configured to capture one or more images of a field of view associated with the implement, and an implement controller in electrical communication with the image sensors. The implement controller may be configured to receive the images from the image sensors, identify one or more interactive targets within the images, select one of the interactive targets based on proximity, and align the implement to the selected interactive target.
-
公开(公告)号:US20220180131A1
公开(公告)日:2022-06-09
申请号:US17112932
申请日:2020-12-04
Applicant: CATERPILLAR INC.
Inventor: Tod Andrew Oblak , Shastri Ram , Jeff T. Stringer , Sri Sekharan , Lawrence Andrew Mianzo , Mark Edward Hartman
Abstract: An intelligent three dimensional scanner system mountable on a movable machine, including three dimensional scanner, a camera, and control circuitry. The control circuitry is configured to receive three dimensional point data from the three dimensional scanner, receive two dimensional image data from the camera, input the two dimensional image data to a machine learning model, which identifies objects in the two dimensional image data, fuse the three dimensional point data with the identified objects in the two dimensional image data in order to identify the objects in the three dimensional point data, and control a scan pattern to direct scanning resolution of the three dimensional scanner based on the identified objects.
-
-
-
-
-
-
-
-
-