Method, System and Apparatus for Detecting Product Facings

    公开(公告)号:US20200380454A1

    公开(公告)日:2020-12-03

    申请号:US16429820

    申请日:2019-06-03

    Abstract: A method of detecting product facings from captured depth and image data includes: obtaining, at an imaging controller, (i) depth measurements representing a support structure supporting a plurality of product facings, (ii) image data representing the support structure, and (iii) a set of region of interest (ROI) indicators each indicating a position of a plurality of the product facings; generating a first set of candidate facing edges from the depth measurements; generating a second set of candidate facing edges from the image data; generating a third set of candidate facing edges by combining the first and second sets; generating, for each adjacent pair of the third set of candidate facing edges, a candidate facing boundary; selecting a subset of output facing boundaries from the candidate facing boundaries, based on the ROI indicators; and storing the output facing boundaries in a memory coupled to the imaging controller.

    Method, System and Apparatus for Gap Detection in Support Structures with Peg Regions

    公开(公告)号:US20200380317A1

    公开(公告)日:2020-12-03

    申请号:US16429687

    申请日:2019-06-03

    Abstract: A method of detecting gaps on a support structure includes: obtaining, at an imaging controller, (i) a plurality of depth measurements representing the support structure according to a common frame of reference, and (ii) a plurality of label indicators each defining a label position in the common frame of reference; for each of the label indicators: classifying the label indicator as either a peg label or a shelf label, based on a portion of the depth measurements selected according to the label position and a portion of the depth measurements adjacent to the label position; generating an item search space in the common frame of reference according to the class of the label indicator; and determining, based on a subset of the depth measurements within the item search space, whether the item search space contains an item.

    METHOD, SYSTEM AND APPARATUS FOR AUXILIARY LABEL DETECTION AND ASSOCIATION

    公开(公告)号:US20200184170A1

    公开(公告)日:2020-06-11

    申请号:US16214752

    申请日:2018-12-10

    Abstract: A method of auxiliary label detection includes: at an imaging controller, obtaining (i) an image of a support structure and (ii) a plurality of primary label indicators each defining a position of a primary label within the image; at the imaging controller, selecting a detection region from the image based on a reference indicator; at the imaging controller, detecting an auxiliary label within the detection region based on predefined visual attributes of the auxiliary label; at the imaging controller, selecting one of the primary label indicators based on proximity between the auxiliary label and the selected primary label indicator; updating the selected primary label indicator with an identifier of the auxiliary label; and storing the updated primary label indicator in a memory.

    Mixed Depth Object Detection
    5.
    发明申请

    公开(公告)号:US20220414926A1

    公开(公告)日:2022-12-29

    申请号:US17900392

    申请日:2022-08-31

    Abstract: A method includes obtaining a point cloud captured by a depth sensor, and image data captured by an image sensor, the point cloud and the image data representing a support structure bearing a set of objects; obtaining an image boundary corresponding to an object from the set of objects; determining a portion of the point cloud corresponding to the image boundary; selecting, from the determined portion, a subset of points corresponding to a forward surface of the object; and generating a three-dimensional position of the object based on the forward surface.

    Method, System and Apparatus for Detecting Support Structure Obstructions

    公开(公告)号:US20200380706A1

    公开(公告)日:2020-12-03

    申请号:US16429516

    申请日:2019-06-03

    Abstract: A method in an imaging controller of detecting obstructions on a front of a support structure includes: obtaining (i) a point cloud of the support structure and an obstruction, and (ii) a support structure plane corresponding to the front of the support structure; for each of a plurality of selection depths: selecting a subset of points from the point cloud based on the selection depth; detecting obstruction candidates from the subset of points and, for each obstruction candidate: responsive to a dimensional criterion being met, determining whether the obstruction candidate meets a confirmation criterion; when the obstruction candidate meets the confirmation criterion, identifying the obstruction candidate as a confirmed obstruction; and presenting obstruction detection output data including the confirmed obstructions.

    Method, system and apparatus for support structure depth determination

    公开(公告)号:US11506483B2

    公开(公告)日:2022-11-22

    申请号:US16152986

    申请日:2018-10-05

    Abstract: A method of determining a support structure depth of a support structure having a front and a back separated by the support structure depth includes: obtaining a point cloud of the support structure, and a mask indicating, for a plurality of portions of an image of the support structure captured from a capture pose, respective confidence levels that the portions depict the back of the support structure; selecting, from the point cloud, an initial set of points located within a field of view originating at the capture pose; selecting, from the initial set of points, an unoccluded subset of depth measurements, the depth measurements in the unoccluded subset corresponding to respective image coordinates; retrieving, from the mask, a confidence level for each of the depth measurements in the unoccluded subset; and based on the depth measurements in the unoccluded subset and the retrieved confidence levels, determining the support structure depth.

    Method, system and apparatus for detecting support structure obstructions

    公开(公告)号:US11341663B2

    公开(公告)日:2022-05-24

    申请号:US16429516

    申请日:2019-06-03

    Abstract: A method in an imaging controller of detecting obstructions on a front of a support structure includes: obtaining (i) a point cloud of the support structure and an obstruction, and (ii) a support structure plane corresponding to the front of the support structure; for each of a plurality of selection depths: selecting a subset of points from the point cloud based on the selection depth; detecting obstruction candidates from the subset of points and, for each obstruction candidate: responsive to a dimensional criterion being met, determining whether the obstruction candidate meets a confirmation criterion; when the obstruction candidate meets the confirmation criterion, identifying the obstruction candidate as a confirmed obstruction; and presenting obstruction detection output data including the confirmed obstructions.

    MIXED DEPTH OBJECT DETECTION
    10.
    发明申请

    公开(公告)号:US20220020170A1

    公开(公告)日:2022-01-20

    申请号:US16932174

    申请日:2020-07-17

    Abstract: A method includes obtaining a point cloud captured by a depth sensor, and image data captured by an image sensor, the point cloud and the image data representing a support structure bearing a set of objects; obtaining an image boundary corresponding to an object from the set of objects; determining a portion of the point cloud corresponding to the image boundary; selecting, from the determined portion, a subset of points corresponding to a forward surface of the object; and generating a three-dimensional position of the object based on the forward surface.

Patent Agency Ranking