-
公开(公告)号:US11321914B1
公开(公告)日:2022-05-03
申请号:US15867449
申请日:2018-01-10
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: David Allen Fotland , Roger Robert Webster , Arif Dikici
Abstract: A point cloud or map of an environment is generated by determining sets of landmark points from multiple images, such as through use of a Simultaneous Localization and Mapping (SLAM) algorithm. Images acquired using a depth camera are used to determine depth points indicative of at least one object not represented by the landmark points. A combined map is generated to include both the landmark points and the depth points. The set of depth points is mapped to a corresponding set of landmark points based on proximity of the points, similarity of the camera poses, or times that the images were acquired. The relationship between the depth and landmark points may be determined. When the landmark points are moved, such as to account for error in the SLAM algorithm, the depth points may be moved to a modified location relative to the landmark points so that the relationship remains constant.
-
公开(公告)号:US11409279B1
公开(公告)日:2022-08-09
申请号:US16584066
申请日:2019-09-26
Applicant: Amazon Technologies, Inc.
Inventor: Amy Solenberg , Anil Kumar Katta , Swati S Rao , Swetha Bijoy , Anthony George Robson , David Allen Fotland , Robert Franklin Ebert , Roger Robert Webster , Adam Fineberg
IPC: G05D1/00 , G06F3/0488 , H04N7/18
Abstract: Movement of an autonomously motile device may be controlled by a user device. The user device may display image data captured by a camera of the autonomously motile device; a user may provide input, such as a touch gesture on a display screen, indicating a command for the autonomously motile device to move to a location indicated by the input. The autonomously motile device determines a coordinate of the input and a time of the touch input; the autonomously motile device then determines a direction and distance of a corresponding movement.
-
公开(公告)号:US10200572B1
公开(公告)日:2019-02-05
申请号:US15060491
申请日:2016-03-03
Applicant: Amazon Technologies, Inc.
Inventor: David Allen Fotland , Alexander Michael Fotland
IPC: H04N19/137 , H04N5/14
Abstract: Various examples are directed to systems and methods for detection motion in video data. An image processor may receive video data. A first frame and a second frame may describe a plurality of pixel locations. The second frame may be positioned after the first frame in the frame sequence. The image processor may determine that a first subset of pixel locations from the plurality of pixel locations differ by less than a threshold amount between frames for at least a threshold number of frames in the frame sequence prior to the first frame. The image processor may identify from the first subset of pixel locations, a second subset of pixel locations that differ by more than the threshold amount between the first frame and the second frame and determine that a number of pixel locations in the second subset of pixel locations is greater than a motion pixel threshold.
-
公开(公告)号:US20150055821A1
公开(公告)日:2015-02-26
申请号:US13973913
申请日:2013-08-22
Applicant: Amazon Technologies, Inc.
Inventor: David Allen Fotland
CPC classification number: G06K9/3241 , G06K9/00228 , G06K9/00369 , G06K2009/3291 , G06T7/246 , G06T2207/10016 , G06T2207/30201
Abstract: Systems and approaches are provided for tracking an object using multiple tracking processes. By combining multiple lightweight tracking processes, object tracking can be robust, use a limited amount of power, and enable a computing device to respond to input corresponding to the motion of the object in real time. The multiple tracking processes can be run in parallel to determine the position of the object by selecting the results of the best performing tracker under certain heuristics or combining the results of multiple tracking processes in various ways. Further, other sensor data of a computing device can be used to improve the results provided by one or more of the tracking processes.
Abstract translation: 提供了使用多个跟踪过程跟踪对象的系统和方法。 通过组合多个轻量级跟踪过程,对象跟踪可以是鲁棒的,使用有限的功率,并且使得计算设备能够实时响应对象的运动的输入。 可以并行运行多个跟踪过程,以通过在某些启发式下选择最佳性能的跟踪器的结果或以多种方式组合多个跟踪过程的结果来确定对象的位置。 此外,可以使用计算设备的其他传感器数据来改善由一个或多个跟踪处理提供的结果。
-
公开(公告)号:US11983006B2
公开(公告)日:2024-05-14
申请号:US17875622
申请日:2022-07-28
Applicant: Amazon Technologies, Inc.
Inventor: Amy Solenberg , Anil Kumar Katta , Swati S. Rao , Swetha Bijoy , Anthony George Robson , David Allen Fotland , Robert Franklin Ebert , Roger Robert Webster , Adam Fineberg
IPC: G05D1/00 , G06F3/0488 , H04N7/18
CPC classification number: G05D1/0038 , G05D1/0088 , G06F3/0488 , H04N7/185
Abstract: Movement of an autonomously motile device may be controlled by a user device. The user device may display image data captured by a camera of the autonomously motile device; a user may provide input, such as a touch gesture on a display screen, indicating a command for the autonomously motile device to move to a location indicated by the input. The autonomously motile device determines a coordinate of the input and a time of the touch input; the autonomously motile device then determines a direction and distance of a corresponding movement.
-
公开(公告)号:US11520332B1
公开(公告)日:2022-12-06
申请号:US16702008
申请日:2019-12-03
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: James Charles Zamiska , David Allen Fotland , Roger Robert Webster , Mohit Deshpande , Robert Franklin Ebert , Nikhil Sharma , Rachel Liao , Chang Young Kim
IPC: G05D1/00 , G01S17/931 , G05D1/02
Abstract: An autonomous mobile device (AMD) uses sensors to explore a physical space and determine the locations of obstacles. Simultaneous localization and mapping (SLAM) techniques are used by the AMD to designate as keyframes some images and their associated descriptors of features in the space. Each keyframe indicates a location and orientation of the AMD relative to those features. Anchors are specified relative to keyframes. A marker is specified relative to one or more anchors. Because markers are associated with features in the physical space, they maintain their association with the physical space through various processes such as SLAM loop closures. Markers may specify locations in the physical space, such as navigation waypoints, navigation destinations such as a goal pose for exploring an unexplored area, as an observation target to facilitate exploration, and so forth. Markers may also be used to specify block listed locations to be avoided during exploration.
-
公开(公告)号:US20230120303A1
公开(公告)日:2023-04-20
申请号:US17875622
申请日:2022-07-28
Applicant: Amazon Technologies, Inc.
Inventor: Amy Solenberg , Anil Kumar Katta , Swati S. Rao , Swetha Bijoy , Anthony George Robson , David Allen Fotland , Robert Franklin Ebert , Roger Robert Webster , Adam Fineberg
IPC: G05D1/00 , G06F3/0488 , H04N7/18
Abstract: Movement of an autonomously motile device may be controlled by a user device. The user device may display image data captured by a camera of the autonomously motile device; a user may provide input, such as a touch gesture on a display screen, indicating a command for the autonomously motile device to move to a location indicated by the input. The autonomously motile device determines a coordinate of the input and a time of the touch input; the autonomously motile device then determines a direction and distance of a corresponding movement.
-
公开(公告)号:US11442463B1
公开(公告)日:2022-09-13
申请号:US16579059
申请日:2019-09-23
Applicant: AMAZON TECHNOLOGIES, INC.
Inventor: David Allen Fotland , Ishan Ankur Patil , Yan Lu , Joydeep Biswas
Abstract: An autonomous mobile device moves through a physical space using simultaneous localization and mapping (SLAM) techniques. SLAM processes images from cameras to determine localization and trajectory of the device based on features that are assumed to be stationary. SLAM performance is improved by removing moving features from consideration. A first position of a feature at a first time and data from an inertial sensor are used to determine a predicted position at a second time. The predicted position is compared to a second position of the feature at the second time. This comparison takes into consideration an assumed Gaussian error distribution of how the positions are determined. If the predicted position differs from the second position by less than a threshold value, the feature may be determined to be stationary. The stationary features are then processed using SLAM to determine the localization and trajectory information.
-
公开(公告)号:US10007860B1
公开(公告)日:2018-06-26
申请号:US14976696
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: David Allen Fotland , Ambrish Tyagi
CPC classification number: G06K9/3233 , G06K9/00369 , G06T7/11 , G06T7/187 , G06T7/194 , G06T2207/20132
Abstract: The techniques described herein may identify images that likely depict one or more items by comparing features of the items to features of different regions-of-interest (ROIs) of the images. For instance, some of the images may include a user, and the techniques may define multiple regions within the image corresponding to different portions of the user. The techniques may then use a trained convolutional neural network or any other type of trained classifier to determine, for each region of the image, whether the region depicts a particular item. If so, the techniques may designate the corresponding image as depicting the item and may output an indication that the image depicts the item. The techniques may perform this process for multiple images, outputting an indication of each image deemed to depict the particular item.
-
公开(公告)号:US09953242B1
公开(公告)日:2018-04-24
申请号:US14976850
申请日:2015-12-21
Applicant: Amazon Technologies, Inc.
Inventor: Ambrish Tyagi , David Allen Fotland
CPC classification number: G06K9/6212 , G06K9/38 , G06K9/4652 , G06K9/52 , G06K2009/4666 , G06K2009/6213 , G06T7/0059 , G06T7/0081 , G06T2207/10024 , G06T2207/20132 , G06T2207/30196
Abstract: The techniques described herein may identify images that likely depict one or more items by comparing features of the items to features of different regions-of-interest (ROIs) of the images. When a user requests to identify images that depict a particular item, the techniques may determine a region-of-interest (ROI) size based on the size of the requested item. The techniques may then search multiple images using the ROI size.
-
-
-
-
-
-
-
-
-