公开(公告)号：US20230244233A1

公开(公告)日：2023-08-03

申请号：US18120643

申请日：2023-03-13

申请人： SKYDIO, INC.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Bachrach ,  Adam Bry ,  Ryan David Kennedy ,  Himel Mondal ,  Quentin Allen Wah Yen Delepine

IPC分类号： G05D1/00 ,  G05B17/02 ,  B64C39/02 ,  B64D47/08 ,  B64D31/06 ,  G05D1/10 ,  G06T17/00 ,  G06T7/55 ,  G06T7/73 ,  G05B13/02 ,  G06T19/20 ,  H04N23/60 ,  H04N23/90 ,  H04N23/695 ,  G06V20/13 ,  G06V20/64

CPC分类号： G05D1/0094 ,  B64C39/024 ,  B64D31/06 ,  B64D47/08 ,  G05B13/0265 ,  G05B17/02 ,  G05D1/0088 ,  G05D1/101 ,  G06T7/55 ,  G06T7/74 ,  G06T17/00 ,  G06T19/20 ,  G06V20/13 ,  G06V20/64 ,  H04N23/64 ,  H04N23/90 ,  H04N23/695 ,  B64U10/13 ,  G06T2207/10032 ,  G06T2207/20221 ,  G06T2219/2004

摘要： In some examples, an unmanned aerial vehicle (UAV) may identify a scan target. The UAV may navigate to two or more positions in relation to the scan target. The UAV may capture, using one or more image sensors of the UAV, two or more images of the scan target from different respective positions in relation to the scan target. For instance, the two or more respective positions may be selected by controlling a spacing between the two or more respective positions to enable determination of parallax disparity between a first image captured at a first position and a second image captured at a second position of the two or more positions. The UAV may determine a three-dimensional model corresponding to the scan target based in part on the determined parallax disparity of the two or more images including the first image and the second image.

公开(公告)号：US11829141B2

公开(公告)日：2023-11-28

申请号：US18120643

申请日：2023-03-13

申请人： SKYDIO, INC.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Bachrach ,  Adam Bry ,  Ryan David Kennedy ,  Himel Mondal ,  Quentin Allen Wah Yen Delepine

IPC分类号： G06V20/13 ,  G05D1/00 ,  G05B17/02 ,  B64C39/02 ,  B64D47/08 ,  B64D31/06 ,  G05D1/10 ,  G06T17/00 ,  G06T7/55 ,  G06T7/73 ,  G05B13/02 ,  G06T19/20 ,  H04N23/60 ,  H04N23/90 ,  H04N23/695 ,  G06V20/64 ,  B64U10/13 ,  B64U101/30

CPC分类号： G05D1/0094 ,  B64C39/024 ,  B64D31/06 ,  B64D47/08 ,  G05B13/0265 ,  G05B17/02 ,  G05D1/0088 ,  G05D1/101 ,  G06T7/55 ,  G06T7/74 ,  G06T17/00 ,  G06T19/20 ,  G06V20/13 ,  G06V20/64 ,  H04N23/64 ,  H04N23/695 ,  H04N23/90 ,  B64U10/13 ,  B64U2101/30 ,  G06T2207/10032 ,  G06T2207/20221 ,  G06T2219/2004

摘要： In some examples, an unmanned aerial vehicle (UAV) may identify a scan target. The UAV may navigate to two or more positions in relation to the scan target. The UAV may capture, using one or more image sensors of the UAV, two or more images of the scan target from different respective positions in relation to the scan target. For instance, the two or more respective positions may be selected by controlling a spacing between the two or more respective positions to enable determination of parallax disparity between a first image captured at a first position and a second image captured at a second position of the two or more positions. The UAV may determine a three-dimensional model corresponding to the scan target based in part on the determined parallax disparity of the two or more images including the first image and the second image.

公开(公告)号：US20230021969A1

公开(公告)日：2023-01-26

申请号：US17890884

申请日：2022-08-18

申请人： Skydio, Inc.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Galton Bachrach ,  Adam Bry

IPC分类号： G08G5/00 ,  G06F3/04845 ,  G06F3/04817 ,  G06T17/05 ,  G06T19/00 ,  G06F3/04847 ,  B64C39/02 ,  B64D47/08 ,  G05D1/10 ,  G05D1/00 ,  G08G5/04 ,  G01S13/89 ,  G01S17/89 ,  H04N5/272 ,  G06T17/10 ,  G06V20/13 ,  G06V20/10

摘要： Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

公开(公告)号：US20190004543A1

公开(公告)日：2019-01-03

申请号：US15641021

申请日：2017-07-03

申请人： Skydio, Inc.

发明人： Ryan Kennedy ,  Peter Henry ,  Abraham Bachrach

IPC分类号： G05D1/10 ,  H04N5/247 ,  G06K9/00 ,  H04N5/232 ,  G06T7/11 ,  H04N17/00 ,  G06T5/00 ,  B64C39/02 ,  B64D47/08

CPC分类号： G05D1/101 ,  B64C39/024 ,  B64C2201/141 ,  B64D47/08 ,  G06K9/0063 ,  G06T5/002 ,  G06T7/0002 ,  G06T7/11 ,  G06T2207/10012 ,  G06T2207/10032 ,  G06T2207/30168 ,  H04N5/2171 ,  H04N5/2258 ,  H04N5/23296 ,  H04N5/2351 ,  H04N5/247 ,  H04N13/00 ,  H04N13/239 ,  H04N17/002

摘要： Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).

公开(公告)号：US20240278912A1

公开(公告)日：2024-08-22

申请号：US18435299

申请日：2024-02-07

申请人： Skydio, Inc.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Galton Bachrach ,  Adam Bry

IPC分类号： B64C39/02 ,  B64D47/08 ,  B64U10/13 ,  B64U101/30 ,  G01S13/89 ,  G01S17/89 ,  G05D1/223 ,  G05D1/224 ,  G05D1/606 ,  G06F3/04817 ,  G06F3/04845 ,  G06F3/04847 ,  G06T17/05 ,  G06T17/10 ,  G06T19/00 ,  G06V20/10 ,  G06V20/13 ,  G06V20/17 ,  G06V20/64 ,  G08G5/00 ,  G08G5/04 ,  H04N5/272 ,  H04N13/204

CPC分类号： B64C39/024 ,  B64D47/08 ,  G01S13/89 ,  G01S17/89 ,  G05D1/223 ,  G05D1/224 ,  G05D1/606 ,  G06F3/04817 ,  G06F3/04845 ,  G06F3/04847 ,  G06T17/05 ,  G06T17/10 ,  G06T19/006 ,  G06V20/13 ,  G06V20/17 ,  G06V20/176 ,  G06V20/647 ,  G08G5/003 ,  G08G5/04 ,  H04N5/272 ,  B64U10/13 ,  B64U2101/30 ,  B64U2201/00 ,  B64U2201/20 ,  H04N13/204

摘要： Described herein are systems for roof scan using an unmanned aerial vehicle. For example, some methods include capturing, using an unmanned aerial vehicle, an overview image of a roof of a building from above the roof; presenting a suggested bounding polygon overlaid on the overview image to a user; determining a bounding polygon based on the suggested bounding polygon and user edits; based on the bounding polygon, determining a flight path including a sequence of poses of the unmanned aerial vehicle with respective fields of view at a fixed height that collectively cover the bounding polygon; fly the unmanned aerial vehicle to a sequence of scan poses with horizontal positions matching respective poses of the flight path and vertical positions determined to maintain a consistent distance above the roof; and scanning the roof from the sequence of scan poses to generate a three-dimensional map of the roof.

公开(公告)号：US12025983B2

公开(公告)日：2024-07-02

申请号：US18222786

申请日：2023-07-17

申请人： SKYDIO, INC.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Bachrach ,  Adam Bry ,  Ryan David Kennedy ,  Himel Mondal ,  Quentin Allen Wah Yen Delepine

IPC分类号： G06T17/00 ,  B64C39/02 ,  B64D31/06 ,  B64D47/08 ,  G05B13/02 ,  G05B17/02 ,  G05D1/00 ,  G06T7/55 ,  G06T7/73 ,  G06T19/20 ,  G06V20/13 ,  G06V20/64 ,  H04N23/60 ,  H04N23/695 ,  H04N23/90 ,  B64U10/13 ,  B64U101/30

CPC分类号： G05D1/0094 ,  B64C39/024 ,  B64D31/06 ,  B64D47/08 ,  G05B13/0265 ,  G05B17/02 ,  G05D1/0088 ,  G05D1/101 ,  G06T7/55 ,  G06T7/74 ,  G06T17/00 ,  G06T19/20 ,  G06V20/13 ,  G06V20/64 ,  H04N23/64 ,  H04N23/695 ,  H04N23/90 ,  B64U10/13 ,  B64U2101/30 ,  G06T2207/10032 ,  G06T2207/20221 ,  G06T2219/2004

摘要： In some examples, an image of a scan target is presented in a user interface on a display associated with a computing device. The user interface receives at least one user input indicating at least one point in a perimeter or edge of a volume for encompassing the scan target presented in the image of the scan target. A graphical representation of the volume in relation to the image of the scan target is generated in the user interface. Information for defining a location of at least a portion of the volume in three-dimensional space is sent to an unmanned aerial vehicle (UAV) to cause, at least in part, the UAV to scan at least a portion of the scan target corresponding to the volume.

公开(公告)号：US11455894B2

公开(公告)日：2022-09-27

申请号：US16896066

申请日：2020-06-08

申请人： Skydio, Inc.

发明人： Peter Henry ,  Jack Zhu ,  Brian Richman ,  Harrison Zheng ,  Hayk Martirosyan ,  Matthew Donahoe ,  Abraham Galton Bachrach ,  Adam Bry

IPC分类号： G08G5/00 ,  G06F3/04845 ,  G06F3/04817 ,  G06T17/05 ,  G06T19/00 ,  G06F3/04847 ,  B64C39/02 ,  B64D47/08 ,  G05D1/10 ,  G05D1/00 ,  G08G5/04 ,  G01S13/89 ,  G01S17/89 ,  H04N5/272 ,  G06T17/10 ,  G06V20/13 ,  G06V20/10 ,  H04N13/204

摘要： Described herein are systems and methods for structure scan using an unmanned aerial vehicle. For example, some methods include accessing a three-dimensional map of a structure; generating facets based on the three-dimensional map, wherein the facets are respectively a polygon on a plane in three-dimensional space that is fit to a subset of the points in the three-dimensional map; generating a scan plan based on the facets, wherein the scan plan includes a sequence of poses for an unmanned aerial vehicle to assume to enable capture, using image sensors of the unmanned aerial vehicle, of images of the structure; causing the unmanned aerial vehicle to fly to assume a pose corresponding to one of the sequence of poses of the scan plan; and capturing one or more images of the structure from the pose.

公开(公告)号：US20190332127A1

公开(公告)日：2019-10-31

申请号：US16452978

申请日：2019-06-26

申请人： Skydio, Inc.

发明人： Ryan Kennedy ,  Peter Henry ,  Abraham Bachrach

IPC分类号： G05D1/10 ,  H04N17/00 ,  B64C39/02 ,  H04N5/217 ,  H04N5/225 ,  H04N5/235 ,  H04N13/00 ,  G06T5/00 ,  G06T7/11 ,  H04N5/232 ,  G06K9/00 ,  B64D47/08 ,  G06T7/00

摘要： Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).

公开(公告)号：US10379545B2

公开(公告)日：2019-08-13

申请号：US15641021

申请日：2017-07-03

申请人： Skydio, Inc.

发明人： Ryan Kennedy ,  Peter Henry ,  Abraham Bachrach

IPC分类号： B64C39/02 ,  B64D47/08 ,  G05D1/10 ,  G06K9/00 ,  G06T5/00 ,  G06T7/11 ,  H04N17/00 ,  H04N5/232 ,  H04N5/247

摘要： Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).

公开(公告)号：US20240101254A1

公开(公告)日：2024-03-28

申请号：US18363832

申请日：2023-08-02

申请人： Skydio, Inc.

发明人： Ryan Kennedy ,  Peter Henry ,  Abraham Bachrach

IPC分类号： B64C39/02 ,  B64D47/08 ,  G05D1/10 ,  G06T5/00 ,  G06T7/00 ,  G06T7/11 ,  H04N13/00 ,  H04N13/239 ,  H04N17/00 ,  H04N23/45 ,  H04N23/69 ,  H04N23/71 ,  H04N23/81 ,  H04N23/90

CPC分类号： B64C39/024 ,  B64D47/08 ,  G05D1/102 ,  G06T5/002 ,  G06T7/0002 ,  G06T7/11 ,  H04N13/00 ,  H04N13/239 ,  H04N17/002 ,  H04N23/45 ,  H04N23/69 ,  H04N23/71 ,  H04N23/811 ,  H04N23/90 ,  B64U2201/10 ,  G06T2207/10012 ,  G06T2207/10032 ,  G06T2207/30168

摘要： Embodiments are described for detecting optical discrepancies associated with image capture analyzing pixels in multiple images corresponding to common points of reference in a physical environment. In an embodiment, photometric error values are averaged over time to compute the mean error at each pixel. Once the estimate of the mean error has a sufficient number of updates above a specified value, the estimate is thresholded to provide a mask of any optical discrepancies occurring in the stereo pair of images. Applications include detecting optical discrepancies in images captured for use by a visual navigation system in guiding an autonomous vehicle (e.g., an unmanned aerial vehicle).