Three-dimensional annotations for street view data

    公开(公告)号:US10540794B2

    公开(公告)日:2020-01-21

    申请号:US15290606

    申请日:2016-10-11

    Applicant: Google Inc.

    Abstract: The present invention relates to annotating images. In an embodiment, the present invention enables users to create annotations corresponding to three-dimensional objects while viewing two-dimensional images. In one embodiment, this is achieved by projecting a selecting object onto a three-dimensional model created from a plurality of two-dimensional images. The selecting object is input by a user while viewing a first image corresponding to a portion of the three-dimensional model. A location corresponding to the projection on the three-dimensional model is determined, and content entered by the user while viewing the first image is associated with the location. The content is stored together with the location information to form an annotation. The annotation can be retrieved and displayed together with other images corresponding to the location.

    USING IMAGE CONTENT TO FACILITATE NAVIGATION IN STREET VIEW DATA

    公开(公告)号:US20170186229A1

    公开(公告)日:2017-06-29

    申请号:US15460727

    申请日:2017-03-16

    Applicant: Google Inc.

    Abstract: The technology uses image content to facilitate navigation in panoramic image data. Aspects include providing a first image including a plurality of avatars, in which each avatar corresponds to an object within the first image, and determining an orientation of at least one of the plurality of avatars to a point of interest within the first image. A viewport is determined for a first avatar in accordance with the orientation thereof relative to the point of interest, which is included within the first avatar's viewport. In response to received user input, a second image is selected that includes at least a second avatar and the point of interest from the first image. A viewport of the second avatar in the second image is determined and the second image is oriented to align the second avatar's viewpoint with the point of interest to provide navigation between the first and second images.

    Detecting road weather conditions

    公开(公告)号:US09499172B2

    公开(公告)日:2016-11-22

    申请号:US13623422

    申请日:2012-09-20

    Applicant: Google Inc.

    CPC classification number: B60W40/06 B60W2420/62

    Abstract: Aspects of the disclosure relate generally to detecting road weather conditions. Vehicle sensors including a laser, precipitation sensors, and/or camera may be used to detect information such as the brightness of the road, variations in the brightness of the road, brightness of the world, current precipitation, as well as the detected height of the road. Information received from other sources such as networked based weather information (forecasts, radar, precipitation reports, etc.) may also be considered. The combination of the received and detected information may be used to estimate the probability of precipitation such as water, snow or ice in the roadway. This information may then be used to maneuver an autonomous vehicle (for steering, accelerating, or braking) or identify dangerous situations.

    Methods and systems for pedestrian avoidance using LIDAR
    6.
    发明授权
    Methods and systems for pedestrian avoidance using LIDAR 有权
    使用LIDAR行人避免的方法和系统

    公开(公告)号:US09315192B1

    公开(公告)日:2016-04-19

    申请号:US14041121

    申请日:2013-09-30

    Applicant: Google Inc.

    Abstract: An autonomous vehicle configured to detect and avoid pedestrians may use information from LIDAR or other range-based sensors. An example method involves: (a) receiving, at a computing device, range data corresponding to a plurality of objects in an environment of a vehicle, wherein the range data comprises a plurality of first data points; (b) generating a spherical data set comprising a plurality of second data points, wherein spherical coordinates for each second data point are generated based on a corresponding one of the first plurality of data points; and (c) determining a two-dimensional map based on the spherical data set comprising the plurality of second data points, wherein the two-dimensional map comprises a plurality of pixels, wherein each pixel of the plurality of pixels is indicative of a plurality of parameters corresponding to the plurality of objects in the environment.

    Abstract translation: 配置成检测和避免行人的自主车辆可以使用来自LIDAR或其他基于范围的传感器的信息。 示例性方法包括:(a)在计算设备处接收与车辆环境中的多个对象相对应的范围数据,其中所述距离数据包括多个第一数据点; (b)产生包括多个第二数据点的球面数据集,其中基于所述第一多个数据点中的相应一个数据点生成每个第二数据点的球坐标; 以及(c)基于包括所述多个第二数据点的球面数据集来确定二维图,其中所述二维图包括多个像素,其中所述多个像素中的每个像素指示多个 对应于环境中的多个对象的参数。

    Object bounding box estimation
    7.
    发明授权
    Object bounding box estimation 有权
    对象边界框估计

    公开(公告)号:US09256226B1

    公开(公告)日:2016-02-09

    申请号:US14252966

    申请日:2014-04-15

    Applicant: Google Inc.

    Abstract: Aspects of the disclosure relate generally to maneuvering autonomous vehicles. Specifically, the vehicle may use a laser to collect scan data for a section of roadway. The vehicle may access a detailed map including the section of the roadway. A disturbance indicative of an object and including a set of data points data may be identified from the scan data based on the detailed map. The detailed map may also be used to estimate a heading of the disturbance. A bounding box for the disturbance may be estimated using the set of data points as well as the estimated heading. The parameters of the bounding box may then be adjusted in order to increase or maximize the average density of data points of the disturbance along the edges of the bounding box visible to the laser. This adjusted bounding box may then used to maneuver the vehicle.

    Abstract translation: 本公开的方面通常涉及操纵自主车辆。 具体地,车辆可以使用激光来收集道路的一部分的扫描数据。 车辆可以访问包括道路部分的详细地图。 可以根据详细地图从扫描数据识别表示对象并包括一组数据点数据的干扰。 详细的地图也可以用来估计干扰的方向。 可以使用该组数据点以及估计的标题来估计扰动的边界框。 然后可以调整边界框的参数,以便增加或最大化沿着激光可见的边界框的边缘的扰动的数据点的平均密度。 然后可以使用该调整的边界框来操纵车辆。

    Characterizing optically reflective features via hyper-spectral sensor
    8.
    发明授权
    Characterizing optically reflective features via hyper-spectral sensor 有权
    通过超光谱传感器表征光学反射特征

    公开(公告)号:US09234618B1

    公开(公告)日:2016-01-12

    申请号:US13629378

    申请日:2012-09-27

    Applicant: Google Inc.

    Abstract: A light detection and ranging device associated with an autonomous vehicle scans through a scanning zone while emitting light pulses and receives reflected signals corresponding to the light pulses. The reflected signals indicate a three-dimensional point map of the distribution of reflective points in the scanning zone. A hyperspectral sensor images a region of the scanning zone corresponding to a reflective feature indicated by the three-dimensional point map. The output from the hyperspectral sensor includes spectral information characterizing a spectral distribution of radiation received from the reflective feature. The spectral characteristics of the reflective feature allow for distinguishing solid objects from non-solid reflective features, and a map of solid objects is provided to inform real time navigation decisions.

    Abstract translation: 与自主车辆相关联的光检测和测距装置在发射光脉冲的同时扫描扫描区域并接收对应于光脉冲的反射信号。 反射信号表示扫描区域中反射点分布的三维点图。 高光谱传感器对与三维点图所示的反射特征对应的扫描区域进行成像。 来自高光谱传感器的输出包括表征从反射特征接收的辐射的光谱分布的光谱信息。 反射特征的光谱特征允许区分固体物体与非固体反射特征,并且提供固体物体的映射以通知实时导航决定。

    Detecting road weather conditions
    9.
    发明授权
    Detecting road weather conditions 有权
    检测道路天气情况

    公开(公告)号:US09110196B2

    公开(公告)日:2015-08-18

    申请号:US13623397

    申请日:2012-09-20

    Applicant: Google Inc.

    Abstract: Aspects of the disclosure relate generally to detecting road weather conditions. Vehicle sensors including a laser, precipitation sensors, and/or camera may be used to detect information such as the brightness of the road, variations in the brightness of the road, brightness of the world, current precipitation, as well as the detected height of the road. Information received from other sources such as networked based weather information (forecasts, radar, precipitation reports, etc.) may also be considered. The combination of the received and detected information may be used to estimate the probability of precipitation such as water, snow or ice in the roadway. This information may then be used to maneuver an autonomous vehicle (for steering, accelerating, or braking) or identify dangerous situations.

    Abstract translation: 本公开的方面通常涉及检测道路天气状况。 可以使用包括激光,降水传感器和/或照相机的车辆传感器来检测诸如道路的亮度,道路亮度的变化,世界的亮度,当前的降水以及检测到的高度 马路。 也可以考虑从其他来源获得的信息,例如网络天气信息(预测,雷达,降水报告等)。 接收和检测信息的组合可用于估计巷道中的降水概率,例如水,雪或冰。 然后可以使用该信息来操纵自主车辆(用于转向,加速或制动)或识别危险情况。

Patent Agency Ranking