公开(公告)号：US08948498B1

公开(公告)日：2015-02-03

申请号：US13974129

申请日：2013-08-23

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  James R. Bruce

IPC: G06K9/00 ,  G06T15/04

CPC classification number: G06T15/04 ,  G06T17/00 ,  G06T2210/56

Abstract: Examples disclose a method and system to transform a colored point cloud to a 3D textured mesh. The method may be executable to identify a location on a 2D image of an object, identify a location on a 3D image of the object, and determine a color associated with the location on the 2D image. Determining a color may include receiving data associated with a simulation of a plurality of rays cast on the 3D image, identifying a color of the location on the 3D image associated with the received data, identifying a confidence level associated with the identified color of the location on the 3D image, and associating the identified color of the location on the 3D image with the location on the 2D image.

Abstract translation: 实例公开了将彩色点云变换为3D纹理网格的方法和系统。 该方法可以执行以识别对象的2D图像上的位置，识别对象的3D图像上的位置，并且确定与2D图像上的位置相关联的颜色。 确定颜色可以包括接收与在3D图像上投射的多个光线的模拟相关联的数据，识别与所接收的数据相关联的3D图像上的位置的颜色，识别与所识别的位置的颜色相关联的置信度 并且将3D图像上的位置的识别颜色与2D图像上的位置相关联。

公开(公告)号：US20140253546A1

公开(公告)日：2014-09-11

申请号：US14284889

申请日：2014-05-22

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, JR. ,  Anthony Gerald Francis, JR. ,  Arshan Poursohi ,  James R. Bruce ,  Thor Lewis ,  Chaitanya Gharpure

IPC: G06T19/20 ,  G06T17/00

CPC classification number: G06T19/20 ,  G06T15/20 ,  G06T17/00 ,  G06T2219/2004 ,  G09G5/00

Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve providing to a display device for display a first 3D object data model and a second 3D object data model. Information associated with a modification to the first 3D object data model may be received. Based on the received information, a same change may be applied to the first 3D object data model and applied to the second 3D object data model to obtain a first modified 3D object data model and a second modified 3D object data model. According to the method, the first modified 3D object data model and the second modified 3D object data model may be provided to the display device for substantially simultaneous display.

Abstract translation: 提供了与多个三维（3D）对象数据模型进行交互的方法和系统。 示例性方法可以涉及向显示设备提供用于显示第一3D对象数据模型和第二3D对象数据模型。 可以接收与第一3D对象数据模型的修改相关联的信息。 基于接收到的信息，可以将相同的变化应用于第一3D对象数据模型并应用于第二3D对象数据模型以获得第一修改的3D对象数据模型和第二修改3D对象数据模型。 根据该方法，可以将第一修改3D对象数据模型和第二修改3D对象数据模型提供给显示装置，以便基本上同时显示。

公开(公告)号：US08922576B2

公开(公告)日：2014-12-30

申请号：US14284889

申请日：2014-05-22

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  Anthony Gerald Francis, Jr. ,  Arshan Poursohi ,  James R. Bruce ,  Thor Lewis ,  Chaitanya Gharpure

IPC: G09G5/00 ,  G06T19/20 ,  G06T17/00

CPC classification number: G06T19/20 ,  G06T15/20 ,  G06T17/00 ,  G06T2219/2004 ,  G09G5/00

Abstract: Methods and systems for interacting with multiple three-dimensional (3D) object data models are provided. An example method may involve providing to a display device for display a first 3D object data model and a second 3D object data model. Information associated with a modification to the first 3D object data model may be received. Based on the received information, a same change may be applied to the first 3D object data model and applied to the second 3D object data model to obtain a first modified 3D object data model and a second modified 3D object data model. According to the method, the first modified 3D object data model and the second modified 3D object data model may be provided to the display device for substantially simultaneous display.

Abstract translation: 提供了与多个三维（3D）对象数据模型交互的方法和系统。 示例性方法可以涉及向显示设备提供用于显示第一3D对象数据模型和第二3D对象数据模型。 可以接收与第一3D对象数据模型的修改相关联的信息。 基于接收到的信息，可以将相同的变化应用于第一3D对象数据模型并应用于第二3D对象数据模型以获得第一修改的3D对象数据模型和第二修改3D对象数据模型。 根据该方法，可以将第一修改3D对象数据模型和第二修改3D对象数据模型提供给显示装置，以便基本上同时显示。

公开(公告)号：US08831366B1

公开(公告)日：2014-09-09

申请号：US13673994

申请日：2012-11-10

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  Anthony Gerald Francis, Jr. ,  Arshan Poursohi ,  James R. Bruce ,  Thor Lewis ,  Chaitanya Gharpure ,  Won Chun

IPC: G06K9/36 ,  G06K9/46 ,  G06T9/00

CPC classification number: G06T15/10 ,  G06T9/001 ,  G06T15/80 ,  G06T19/20 ,  G06T2219/2012 ,  G06T2219/2021

Abstract: Methods and systems for encoding and compressing 3D object data models are provided. An example method may involve receiving 3D mesh data for an object that includes geometry coordinates for a surface of the object. Additionally, material properties may be associated with the geometry coordinates. The method may also include identifying multiple portions of the mesh data based on the material properties associated with the geometry coordinates. For example, a given group of adjacent geometry coordinates having common material properties may be identified as a given portion. For at least some of the identified portions of the mesh data, the method may further include encoding information related to an identified portion of the mesh data and compressing the encoded information into a file of compressed geometric data.

Abstract translation: 提供了用于编码和压缩3D对象数据模型的方法和系统。 示例性方法可以涉及接收包括对象表面的几何坐标的对象的3D网格数据。 另外，材料属性可以与几何坐标相关联。 该方法还可以包括基于与几何坐标相关联的材料属性来识别网格数据的多个部分。 例如，具有共同材料属性的给定组的相邻几何坐标可以被识别为给定部分。 对于网格数据的所识别的部分的至少一些，该方法还可以包括对与网格数据的识别部分相关的信息进行编码，并将编码的信息压缩成压缩几何数据的文件。

公开(公告)号：US08817021B1

公开(公告)日：2014-08-26

申请号：US13644680

申请日：2012-10-04

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  Anthony Gerald Francis, Jr. ,  Arshan Poursohi ,  James R. Bruce ,  Thor Lewis ,  Chaitanya Gharpure

IPC: G06T17/00

CPC classification number: G06T15/00 ,  G06F17/30271

Abstract: Methods and systems for writing, interpreting, and translating three-dimensional (3D) scenes are provided. An example method may involve accessing data associated with a three-dimensional (3D) scene that includes one or more objects of the 3D scene and one or more rendering effects for the one or more objects. Requests for assets and instructions associated with rendering the one or more objects based on the data associated with the 3D scene may be determined and sent to a server. Additionally, the method may include receiving from the server assets and instructions that facilitate rendering the one or more objects based on the one or more rendering effects. According to the method, the one or more objects of the 3D scene may be rendered based on the received instructions and the received assets.

Abstract translation: 提供了编写，解释和翻译三维（3D）场景的方法和系统。 示例性方法可以涉及访问与包括3D场景的一个或多个对象和一个或多个对象的一个​​或多个呈现效果的三维（3D）场景相关联的数据。 可以确定与基于与3D场景相关联的数据呈现一个或多个对象相关联的资产和指令的请求，并将其发送到服务器。 另外，该方法可以包括从服务器接收资源和基于一个或多个呈现效果来促进呈现一个或多个对象的指令。 根据该方法，3D场景的一个或多个对象可以基于接收到的指令和接收到的资产来呈现。

公开(公告)号：US08848201B1

公开(公告)日：2014-09-30

申请号：US13793071

申请日：2013-03-11

Applicant: Google Inc.

Inventor： James R. Bruce ,  Ryan Hickman ,  Arshan Poursohi

IPC: G01B11/24

CPC classification number: G01B11/24 ,  G01B21/047

Abstract: Methods and systems for multi-modal three-dimensional (3D) scanning of objects are described. An example method may include receiving, from a scanning system, 3D information associated with an object having a first resolution. A region of interest of the object may be determined by a processor based on the 3D information associated with the object. Additionally, instructions for operating the scanning system to determine additional information associated with the region of interest of the object may be determined. The additional information associated with the region of interest may have a second resolution that is higher than the first resolution. The instructions may be provided to the scanning system to determine the additional information associated with the region of interest of the object.

Abstract translation: 描述了用于多模态三维（3D）扫描对象的方法和系统。 示例性方法可以包括从扫描系统接收与具有第一分辨率的对象相关联的3D信息。 对象的感兴趣区域可以由处理器基于与对象相关联的3D信息来确定。 此外，可以确定用于操作扫描系统以确定与对象的感兴趣区域相关联的附加信息的指令。 与感兴趣区域相关联的附加信息可以具有高于第一分辨率的第二分辨率。 可以向扫描系统提供指令以确定与对象的感兴趣区域相关联的附加信息。

公开(公告)号：US20130262511A1

公开(公告)日：2013-10-03

申请号：US13791182

申请日：2013-03-08

Applicant: GOOGLE INC.

Inventor： James J. Kuffner, JR. ,  James R. Bruce ,  Arshan Poursohi ,  Ryan Hickman

IPC: G06F17/30

CPC classification number: G06F17/30047 ,  G06F17/30259 ,  G06F17/30268 ,  G06T15/50 ,  G06T2215/16

Abstract: Methods and systems are provided for determining and transmitting applicable lighting information, applicable viewing perspective, and a 3D model for an object in response to a search query. An example method includes receiving, at a server, a search query regarding an object. A 3D model for the object is determined. The 3D model includes three-dimensional shape information about the object. The method also includes determining, based on a plurality of stored images of the object, at least one applicable light field and at least one applicable viewing perspective. A search query result is transmitted from the server. The search query result may include the 3D model, the applicable light field(s), and the applicable viewing perspective(s). A server and a non-transitory computer readable medium are also disclosed that could perform a similar method.

Abstract translation: 提供了用于响应于搜索查询来确定和传送可应用的照明信息，适用的观看透视图和用于对象的3D模型的方法和系统。 一种示例性方法包括在服务器处接收关于对象的搜索查询。 确定对象的3D模型。 3D模型包括关于对象的三维形状信息。 该方法还包括基于对象的多个存储的图像来确定至少一个可应用的光场和至少一个适用的观看透视图。 从服务器发送搜索查询结果。 搜索查询结果可以包括3D模型，可应用的光场和适用的观看透视图。 还公开了可以执行类似方法的服务器和非暂时计算机可读介质。

公开(公告)号：US09836483B1

公开(公告)日：2017-12-05

申请号：US14010642

申请日：2013-08-27

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  James R. Bruce ,  Anthony G. Francis, Jr. ,  Arshan Poursohi ,  Chaitanya Gharpure

IPC: G06F17/30

CPC classification number: G06F17/30259

Abstract: Methods and systems for comparing a 3D model of a target object to a shape-search database are provided. An example method includes using a mobile device to acquire a plurality of images of a target object, determining a 3D model based on the images, transmitting a search query that includes the 3D model, and receiving a search query result. In another example method, a server could receive a search query that includes a 3D model of an object, compare the 3D model to a shape-search database, generate a search query result based on the comparison, and transmit the search query result. The search query result could include one or more of: information regarding the target object, information regarding one or more objects similar to the target object, and a suggestion for acquiring additional images of the target object.

公开(公告)号：US09417185B1

公开(公告)日：2016-08-16

申请号：US14058949

申请日：2013-10-21

Applicant: Google Inc.

Inventor： James R. Bruce ,  Ryan Hickman ,  James J. Kuffner, Jr. ,  Arshan Poursohi

IPC: G01N21/55 ,  G06T15/04 ,  G06T15/00 ,  G06T7/40

CPC classification number: G01N21/55 ,  G01N2021/559 ,  G06T7/40 ,  G06T15/00 ,  G06T15/04

Abstract: Methods and systems for controlling light arrays to determine properties of an object are described. An example method includes causing illumination of a surface of an object from multiple illumination positions using a programmable array of lights, and receiving images from an image-capture device while the surface of the object is illuminated. For example, the programmable array of lights may be modulated to cause illumination of a portion of the surface of the object from first and second illumination positions, and a first and second image of the surface of the object captured during illumination from the first and second illumination positions respectively may be received. Subsequently, a processor may determine material information for the object based on an amount of specular reflectivity for the surface of the object and reference to a database of known amounts of specular reflectivity for a plurality of materials.

Abstract translation: 描述了用于控制光阵列以确定对象的属性的方法和系统。 示例性方法包括：使用可编程阵列阵列从多个照明位置照射物体的表面，并且在物体的表面被照亮的同时从图像捕获装置接收图像。 例如，可编程阵列的光可以被调制以使得来自第一和第二照明位置的物体表面的一部分的照明，以及在照明期间从第一和第二照明位置捕获的物体的表面的第一和第二图像 可以分别接收照明位置。 随后，处理器可以基于物体表面的镜面反射率的量并且参考多个材料的已知量的镜面反射率的数据库来确定物体的材料信息。

公开(公告)号：US09183672B1

公开(公告)日：2015-11-10

申请号：US13895167

申请日：2013-05-15

Applicant: Google Inc.

Inventor： Ryan Hickman ,  James J. Kuffner, Jr. ,  Anthony Gerald Francis, Jr. ,  Arshan Poursohi ,  James R. Bruce ,  Thor Lewis ,  Chaitanya Gharpure

IPC: G06T17/00 ,  G06T19/00

CPC classification number: G06T15/005 ,  G06F17/2247

Abstract: Methods and systems for providing a three-dimensional (3D) image viewer in a webpage are provided. According to an example method, a webpage may be provided, and the webpage may include embedded language that identifies a 3D image viewer to be provided within the webpage. Based on the embedded language, a computer having a processor and a memory may request information associated with rendering a 3D object data model in the 3D image viewer. The method may also include providing the 3D image viewer within the webpage, and receiving information associated with rendering the 3D object data model. Additionally, the 3D object data model may be rendered in the 3D image viewer based on the received information. Additional example systems and methods are described herein.

Abstract translation: 提供了一种用于在网页中提供三维（3D）图像查看器的方法和系统。 根据示例性方法，可以提供网页，并且网页可以包括标识要在网页内提供的3D图像查看器的嵌入语言。 基于嵌入式语言，具有处理器和存储器的计算机可以请求与在3D图像查看器中呈现3D对象数据模型相关联的信息。 该方法还可以包括在网页内提供3D图像查看器，以及接收与呈现3D对象数据模型相关联的信息。 另外，3D对象数据模型可以基于所接收的信息在3D图像查看器中呈现。 本文描述了另外的示例性系统和方法。