公开(公告)号：US20160191722A1

公开(公告)日：2016-06-30

申请号：US15066105

申请日：2016-03-10

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04N1/00 ,  H04N5/232 ,  H04N5/77 ,  H04N5/225

CPC classification number: H04N1/00204 ,  H04N1/2133 ,  H04N1/215 ,  H04N1/32128 ,  H04N5/2257 ,  H04N5/232 ,  H04N5/23229 ,  H04N5/772 ,  H04N2201/0084 ,  H04N2201/3247 ,  H04N2201/3252

Abstract: Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.

公开(公告)号：US09274369B1

公开(公告)日：2016-03-01

申请号：US13664147

申请日：2012-10-30

Applicant: Google Inc.

Inventor： Johnny Lee ,  Eric Peeters ,  Eric Teller

IPC: H01J29/10 ,  G02F1/1335 ,  F21V8/00

CPC classification number: G02F1/133524 ,  G02B6/0005 ,  G02F1/13336

Abstract: A display tile includes a display panel and a fused fiber bundle overlay. The display panel includes display pixels and a bezel surrounding the display pixels. The fused fiber bundle overlay includes an input side mounted adjacent to the display panel and optically aligned with the display pixels to receive image light, an emission side opposite the input side to emit the image light, and an array of fused fibers each extending from the input side to the emission side and each including an input end and an emission end. At least a portion of the fused fibers are tapered.

Abstract translation: 显示瓦片包括显示面板和熔融纤维束覆盖层。 显示面板包括显示像素和围绕显示像素的边框。 熔融纤维束覆盖层包括安装在显示面板附近并与显示像素光学对准以接收图像光的输入侧，与输入侧相对的发射侧以发射图像光的发射侧，以及熔融光纤阵列， 输入侧到发射侧，并且每个包括输入端和发射端。 熔融纤维的至少一部分是锥形的。

公开(公告)号：US20150381860A1

公开(公告)日：2015-12-31

申请号：US14750958

申请日：2015-06-25

Applicant: Google Inc.

Inventor： Renzo De Nardi ,  Johnny Lee ,  Alan Beltran ,  Ashish Shah

IPC: H04N5/225 ,  H04N5/247

CPC classification number: H04N5/247 ,  G06F1/1632 ,  G06F1/1686 ,  H04N5/2251

Abstract: A user portable device includes a device chassis comprising at least one opening at a surface of the device chassis and a sensor assembly aligned with the at least one opening. The sensor assembly includes a mounting structure and a plurality of sensors mounted to the mounting structure. The sensors include at least two sensors utilized by the user portable device based on a specified geometric configuration between the at least two sensors. The user portable device further includes a mounting fastener that mounts the sensor assembly to the device chassis so as to isolate the sensor assembly from deformation of the surface of the device chassis along one or more axes during user handling, and thus aid in preventing alteration of a baseline geometric configuration of one or more sensors of the sensor assembly due to the chassis deformation.

Abstract translation: 用户便携式设备包括设备底盘，其包括在设备底盘的表面处的至少一个开口和与所述至少一个开口对准的传感器组件。 传感器组件包括安装结构和安装到安装结构的多个传感器。 所述传感器包括至少两个由所述用户便携式设备基于所述至少两个传感器之间的指定几何配置所使用的传感器。 用户便携式设备还包括安装紧固件，其将传感器组件安装到设备底盘，以便在用户处理期间将传感器组件与装置底盘的表面沿着一个或多个轴线隔离，并因此有助于防止改变 由于底盘变形，传感器组件的一个或多个传感器的基线几何构型。

公开(公告)号：US20150237479A1

公开(公告)日：2015-08-20

申请号：US14184929

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04W4/02 ,  G06T7/20

CPC classification number: H04W4/026 ,  G06T7/246 ,  G06T2207/10004 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/30241

Abstract: Methods and systems for cross-validating sensor data are described. An example method involves receiving image data and first timing information associated with the image data, and receiving sensor data and second timing information associated with the sensor data. The method further involves determining a first estimation of motion of the mobile device based on the image data and the first timing information, and determining a second estimation of the motion of the mobile device based on the sensor data and the second timing information. Additionally, the method involves determining whether the first estimation is within a threshold variance of the second estimation. The method then involves providing an output indicative of a validity of the first timing information and the second timing information based on whether the first estimation is within the threshold variance of the second estimation.

Abstract translation: 描述用于交叉验证传感器数据的方法和系统。 示例性方法包括接收与图像数据相关联的图像数据和第一定时信息，以及接收与传感器数据相关联的传感器数据和第二定时信息。 该方法还包括基于图像数据和第一定时信息确定移动设备的运动的第一估计，以及基于传感器数据和第二定时信息确定移动设备的运动的第二估计。 另外，该方法包括确定第一估计是否在第二估计的阈值方差内。 该方法然后包括基于第一估计是否在第二估计的阈值方差内提供指示第一定时信息和第二定时信息的有效性的输出。

公开(公告)号：US20150237269A1

公开(公告)日：2015-08-20

申请号：US14185477

申请日：2014-02-20

Applicant: Google Inc.

Inventor： Joel Hesch ,  Ryan Hickman ,  Johnny Lee

IPC: H04N5/262 ,  G06T7/00 ,  H04N5/225 ,  H04N5/232

CPC classification number: H04N5/2628 ,  G06T15/205 ,  H04N5/2258 ,  H04N5/23229 ,  H04N5/23293 ,  H04N5/2621 ,  H04N2209/047 ,  H04W4/026 ,  H04W4/027

Abstract: Example methods and systems for adjusting sensor viewpoint to a virtual viewpoint are provided. An example method may involve receiving data from a first camera; receiving data from a second camera; transforming, from the first viewpoint to a virtual viewpoint within the device, frames in a first plurality of frames based on an offset from the first camera to the virtual viewpoint; determining, in a second plurality of frames, one or more features and a movement, relative to the second viewpoint, of the one or more features; and transforming, from the second viewpoint to the virtual viewpoint, the movement of the one or more features based on an offset from the second camera to the virtual viewpoint; adjusting the transformed frames of the virtual viewpoint by an amount that is proportional to the transformed movement; and providing for display the adjusted and transformed frames of the first plurality of frames.

Abstract translation: 提供了将传感器视点调整到虚拟视点的示例性方法和系统。 示例性方法可以涉及从第一相机接收数据; 从第二相机接收数据; 基于从第一摄像机到虚拟视点的偏移，从设备内的第一视点到虚拟视点转换第一多个帧中的帧; 在第二多个帧中确定所述一个或多个特征的一个或多个特征和相对于所述第二视点的运动; 并且从第二观点向虚拟视点将基于从第二照相机的偏移到所述虚拟视点的所述一个或多个特征的移动; 将所述虚拟视点的变换帧调整与所述变换的运动成比例的量; 以及提供用于显示所述第一多个帧的已调整和变换的帧。

公开(公告)号：US20150237223A1

公开(公告)日：2015-08-20

申请号：US14185091

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04N1/00 ,  H04N5/77 ,  H04N5/225

CPC classification number: H04N1/00204 ,  H04N1/2133 ,  H04N1/215 ,  H04N1/32128 ,  H04N5/2257 ,  H04N5/232 ,  H04N5/23229 ,  H04N5/772 ,  H04N2201/0084 ,  H04N2201/3247 ,  H04N2201/3252

Abstract: Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.

Abstract translation: 描述了用于在移动设备上传送传感器数据的方法和系统。 一种示例性方法包括由处理器和惯性测量单元（IMU）接收对应于第一时间帧的传感器数据，以及使用数据缓冲器存储传感器数据。 处理器还可以接收对应于第二时间帧的图像数据和传感器数据。 然后，处理器可以生成至少包括对应于第二时间帧的图像数据和对应于第一时间帧和第二时间帧的传感器数据的数字图像。 处理器可以将对应于第一时间帧和第二时间帧的存储的传感器数据嵌入数字图像的像素中。 并且处理器可以将数字图像提供给移动设备的应用处理器。

公开(公告)号：US20150235335A1

公开(公告)日：2015-08-20

申请号：US14185027

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: G06T1/00 ,  H04M1/02

CPC classification number: G06T1/0021 ,  G03B19/00 ,  H04N5/23229

Abstract: Methods and systems for detecting frame tears are described. As one example, a mobile device may include at least one camera, a sensor, a co-processor, and an application processor. The co-processor is configured to generate a digital image including image data from the at least one camera and sensor data from the sensor. The co-processor is further configured to embed a frame identifier corresponding to the digital image at least two corner pixels of the digital image. The application processor is configured to receive the digital image from the co-processor, determine a first value embedded in a first corner pixel of the digital image, and determined a second value embedded in a second corner pixel of the digital image. The application processor is also configured to provide an output indicative of a validity of the digital image based on a comparison between the first value and the second value.

Abstract translation: 描述了用于检测框架撕裂的方法和系统。 作为一个示例，移动设备可以包括至少一个相机，传感器，协处理器和应用处理器。 协处理器被配置为生成包括来自至少一个照相机的图像数据和来自传感器的传感器数据的数字图像。 协处理器还被配置为将与数字图像相对应的帧标识符嵌入数字图像的至少两个角落像素。 应用处理器被配置为从协处理器接收数字图像，确定嵌入在数字图像的第一角落像素中的第一值，并且确定嵌入在数字图像的第二角落像素中的第二值。 应用处理器还被配置为基于第一值和第二值之间的比较来提供指示数字图像的有效性的输出。