公开(公告)号：US20160191722A1

公开(公告)日：2016-06-30

申请号：US15066105

申请日：2016-03-10

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04N1/00 ,  H04N5/232 ,  H04N5/77 ,  H04N5/225

CPC classification number: H04N1/00204 ,  H04N1/2133 ,  H04N1/215 ,  H04N1/32128 ,  H04N5/2257 ,  H04N5/232 ,  H04N5/23229 ,  H04N5/772 ,  H04N2201/0084 ,  H04N2201/3247 ,  H04N2201/3252

Abstract: Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.

公开(公告)号：US20150237479A1

公开(公告)日：2015-08-20

申请号：US14184929

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04W4/02 ,  G06T7/20

CPC classification number: H04W4/026 ,  G06T7/246 ,  G06T2207/10004 ,  G06T2207/10012 ,  G06T2207/10028 ,  G06T2207/30241

Abstract: Methods and systems for cross-validating sensor data are described. An example method involves receiving image data and first timing information associated with the image data, and receiving sensor data and second timing information associated with the sensor data. The method further involves determining a first estimation of motion of the mobile device based on the image data and the first timing information, and determining a second estimation of the motion of the mobile device based on the sensor data and the second timing information. Additionally, the method involves determining whether the first estimation is within a threshold variance of the second estimation. The method then involves providing an output indicative of a validity of the first timing information and the second timing information based on whether the first estimation is within the threshold variance of the second estimation.

Abstract translation: 描述用于交叉验证传感器数据的方法和系统。 示例性方法包括接收与图像数据相关联的图像数据和第一定时信息，以及接收与传感器数据相关联的传感器数据和第二定时信息。 该方法还包括基于图像数据和第一定时信息确定移动设备的运动的第一估计，以及基于传感器数据和第二定时信息确定移动设备的运动的第二估计。 另外，该方法包括确定第一估计是否在第二估计的阈值方差内。 该方法然后包括基于第一估计是否在第二估计的阈值方差内提供指示第一定时信息和第二定时信息的有效性的输出。

公开(公告)号：US20150237223A1

公开(公告)日：2015-08-20

申请号：US14185091

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: H04N1/00 ,  H04N5/77 ,  H04N5/225

CPC classification number: H04N1/00204 ,  H04N1/2133 ,  H04N1/215 ,  H04N1/32128 ,  H04N5/2257 ,  H04N5/232 ,  H04N5/23229 ,  H04N5/772 ,  H04N2201/0084 ,  H04N2201/3247 ,  H04N2201/3252

Abstract: Methods and systems for communicating sensor data on a mobile device are described. An example method involves receiving, by a processor and from an inertial measurement unit (IMU), sensor data corresponding to a first timeframe, and storing the sensor data using a data buffer. The processor may also receive image data and sensor data corresponding to a second timeframe. The processor may then generate a digital image that includes at least the image data corresponding to the second timeframe and the sensor data corresponding to the first timeframe and the second timeframe. The processor may embed the stored sensor data corresponding to the first timeframe and the second timeframe in pixels of the digital image. And the processor may provide the digital image to an application processor of the mobile device.

Abstract translation: 描述了用于在移动设备上传送传感器数据的方法和系统。 一种示例性方法包括由处理器和惯性测量单元（IMU）接收对应于第一时间帧的传感器数据，以及使用数据缓冲器存储传感器数据。 处理器还可以接收对应于第二时间帧的图像数据和传感器数据。 然后，处理器可以生成至少包括对应于第二时间帧的图像数据和对应于第一时间帧和第二时间帧的传感器数据的数字图像。 处理器可以将对应于第一时间帧和第二时间帧的存储的传感器数据嵌入数字图像的像素中。 并且处理器可以将数字图像提供给移动设备的应用处理器。

公开(公告)号：US20150235335A1

公开(公告)日：2015-08-20

申请号：US14185027

申请日：2014-02-20

Applicant: Google Inc.

Inventor： James Fung ,  Joel Hesch ,  Johnny Lee

IPC: G06T1/00 ,  H04M1/02

CPC classification number: G06T1/0021 ,  G03B19/00 ,  H04N5/23229

Abstract: Methods and systems for detecting frame tears are described. As one example, a mobile device may include at least one camera, a sensor, a co-processor, and an application processor. The co-processor is configured to generate a digital image including image data from the at least one camera and sensor data from the sensor. The co-processor is further configured to embed a frame identifier corresponding to the digital image at least two corner pixels of the digital image. The application processor is configured to receive the digital image from the co-processor, determine a first value embedded in a first corner pixel of the digital image, and determined a second value embedded in a second corner pixel of the digital image. The application processor is also configured to provide an output indicative of a validity of the digital image based on a comparison between the first value and the second value.

Abstract translation: 描述了用于检测框架撕裂的方法和系统。 作为一个示例，移动设备可以包括至少一个相机，传感器，协处理器和应用处理器。 协处理器被配置为生成包括来自至少一个照相机的图像数据和来自传感器的传感器数据的数字图像。 协处理器还被配置为将与数字图像相对应的帧标识符嵌入数字图像的至少两个角落像素。 应用处理器被配置为从协处理器接收数字图像，确定嵌入在数字图像的第一角落像素中的第一值，并且确定嵌入在数字图像的第二角落像素中的第二值。 应用处理器还被配置为基于第一值和第二值之间的比较来提供指示数字图像的有效性的输出。